Skip to content

Sync .github/skills directory with azure-sdk-tools for PR 16380 - #50048

Open
azure-sdk-automation[bot] wants to merge 1 commit into
mainfrom
sync-.github-skills-fix/vally-skill-eval-environment-skills-16380
Open

Sync .github/skills directory with azure-sdk-tools for PR 16380#50048
azure-sdk-automation[bot] wants to merge 1 commit into
mainfrom
sync-.github-skills-fix/vally-skill-eval-environment-skills-16380

Conversation

@azure-sdk-automation

Copy link
Copy Markdown
Contributor

Sync .github/skills directory with azure-sdk-tools for PR Azure/azure-sdk-tools#16380 See eng/common workflow

Copilot AI lite review requested due to automatic review settings August 6, 2026 01:59
@azure-sdk-automation
azure-sdk-automation Bot requested a review from a team as a code owner August 6, 2026 01:59
@azure-sdk-automation azure-sdk-automation Bot added EngSys This issue is impacting the engineering system. Central-EngSys This issue is owned by the Engineering System team. labels Aug 6, 2026
@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
36 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Note

Copilot could not run the full agentic suite for this review because it was automatically requested on a bot-authored pull request. Request a review from Copilot under Reviewers to retry with the full agentic suite. Improved support for bot-authored pull requests is coming soon.

Updates multiple GitHub skill definitions and evaluation configs to improve skill routing/trigger coverage and make eval stimuli load the intended skills/tools more explicitly.

Changes:

  • Standardized eval configuration blocks (e.g., defaults) and expanded stimuli to include environment.skills.
  • Refined trigger/anti-trigger prompts to better disambiguate between closely related skills (release vs pipeline-fix vs analysis vs APIView, etc.).
  • Updated SKILL.md trigger guidance to include additional “how-to” release queries and examples.

Reviewed changes

Copilot reviewed 9 out of 9 changed files in this pull request and generated 1 comment.

Show a summary per file
File Description
.github/skills/azsdk-common-sdk-release/evals/trigger.eval.yaml Adds per-stimulus environment.skills and expands trigger/anti-trigger prompts for release routing.
.github/skills/azsdk-common-sdk-release/SKILL.md Broadens documented triggers/examples toward release process/checklist queries.
.github/skills/azsdk-common-prepare-release-plan/evals/trigger.eval.yaml Adds environment.skills and introduces a tool-call-based grader for the explicit link PR → release plan route.
.github/skills/azsdk-common-prepare-release-plan/SKILL.md Refines skill description and trigger phrases for release plan management scenarios.
.github/skills/azsdk-common-pipeline-fixer/evals/trigger.eval.yaml Adds environment.skills and strengthens anti-trigger separation from analysis-only and release flows.
.github/skills/azsdk-common-pipeline-analysis/evals/trigger.eval.yaml Adds environment.skills and clarifies “analyze only” prompts vs “fix” prompts.
.github/skills/azsdk-common-generate-sdk-locally/evals/eval.yaml Adds environment.skills and improves prompts to better encode required context/tool routing for local vs pipeline generation.
.github/skills/azsdk-common-apiview-feedback-resolution/evals/trigger.eval.yaml Adds environment.skills and improves APIView prompts/anti-triggers for stronger routing.
.github/skills/azsdk-common-apiview-feedback-resolution/evals/eval.yaml Adds skill-loading via YAML anchor/alias, plus stronger tool-call expectations for APIView flows.

Comment on lines +23 to +26
environment:
&apiviewSkill # Load the real skill so the executor can route to it and call its tools.
skills:
- ..
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Central-EngSys This issue is owned by the Engineering System team. EngSys This issue is impacting the engineering system.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants