Repository navigation

Add Azure OpenAI Decisions protocol and evaluation metrics to evaluation runners - #49695

Draft

bonanza89 wants to merge 9 commits into

bonanza89:users/aqardahji/openai-decisions

Draft

Add Azure OpenAI Decisions protocol and evaluation metrics to evaluation runners#49695
bonanza89 wants to merge 9 commits into
Azure:mainfrom
bonanza89:users/aqardahji/openai-decisions

Commits on Nov 3, 2026
- Add explicit Azure OpenAI Decisions protocol for evaluators
  Ahmad Qardahji
  committed
  5c3a12a
- Use the Decision-capable asset in the OpenAI example
  Ahmad Qardahji
  committed
  650f707
- Clarify reuse of existing Decision evaluator assets
  Ahmad Qardahji
  committed
  6282ed7
- Add Decision protocol adapters, conversation usage details and metrics
  Ahmad Qardahji
  committed
  a36def6
- Show the built-in evaluators in the OpenAI Decisions sample
  Ahmad Qardahji
  committed
  8373c6e
- Name the decision_protocol fix when a deployment serves the other protocol
  Ahmad Qardahji
  committed
  c0b6931
Commits on Nov 6, 2026
- Merge main into the OpenAI Decisions branch
  Ahmad Qardahji
  committed
  26ddaef
- Report every Decision error kind in evaluation metrics and keep default-path errors unchanged
  Ahmad Qardahji
  committed
  67cf790
- Cover the usage gate and provenance key on successful rows, and tie metric names to the Decision evaluators
  Ahmad Qardahji
  committed
  4ea0574