Skip to content

feat(dashboard): compare providers side by side#1731

Merged
christso merged 1 commit into
mainfrom
av-94ni-model-compare-dogfood
Jul 7, 2026
Merged

feat(dashboard): compare providers side by side#1731
christso merged 1 commit into
mainfrom
av-94ni-model-compare-dogfood

Conversation

@christso

@christso christso commented Jul 7, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Preserve multi-provider results in /api/compare instead of deduping same-run test cases by test_id alone.
  • Add a Dashboard Provider/model comparison table with per-test provider columns, score/pass status, duration, answer preview, and raw answer/grading/transcript links.
  • Update Dashboard docs to describe provider/model comparison through providers and provider labels, not a separate models field.

Validation

  • bun test apps/dashboard/src/components/AnalyticsTab.test.tsx
  • bun test apps/cli/test/commands/results/serve.test.ts --test-name-pattern "GET /api/compare"
  • cd apps/dashboard && bun run build
  • bun --filter agentv build
  • Live dogfood: Promptfoo eval eval-O2u-2026-07-07T13:55:57; AgentV eval .agentv/results/2026-07-07T14-06-40-813Z; Dashboard UAT via agent-browser on rebuilt apps/dashboard/dist.

Evidence

Private evidence is in EntityProcess/agentv-private branch evidence/av-94ni-model-compare-dogfood at commit b066718.

Beads

  • av-nlpr
  • av-94ni
  • av-v9gy
  • Follow-up created: av-9ywp.1 for a future differing-output filter.

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Jul 7, 2026

Copy link
Copy Markdown

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: e93d5ad
Status: ✅  Deploy successful!
Preview URL: https://6045b511.agentv.pages.dev
Branch Preview URL: https://av-94ni-model-compare-dogfoo.agentv.pages.dev

View logs

@christso christso force-pushed the av-94ni-model-compare-dogfood branch from 6d389fe to e93d5ad Compare July 7, 2026 14:50
@christso christso merged commit e11a1c5 into main Jul 7, 2026
9 checks passed
@christso christso deleted the av-94ni-model-compare-dogfood branch July 7, 2026 14:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant