Skip to content

docs(evals): audit Promptfoo schema parity#1726

Merged
christso merged 1 commit into
mainfrom
av-tm9k-schema-parity
Jul 7, 2026
Merged

docs(evals): audit Promptfoo schema parity#1726
christso merged 1 commit into
mainfrom
av-tm9k-schema-parity

Conversation

@christso

@christso christso commented Jul 7, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • adds a Promptfoo schema parity audit for AgentV eval authoring at docs/plans/promptfoo-schema-parity-audit.md
  • records concrete keep/modify/remove recommendations for AgentV-only eval fields
  • creates and links follow-up Beads for actionable schema/docs work

Follow-up Beads

  • av-ibec: hard-deprecate top-level eval YAML experiment
  • av-sdit: align provider declarations with Promptfoo provider schema
  • av-9j60: enforce snake_case eval wire keys with Promptfoo camelCase boundary mapping
  • av-sve2: move eval-level defaults/top-level assert toward compatible slots
  • av-n7ic: align or reclassify extensions
  • av-8h4l: prune Promptfoo-incompatible run-policy fields
  • av-eniz: converge eval metadata/tags
  • av-ij5o: clarify AgentV-only authored assertion types

Validation

  • git diff --cached --check
  • research-only task: no builds/tests/evals run

@cloudflare-workers-and-pages

Copy link
Copy Markdown

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: 85e4933
Status: ✅  Deploy successful!
Preview URL: https://cb85f56d.agentv.pages.dev
Branch Preview URL: https://av-tm9k-schema-parity.agentv.pages.dev

View logs

@christso christso marked this pull request as ready for review July 7, 2026 13:32
@christso christso merged commit 91fb908 into main Jul 7, 2026
9 checks passed
@christso christso deleted the av-tm9k-schema-parity branch July 7, 2026 13:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant