Skip to content

Update agent CLI pins and add isolated OpenRouter evaluation routing - #6

Merged
hanhainebula merged 3 commits into
mainfrom
feat/agent-cli-openrouter
Sep 27, 2026
Merged

hanhainebula merged 3 commits into
mainfrom
feat/agent-cli-openrouter

Conversation

@hanhainebula

Copy link
Copy Markdown
Collaborator

Summary

  • Update the Agent CLI pins across task images and the launcher: Codex 0.157.1, Claude Code 2.1.283, and Pi 0.87.1.
  • Add opt-in --openrouter routing for Codex and Claude Code. It uses a dedicated AGENT_OPENROUTER_API_KEY, full OpenRouter model IDs, and the appropriate API endpoint for each CLI.
  • Keep the Agent key separate from task-submission and verifier credentials. Verifier versions and configuration are unchanged.
  • Add setup and evaluation examples to both READMEs and the evaluation guide.

Example

bash scripts/run_task.sh --task task-1-1 --agent codex --openrouter \
  --model openai/gpt-6-astra --dry-run

bash scripts/run_task.sh --task task-1-1 --agent claude-code --openrouter \
  --model anthropic/claude-opus-5.5 --dry-run

Set AGENT_OPENROUTER_API_KEY in .env before running an evaluation.

Validation

  • 50 relevant unit tests passed.
  • git diff --check origin/main...HEAD passed.
  • A live OpenRouter evaluation and Docker image builds were not run; a real Agent key has not been configured yet.

Pin Codex 0.157.1, Claude Code 2.1.283, and Pi 0.87.1 across task images, launcher defaults, tests, and documentation.
Add a dedicated Agent OpenRouter key and explicit Codex and Claude Code routes. Keep the full model slug, use each CLI's supported API endpoint, preserve phase-scoped networking, and document the evaluation commands.
@hanhainebula
hanhainebula merged commit c4af5f3 into main Sep 27, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant