Skip to content

Default to DeepSeek-V4.1-Flash (deepseek-flash), on dated rate cards - #4

Merged
lroolle merged 1 commit into
mainfrom
v41-flash
Sep 18, 2026
Merged

lroolle merged 1 commit into
mainfrom
v41-flash

Conversation

@lroolle

@lroolle lroolle commented Sep 18, 2026

Copy link
Copy Markdown
Member

DeepSeek-V4.1-Flash shipped 2026-09-10 as deepseek-flash (changelog 2026-09-10). V4 Flash and V4 Flash Vision Exp are retired; their names are still accepted, served by V4.1 Flash and billed at the Flash price. V4 Pro continues with billing unchanged.

What changed

  • Default model -> deepseek-flash in the CLI, scheduled jobs and the eval runner. Every built-in sub-agent role runs on it, including reviewer, which ran pro.
  • Why Flash over Pro, with sources. DeepSeek's changelog, on the benchmarks both the 2026-09-10 (V4.1 Flash) and 2026-08-13 (V4 Pro GA) entries report: Terminal Bench 2.1 90.6 vs 87.9, NL2Repo 65.4 vs 61.5, CyberGym 88.1 vs 83.3, HLE with tools 63.9 vs 60.0. HLE without tools goes the other way, 36.8 vs 42.7. Our own eval has not been re-run on V4.1.
  • Dated rate cards. The catalog still carried the 2026-08-02 flat card; the 2026-08-16 time-of-use repricing never reached it. It now holds three dated cards (flat; V4 from 2026-08-16 16:00 UTC; V4.1 from 2026-09-10 11:00 UTC) with peak at 2x, weekdays only after 2026-08-22 16:00 UTC. The V4.1 instant is inferred, not published: our docs mirror read the old card at 04:50 UTC and the new one at 11:27 UTC. deepseek-cli and dsh-meter use the same instant. Pro is unchanged across it. eval/pricing.json carries the same cards.
  • Retired names still work. deepseek-v4-flash and deepseek-v4-flash-vision-exp are accepted, so existing jobs keep validating, and they price as flash. Help text and known: lists offer only the current names.
  • Compaction summaries run with thinking off. Measured on deepseek-flash: with thinking on, a 512-token cap (the floor on small context budgets) came back 512/512 reasoning and no text, so compaction fell back to the emergency summary without saying so. With thinking off, the same call returned the summary in 165 tokens. The /seek planner keeps thinking and its 8192 cap; one live plan fit.
  • Tripwire. tests/claims.test.ts pins every published default-model and price claim (README table, --model line, eval commands in README and EVAL.md, the eval runner's default, eval card, sub-agent roles) to the catalog. Nine deliberate breaks, nine reds.

Verification

  • bun test tests: 150 pass (was 133).
  • Live: dsc -p "Reply with exactly the word: pong" --output-format json -> "result":"pong","model":"deepseek-flash", 1083 in / 3 out.

No version bump: the V4-Pro GA PR (#1) set the precedent for model-alignment changes.

🤖 Generated with Claude Code

…cards

DeepSeek-V4.1-Flash shipped 2026-09-10 as `deepseek-flash`. V4 Flash and
V4 Flash Vision Exp are retired; their names still work, are served by
V4.1 Flash and bill at the Flash price. V4 Pro continues, billing
unchanged. GET /models lists exactly deepseek-flash and deepseek-v4-pro.

- Default model is deepseek-flash (CLI, jobs, eval runner). Every
  sub-agent role runs on it, including reviewer, which ran pro. README
  cites DeepSeek's own changelog for why: on the benchmarks both the
  2026-09-10 and 2026-08-13 entries report, Flash leads on Terminal
  Bench 2.1, NL2Repo, CyberGym and HLE with tools, and trails on HLE
  without tools. Our own eval has not been re-run on V4.1.
- Pricing was still the 2026-08-02 flat card: the 2026-08-16 time-of-use
  repricing never reached it. The catalog now holds dated cards (flat,
  V4, V4.1 from 2026-09-10 11:00 UTC, an inferred instant shared with
  deepseek-cli and dsh-meter) with peak at 2x, weekdays only from
  2026-08-22 16:00 UTC. Retired names price as flash. eval/pricing.json
  carries the same cards, off-peak.
- Help and "known:" lists offer only the current names; retired names
  are still accepted so existing jobs keep validating.
- Compaction's summary call now disables thinking. Measured on
  deepseek-flash: with thinking on, a 512-token cap (the floor on small
  context budgets) came back 512/512 reasoning and no text, so
  compaction silently fell back to the emergency summary. With thinking
  off the same call returned the summary in 165 tokens. The /seek
  planner keeps thinking and its 8192 cap; one live plan fit.
- tests/claims.test.ts pins every published default-model and price
  claim (README, EVAL.md, eval runner, eval card, roles) to the catalog;
  each of nine deliberate breaks turned it red.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
@lroolle
lroolle merged commit e88243f into main Sep 18, 2026
1 check passed
@lroolle
lroolle deleted the v41-flash branch September 18, 2026 06:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant