generic prompting in interface - #178

Open

cjpais wants to merge 32 commits into

mainfrom

generic-prompting

Commits on Sep 27, 2026

prompting prereqs: drop voxtral INITIAL_PROMPT bit, IBM granite translate wording, fix stale docs
cjpais
committed
c683647
prompting core ABI: vocabulary/prompt/prefix fields, INSTRUCT task, feature bits, dispatcher validation
cjpais
committed
e20948a
prompting: log why a prompting request is rejected
cjpais
committed
685a0d7
prompting bindings (python, rust, swift, ts) and CLI flags
cjpais
committed
3be96ed
whisper: vocabulary and context prompt in the startofprev slot
cjpais
committed
7f2aa4d
qwen3_asr: vocabulary and context prompt in the system message; shared prompt budget fitting
cjpais
committed
4ed172e
granite: vocabulary as keyword-list biasing (4.0, 4.1, 4.1-plus)
cjpais
committed
80c4ab5
voxtral: TRANSCRIBE_TASK_INSTRUCT through the chat instruct path
cjpais
committed
459c981
funasr_nano: vocabulary as the upstream hotword list
cjpais
committed
8e9a9b0
whisper: transcript prefix after the SOT sequence, first window only
cjpais
committed
9c11c2d
prompting: document AUTO timestamps under a prefix
cjpais
committed
2355363
canary2: transcript prefix via user_prefix; SentencePiece BPE encoder with reference id fixtures
cjpais
committed
0afce1a
granite: transcript prefix on 4.1-plus via prefix_text
cjpais
committed
84df795
granite: simplify prefix trim
cjpais
committed
9a71694
moss: vocabulary as the upstream hotword hint; converter splits the instruction out of the baked suffix
cjpais
committed
975985b
docs: prompting line per model doc
cjpais
committed
ce7c494
python: model-gated prompting tests
cjpais
committed
ceb033d
prompting: reject bad prompting text before clearing the result; whisper prefix limits; clamp keyword budgets
cjpais
committed
265f12d
prompting acceptance tolerances
cjpais
committed
bbd5b57
granite: decode budget for the word-timestamps task
cjpais
committed
9f76384
granite: timestamps AUTO selects word timestamps on 4.1-plus unless vocabulary, prefix or diarization is requested
cjpais
committed
7ccfac6
docs: granite-plus timestamps AUTO
cjpais
committed
078648b
prompting tolerances: voxtral, granite-plus AUTO
cjpais
committed
14ca031
prompting tolerances: fun-asr mlt-nano
cjpais
committed
04b34fd
Revert "docs: granite-plus timestamps AUTO"
cjpais
committed
a949cce
Revert "granite: timestamps AUTO selects word timestamps on 4.1-plus unless vocabulary, prefix or diarization is requested"
cjpais
committed
cab3cc0
prompting tolerances: granite-plus word-timestamps note
cjpais
committed
202eec4
review
cjpais
committed
b7fcdd7

Navigation Menu

generic prompting in interface - #178

generic prompting in interface#178
cjpais wants to merge 32 commits into
mainfrom
generic-prompting

Commits on Sep 27, 2026

prompting prereqs: drop voxtral INITIAL_PROMPT bit, IBM granite translate wording, fix stale docs

prompting core ABI: vocabulary/prompt/prefix fields, INSTRUCT task, feature bits, dispatcher validation

prompting: log why a prompting request is rejected

prompting bindings (python, rust, swift, ts) and CLI flags

whisper: vocabulary and context prompt in the startofprev slot

qwen3_asr: vocabulary and context prompt in the system message; shared prompt budget fitting

granite: vocabulary as keyword-list biasing (4.0, 4.1, 4.1-plus)

voxtral: TRANSCRIBE_TASK_INSTRUCT through the chat instruct path

funasr_nano: vocabulary as the upstream hotword list

whisper: transcript prefix after the SOT sequence, first window only

prompting: document AUTO timestamps under a prefix

canary2: transcript prefix via user_prefix; SentencePiece BPE encoder with reference id fixtures

granite: transcript prefix on 4.1-plus via prefix_text

granite: simplify prefix trim

moss: vocabulary as the upstream hotword hint; converter splits the instruction out of the baked suffix

docs: prompting line per model doc

python: model-gated prompting tests

prompting: reject bad prompting text before clearing the result; whisper prefix limits; clamp keyword budgets

prompting acceptance tolerances

granite: decode budget for the word-timestamps task

granite: timestamps AUTO selects word timestamps on 4.1-plus unless vocabulary, prefix or diarization is requested

docs: granite-plus timestamps AUTO

prompting tolerances: voxtral, granite-plus AUTO

prompting tolerances: fun-asr mlt-nano

Revert "docs: granite-plus timestamps AUTO"

Revert "granite: timestamps AUTO selects word timestamps on 4.1-plus unless vocabulary, prefix or diarization is requested"

prompting tolerances: granite-plus word-timestamps note

review

Commits on Sep 28, 2026

bindings: prompting fixes, tests and docs

cli: reject --prefix with --batch; strip a UTF-8 BOM from --vocabulary-file

voxtral: INSTRUCT decodes until EOS, growing the KV cache on demand; whisper: full prompt on later ALL_SEGMENTS windows

docs