Conversation
…late wording, fix stale docs
…eature bits, dispatcher validation
…d prompt budget fitting
… with reference id fixtures
…nstruction out of the baked suffix
…per prefix limits; clamp keyword budgets
…ocabulary, prefix or diarization is requested
This reverts commit 078648b.
…unless vocabulary, prefix or diarization is requested" This reverts commit 7ccfac6.
- typescript: marshal vocabulary as a char* array (it reached C as one empty string: 2+ terms were rejected, 1 was ignored); validate terms; free the buffer after each call - python: accept iterators for vocabulary, reject sets/dicts (priority order) - all: reject NUL characters in string options instead of truncating (Rust already errored) - rust: #[non_exhaustive] on Task and Feature - model-gated prompting tests for typescript, rust and swift; python tests tightened (unsupported prefix on the streaming canary, batch/stream cases) - terse prompting docs in each binding README and doc comments
…whisper: full prompt on later ALL_SEGMENTS windows - causal_lm: kv_grow reallocates a single-utterance cache and copies the filled rows, for decodes whose length is not known up front - voxtral: free-text (INSTRUCT) output is no longer capped by the audio-derived transcript budget (448 tokens on short clips); it runs until EOS, a repetition stop or the context ceiling (n_ctx still caps it). The cache starts at the transcript size and grows as needed. INSTRUCT batches run serially, since the packed batched cache cannot grow per row - whisper: with a transcript prefix, only the first window's prompt is shortened to make room for it; later ALL_SEGMENTS windows get the full slot
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.