mlx-bun library API
    Preparing search index...

    One request's proposal sources plus the running match state.

    CONTRACT. push() returns a proposal; the caller MUST then call commit() exactly once with the number of ids it actually emitted (all of them for an assert, the accepted prefix for a verify, 0 when it declined). Nothing enters the session's history until commit — so a partial accept needs no rollback here.

    Index
    appendChunkSize: number

    Execution chunk size, independent of the number of tokens injected.

    decode: ((ids: readonly number[]) => string) | null

    Optional token→text decoder for the proposal trace (set by the serve layer, which owns the tokenizer).

    plan: FillPlan
    stats: FillStats = ...
    • Record what the engine actually emitted from proposal (all of it for an assert; the accepted prefix for a verify; 0 when the engine declined). MUST be called exactly once per proposal returned by push().

      Parameters

      Returns void

    • The tool-call parser rejected this request's markup. Strict rows are disarmed for the rest of the request — the template's own rendering disagreed with what the model actually emits, so every further row is suspect. (Echo rows are unaffected: they never claimed to be schema.)

      REALITY NOTE: the served parse (ToolAwareStream.toolCalls → parseGeneratedToolCalls) runs at sink FLUSH, i.e. after the generation has ended, so within one request this is telemetry and the disarm has no remaining tokens to act on. The seam is here so a future incremental parse (or a plan cached across requests) disarms for real.

      Returns void