mlx-bun library API
    Preparing search index...

    Interface NumberStepSamplerConfig

    interface NumberStepSamplerConfig {
        acceptGrammar?: boolean;
        captureSelectedLogprob?: boolean;
        captureTopLogprobs?: number;
        eosTokenIds?: readonly number[];
        grammarWait: "before-sample";
        historyUpdate: "manual" | "after-sample";
        initialHistory?: readonly number[];
        sampler?: Sampler;
        tokenRepresentation: "number";
    }

    Hierarchy

    • StepSamplerConfigBase
      • NumberStepSamplerConfig
    Index
    acceptGrammar? captureSelectedLogprob? captureTopLogprobs? eosTokenIds? grammarWait historyUpdate initialHistory? sampler? tokenRepresentation
    acceptGrammar?: boolean

    Eager-number mode can advance grammar after sampling.

    captureSelectedLogprob?: boolean
    captureTopLogprobs?: number
    eosTokenIds?: readonly number[]
    grammarWait: "before-sample"

    The grammar owner already awaited ready(), or this sampler must do it.

    historyUpdate: "manual" | "after-sample"

    Update processor history in sample(), or let the decode loop commit later.

    initialHistory?: readonly number[]
    sampler?: Sampler

    Reuse a sampler already shared with a speculative draft source.

    tokenRepresentation: "number"

    Settings
    Member Visibility

    On This Page
    Properties