mlx-bun library API
    Preparing search index...

    Interface DeviceStepSamplerConfig

    interface DeviceStepSamplerConfig {
        acceptGrammar?: boolean;
        captureSelectedLogprob?: boolean;
        captureTopLogprobs?: number;
        eosTokenIds?: readonly number[];
        grammarWait: "external";
        historyUpdate: "manual" | "after-sample";
        initialHistory?: readonly number[];
        sampler?: Sampler;
        tokenRepresentation: "device";
    }

    Hierarchy

    • StepSamplerConfigBase
      • DeviceStepSamplerConfig
    Index
    acceptGrammar? captureSelectedLogprob? captureTopLogprobs? eosTokenIds? grammarWait historyUpdate initialHistory? sampler? tokenRepresentation
    acceptGrammar?: boolean

    Eager-number mode can advance grammar after sampling.

    captureSelectedLogprob?: boolean
    captureTopLogprobs?: number
    eosTokenIds?: readonly number[]
    grammarWait: "external"

    The grammar owner already awaited ready(), or this sampler must do it.

    historyUpdate: "manual" | "after-sample"

    Update processor history in sample(), or let the decode loop commit later.

    initialHistory?: readonly number[]
    sampler?: Sampler

    Reuse a sampler already shared with a speculative draft source.

    tokenRepresentation: "device"

    Settings
    Member Visibility

    On This Page
    Properties