mlx-bun library API
    Preparing search index...

    A written arrangement qualified on M4 Pro. The loader recommends it; explicit selection remains the caller's choice on any machine.

    Implements

    Index
    appendKnown: readonly MlxKnownRange[]
    cacheLayers: readonly MlxCacheLayer[] = ...
    config: ModelConfig

    Unscaled token embeddings, for media prompts that splice embeddings.

    embeddingPrompt: readonly MlxEmbeddingsRange[]

    Prepared embeddings without explicit positions, indexed by total rows.

    faIdx: 3
    finalNorm: RMSNorm
    graph: "qwen3.8-27b-trellis-3.2bpw-m4pro" = QWEN38_TRELLIS_M4PRO_GRAPH
    graphCapabilities: GraphDeclaration = ...
    knownSpans: { maxChunkSize: (state: readonly Cache[]) => number } = ...

    Committed known-token spans, declared when the composition qualifies them (appendKnown then reads committed).

    loraState: LoraState = ...
    mediaPrefill: readonly MlxPositionedEmbeddingsRange[]
    mediaPrompt: readonly MlxPositionedRange[]
    mixedSeparate: MlxSeparateMixed

    Mixed groups that retain their own projection geometry. The scheduler routes each group independently when a verify group is present.

    multiSequencePrompt: readonly MlxPromptRange[]
    multiSequencePromptChunk: readonly MlxPromptRange[]
    prefixBase: "language_model.model" = PREFIX
    prompt: readonly MlxPromptRange[]
    promptChunk: readonly MlxPromptRange[]

    Optional chunk bindings when a file distinguishes chunks from prompt tails.

    sequence: readonly MlxSequenceRange[]

    Full-sequence scoring operations, indexed by total token rows.

    verifyRoundCosts: Map<number, number> = ...

    Measured cost of a verify forward by its row count, relative to one single-row decode step (rows 1 = 1). Declared only by a graph measured on the hardware it serves; speculative depth scheduling reads it.

    weightsBytes: number
    • Release what the graph built at construction (computed constants, Neural Engine programs, its own weight source where it opened one) once every execution and compiled runner has stopped. A graph that built nothing releases nothing. Its owner (the host, a draft provider) calls it before releasing the weights it supplied.

      Returns void