mlx-bun library API
    Preparing search index...
    interface Glm52RuntimeOpenOptions {
        batchSize?: number;
        caches?: Glm52LatentCaches;
        contextTokens?: number;
        enableMtp?: boolean;
        libraryPath?: string;
        machineBytes?: number;
        maxGenerationTokens?: number;
        memoryBudgetBytes?: number;
        mtpDraftTokens?: number;
    }

    Hierarchy (View Summary)

    Index
    batchSize?: number

    Maximum ordinary continuous-batch rows.

    The composition's KV scheme and paging, which the graph's latent caches compose (default f32, unpaged).

    contextTokens?: number

    Context reserved by the exact GLM resource equation.

    enableMtp?: boolean

    Native checkpoint MTP row; on by default.

    libraryPath?: string

    Native expert-I/O dylib override. Packaged/dev defaults are automatic.

    machineBytes?: number

    Test/diagnostic override; normal callers use physical RAM.

    maxGenerationTokens?: number

    Generated-token allowance within contextTokens.

    memoryBudgetBytes?: number

    Whole-process ceiling. Defaults to the smaller of the validated 25 GiB preset and physical RAM.

    mtpDraftTokens?: number