mlx-bun library API
    Preparing search index...

    Interface RuntimeOpenOptions

    Options every planned runtime understands; a runtime ignores what it has no use for. Unset values take the runtime's own preset.

    interface RuntimeOpenOptions {
        batchSize?: number;
        contextTokens?: number;
        kv?: KvStorageScheme;
        libraryPath?: string;
        machineBytes?: number;
        maxGenerationTokens?: number;
        memoryBudgetBytes?: number;
        nativeDraft?: boolean;
        pagedKv?: { blockSize: number } | null;
    }
    Index
    batchSize? contextTokens? kv? libraryPath? machineBytes? maxGenerationTokens? memoryBudgetBytes? nativeDraft? pagedKv?
    batchSize?: number

    Maximum ordinary continuous-batch rows.

    contextTokens?: number

    Context tokens the plan reserves.

    kv?: KvStorageScheme

    The composition's KV scheme and paging, which the runtime's caches compose (unset: unquantized, unpaged).

    libraryPath?: string

    Native loader library override.

    machineBytes?: number

    Test/diagnostic override; normal callers use physical RAM.

    maxGenerationTokens?: number

    Generated-token allowance within contextTokens.

    memoryBudgetBytes?: number

    Whole-process ceiling in bytes.

    nativeDraft?: boolean

    The checkpoint-native draft head, on by default where the checkpoint has one.

    pagedKv?: { blockSize: number } | null

    Settings
    Member Visibility

    On This Page
    Properties