mlx-bun library API
    Preparing search index...
    • Parameters

      • config: ModelConfig
      • weightsBytes: number
      • ctx: number
      • machine: MachineSpec = ...
      • chunk: number = DEFAULT_CHUNK
      • expertsBytes: number = 0

        Bytes of .experts. tensors (registry). MoE decode reads only top_k/num_experts of them per token; residency still needs all.

      • OptionalusableBytes: number

        Explicit memory budget in bytes (admission control). When set it replaces the machine-derived usable ceiling (ram × WIRED_FRACTION) outright — the budget IS the usable envelope.

      • OptionalkvScheme: KvSchemeOptions

        Active KV-quant scheme; a quantized cache holds more context in the same budget, so the solved ceiling (and admission) must bill it.

      Returns FitReport