mlx-bun library API
    Preparing search index...

    Module @mlx-bun/inference/execution

    EngineSession
    ExecutionCoordinator
    ExecutionTasks
    MlxBatchExecutionGroup
    MlxPrefillCohort
    MlxPrefillRows
    BatchRequestFields
    BatchStats
    ExclusiveLock
    MlxBatchExecutionGroupOptions
    MlxBatchGroup
    MlxGatewayBinding
    MlxGroupedMethod
    MlxGroupMethodHost
    MlxGroupMethodRequest
    MlxGroupPreparation
    MlxPrefillRowsHost
    MlxPrefillState
    MlxPrefillStep
    OrdinaryContinuation
    PrefillState
    Row
    SessionResources
    BatchRequest
    MlxPrefillForward
    RowSampler
    bindMlxGateway
    createAutoregressiveMethod
    createDenoisingMethod
    createOrdinaryContinuationRequest
    createRowSampling
    driveExecutionGroup
    resolveExecution
    stepTraceReport
    AdmissionPool → AdmissionPool
    AdmissionRejected → AdmissionRejected
    applyStateChanges → applyStateChanges
    CancellationSource → CancellationSource
    cleanupFailure → cleanupFailure
    configureRuntime → configureRuntime
    createInferenceEngine → createInferenceEngine
    createRuntimeConfig → createRuntimeConfig
    disposeResources → disposeResources
    EngineOptions → EngineOptions
    GenerationCancelled → GenerationCancelled
    ownResource → ownResource
    runtimeConfig → runtimeConfig
    RuntimeConfig → RuntimeConfig
    runtimeFlag → runtimeFlag
    runtimeKey → runtimeKey
    RuntimeKey → RuntimeKey
    runtimeNumber → runtimeNumber
    RuntimeOverrides → RuntimeOverrides
    runtimeValue → runtimeValue
    throwIfCancelled → throwIfCancelled
    withResource → withResource
    withRuntimeConfig → withRuntimeConfig

    Settings
    Member Visibility

    On This Page
    Classes
    Interfaces
    Type Aliases
    Functions
    References