mlx-bun library API
    Preparing search index...

    Module @mlx-bun/inference/layers

    Affine3MmaLinear
    Affine3RowsLinear
    Affine4MmaLinear
    Affine4RowsLinear
    AffineRowLinear
    AffineSplitMmaLinear
    AneAffineSplit
    AneTrellisExpandedMlpSplit
    AneTrellisExpandedMlpSplitK3i
    AneTrellisExpandReduce
    AneTrellisExpandScatter
    AneTrellisMlpSplit
    AneTrellisMlpSplitK3i
    CodebookDownK3iRow
    CodebookDownRow
    CodebookGateUpRow
    CodebookMmaDown
    CodebookMmaDownK3i
    CodebookMmaGateUp
    CodebookSplitGateUpRow
    CompiledGatedRMSNorm
    CompiledGeglu
    CompiledGegluMLP
    CompiledResidualRMSNorm
    CompiledSiluRMSHeads
    DenseEmbedding
    DenseLinear
    DequantizedLinear
    DequantizedMatmulLinear
    ExpandedTrellisLinear
    FactoredDownK3iRow
    FactoredDownK3iRows
    FactoredDownRow
    FactoredDownRows
    FactoredGateUpRow
    FactoredGateUpRows
    FactoredMixedGateUp
    GegluMLP
    LayerNorm
    MmaDown
    MmaDownK3i
    MmaDownWide
    MmaDownWideK3i
    MmaGateUp
    MmaGateUpWide
    NoRope
    PlainGeglu
    PlainGegluMLP
    QuantizedEmbedding
    QuantizedLinear
    QuantizedLinearPlain
    QuantizedLinearRows
    QuantizedSwitchLinear
    ReduceGateUpRow
    ReduceGateUpRows
    ReduceMixedGateUp
    ReduceSplitMixedGateUp
    RMSNorm
    ScatterDownK3iRow
    ScatterDownK3iRows
    ScatterDownRow
    ScatterDownRows
    TrellisExpandReducePrompt
    TrellisExpandScatterPrompt
    TrellisFusedMLP
    TrellisLinear
    TrellisReducePrompt
    TrellisScatterPrompt
    TrellisSplitKPrompt
    TrellisTiledPrompt
    TrellisUnfusedMLP
    TrellisWidePrompt
    UniversalRope
    QuantizedLinearState
    Rope2dTables
    RowProjection
    AneGpuMlpRows
    AneGpuRows
    AneMlpSplit
    AnyEmbedding
    AnyLinear
    AnyNorm
    RopeScalingConfig
    DEQUANTIZED_MIN_ROWS
    FINFO_MIN
    FUSED_N_CHUNK
    aneAffineSplitProgram
    aneChannels
    aneMlpSplitProgram
    applyInterleavedRope
    applyRope2d
    bidirMask
    buildMropePositions
    compiledGeglu
    compiledSwiglu
    createCausalMask
    dequantizedMinRows
    disposing
    foldedQuantizedSdpa
    foldedQuantizedSdpaEligible
    foldedSdpa
    foldedSdpaEligible
    fusedGateUpEligible
    fusedGateUpSwiglu
    fusedSdpaConfigSupported
    geglu
    initializeRope
    interleavedSelector
    loadEmbedding
    loadLayerNorm
    loadLinear
    loadRmsNorm
    mropeInvFreq
    mropePositionIds
    phi3SuRope
    quantizedAppendAttention
    quantizedSdpaGroupedHeads
    quantizedSdpaTiled
    quantizedSdpaUnfused
    qwenRopeIndex
    rope2dTables
    trellisGeometry
    trellisRows
    trellisStoredRows
    LoraDelta → LoraDelta
    LoraOperation → LoraOperation
    LoraState → LoraState
    MixedGateUpTail → MixedGateUpTail
    MropeForwardState → MropeForwardState
    MropeRequestState → MropeRequestState
    TRELLIS_MATVEC_MAX_M → TRELLIS_MATVEC_MAX_M
    TrellisGeometry → TrellisGeometry

    Settings
    Member Visibility

    On This Page
    Classes
    Affine3MmaLinearAffine3RowsLinearAffine4MmaLinearAffine4RowsLinearAffineRowLinearAffineSplitMmaLinearAneAffineSplitAneTrellisExpandedMlpSplitAneTrellisExpandedMlpSplitK3iAneTrellisExpandReduceAneTrellisExpandScatterAneTrellisMlpSplitAneTrellisMlpSplitK3iCodebookDownK3iRowCodebookDownRowCodebookGateUpRowCodebookMmaDownCodebookMmaDownK3iCodebookMmaGateUpCodebookSplitGateUpRowCompiledGatedRMSNormCompiledGegluCompiledGegluMLPCompiledResidualRMSNormCompiledSiluRMSHeadsDenseEmbeddingDenseLinearDequantizedLinearDequantizedMatmulLinearExpandedTrellisLinearFactoredDownK3iRowFactoredDownK3iRowsFactoredDownRowFactoredDownRowsFactoredGateUpRowFactoredGateUpRowsFactoredMixedGateUpGegluMLPLayerNormMmaDownMmaDownK3iMmaDownWideMmaDownWideK3iMmaGateUpMmaGateUpWideNoRopePlainGegluPlainGegluMLPQuantizedEmbeddingQuantizedLinearQuantizedLinearPlainQuantizedLinearRowsQuantizedSwitchLinearReduceGateUpRowReduceGateUpRowsReduceMixedGateUpReduceSplitMixedGateUpRMSNormScatterDownK3iRowScatterDownK3iRowsScatterDownRowScatterDownRowsTrellisExpandReducePromptTrellisExpandScatterPromptTrellisFusedMLPTrellisLinearTrellisReducePromptTrellisScatterPromptTrellisSplitKPromptTrellisTiledPromptTrellisUnfusedMLPTrellisWidePromptUniversalRope
    Interfaces
    Type Aliases
    Variables
    Functions
    References