mlx-bun library API
    Preparing search index...

    Class QwenResidualAttentionLayer

    The corresponding residual/normalization kernel after full attention.

    Hierarchy (View Summary)

    Index
    constructor
    inputNorm mixer mlp postAttnNorm
    forward forwardAttn forwardMlp
    inputNorm: RMSNorm
    mixer: {
        forward(
            x: MlxArray,
            cache: Cache,
            phase: ReadPhase,
            positions?: MropeForwardState | null,
        ): MlxArray;
    }
    mlp: { forward(x: MlxArray): MlxArray }
    postAttnNorm: RMSNorm

    Settings
    Member Visibility

    On This Page
    Constructors
    Properties
    Methods