mlx-bun library API
    Preparing search index...

    Class UniversalAttention

    Index
    constructor
    a adapters kNorm kProj oProj qkvProj qNorm qProj reads rope softcap vProj
    forward
    a: UniversalArgs
    adapters: {
        k: QuantizedLinear | TrellisLinear | null;
        o: QuantizedLinear | TrellisLinear | null;
        q: QuantizedLinear | TrellisLinear | null;
        qkv: QuantizedLinear | TrellisLinear | null;
        v: QuantizedLinear | TrellisLinear | null;
    }

    The projections adapters mount on, read at load.

    kNorm: RMSNorm | null
    kProj: AnyLinear | null
    oProj: AnyLinear
    qkvProj: AnyLinear | null
    qNorm: RMSNorm | null
    qProj: AnyLinear | null
    reads: AttentionReadStrategy

    How the block reads its cache, composed by the graph from the descriptor.

    rope: UniversalRope
    softcap: number | null

    Bound at construction: the score softcap composes the manual attention over dense K/V arrays (any storage, fetched dense) as this block's read; without it, the block reads through the cache's own read, which also attends encoded KV.

    vProj: AnyLinear | null

    Settings
    Member Visibility

    On This Page
    Constructors
    Properties
    Methods