mlx-bun library API
    Preparing search index...

    Class UniversalMLP

    Index
    constructor
    adapters down gate gateUp kind swigluFn up
    forward
    adapters: {
        down: QuantizedLinear | TrellisLinear | null;
        gate: QuantizedLinear | TrellisLinear | null;
        gateUp: QuantizedLinear | TrellisLinear | null;
        up: QuantizedLinear | TrellisLinear | null;
    }

    The projections adapters mount on, read at load.

    down: AnyLinear
    gate: AnyLinear | null
    gateUp: AnyLinear | null
    kind: "swiglu" | "geglu" | "geglu_approx" | "fused_swiglu" | "gelu_mlp"
    swigluFn: SwigluFn | null = compiledSwiglu

    Fused swiglu (silu(gate)*up), default = the oracle's @mx.compile closure. Only consumed for the swiglu / fused_swiglu kinds; geglu/geglu_approx/gelu_mlp are unaffected (the oracle does NOT @mx.compile those — gemma/gemma2/starcoder2 use a plain nn.gelu composition). Set to null for the uncompiled composition.

    up: AnyLinear | null

    Settings
    Member Visibility

    On This Page
    Constructors
    Properties
    Methods