mlx-bun library API
    Preparing search index...

    Type Alias FoldOp

    FoldOp:
        | { kind: "passthrough" }
        | { kind: "ones"; n: number }
        | { gamma?: string; kind: "input" }
        | { kind: "output" }
        | { kind: "bias" }
        | { gammaEmbed: string; gammaHidden: string; kind: "mtp-fc" }

    Fold a qwen3_5 VL trunk (or text-only model when it has no vision tower). Handles both tied (clones an untied folded lm_head) and untied heads.

    Type Declaration

    • { kind: "passthrough" }
    • { kind: "ones"; n: number }
    • { gamma?: string; kind: "input" }

      Reader: fold the last (input) axis; γ (by tensor name) premultiplied.

    • { kind: "output" }

      Writer: R1ᵀ on the output axis of a 2-D [out, in] weight.

    • { kind: "bias" }

      Writer bias: R1ᵀ on a 1-D vector.

    • { gammaEmbed: string; gammaHidden: string; kind: "mtp-fc" }

      MTP fc [H, 2H]: per-block input folds (embed γ, hidden γ) + output fold.

    Settings
    Member Visibility