mlx-bun library API
    Preparing search index...

    Class UniversalLayer

    Index
    constructor
    a attn extraNorm1 extraNorm2 inputNorm mlp postAttnNorm
    forward
    a: UniversalArgs
    attn: UniversalAttention
    extraNorm1: AnyNorm | null

    gemma2: pre_feedforward. glm4: post_self_attn (on attn out).

    extraNorm2: AnyNorm | null

    gemma2: post_feedforward. glm4: post_mlp. post: post_feedforward.

    inputNorm: AnyNorm | null

    pre/gemma2/glm4: input_layernorm. post (olmo2): unused (null).

    mlp: UniversalMLP
    postAttnNorm: AnyNorm

    pre: post_attention_layernorm (pre-MLP). post: post_attention (on attn out). gemma2: post_attention (on attn out). glm4: post_attention (pre-MLP).

    Settings
    Member Visibility

    On This Page
    Constructors
    Properties
    Methods