Class QwenDeltaLayer

A recurrent decoder layer whose mixer and MLP are named by its graph.

Hierarchy (View Summary)

QwenDeltaLayer
- QwenResidualDeltaLayer

Index

Constructors

Properties

inputNorm mixer mlp postAttnNorm

Methods

forward forwardAttn forwardMlp

Constructors

constructor

new QwenDeltaLayer(
    weights: Weights,
    config: ModelConfig,
    prefix: string,
    mixer: {
        forward(
            x: MlxArray,
            cache: GatedDeltaCache,
            phase: ReadPhase,
        ): MlxArray;
    },
    mlp: { forward(x: MlxArray): MlxArray },
): QwenDeltaLayer
Parameters
- weights: Weights
- config: ModelConfig
- prefix: string
- mixer: { forward(x: MlxArray, cache: GatedDeltaCache, phase: ReadPhase): MlxArray }
- mlp: { forward(x: MlxArray): MlxArray }
Returns QwenDeltaLayer
- Defined in packages/inference/src/models/qwen/blocks.ts:576

Properties

`Readonly`inputNorm

inputNorm: RMSNorm

`Readonly`mixer

mixer: {
forward(x: MlxArray, cache: GatedDeltaCache, phase: ReadPhase): MlxArray;
}

`Readonly`mlp

mlp: { forward(x: MlxArray): MlxArray }

`Readonly`postAttnNorm

postAttnNorm: RMSNorm

Methods

forward

forward(x: MlxArray, cache: Cache, phase: ReadPhase): MlxArray
Parameters
- x: MlxArray
- cache: Cache
- phase: ReadPhase
Returns MlxArray
- Defined in packages/inference/src/models/qwen/blocks.ts:592

forwardAttn

forwardAttn(x: MlxArray, cache: Cache, phase: ReadPhase): MlxArray
Parameters
- x: MlxArray
- cache: Cache
- phase: ReadPhase
Returns MlxArray
- Defined in packages/inference/src/models/qwen/blocks.ts:582

forwardMlp

forwardMlp(x: MlxArray): MlxArray
Parameters
- x: MlxArray
Returns MlxArray
- Defined in packages/inference/src/models/qwen/blocks.ts:587