Class CompiledSiluRMSHeads

Shape-aware replay of the fused activation and Q/K RMS norms. Shared traces take both scale vectors as inputs and retain no layer weights.

Index

Constructors

Properties

keyHeads valueHeads valueWidth

Methods

Constructors

constructor

new CompiledSiluRMSHeads(
    keyHeads: number,
    valueHeads: number,
    valueWidth: number,
): CompiledSiluRMSHeads
Parameters
- keyHeads: number
- valueHeads: number
- valueWidth: number
Returns CompiledSiluRMSHeads
- Defined in packages/inference/src/layers/delta-heads.ts:11

Properties

`Readonly`keyHeads

keyHeads: number

`Readonly`valueHeads

valueHeads: number

`Readonly`valueWidth

valueWidth: number

Methods

forward

forward(
    x: MlxArray,
    qScale: MlxArray,
    kScale: MlxArray,
): [MlxArray, MlxArray, MlxArray]
Parameters
- x: MlxArray
- qScale: MlxArray
- kScale: MlxArray
Returns [MlxArray, MlxArray, MlxArray]
- Defined in packages/inference/src/layers/delta-heads.ts:20