Class Qwen3TextAttention<L>

Text positions are selected by the text phase, never by media state.

Type Parameters

L extends AttentionLinear = QuantizedLinear

Hierarchy (View Summary)

Qwen3Attention<L>
- Qwen3TextAttention

Index

Constructors

Properties

headDim kNorm kProj nHeads nKvHeads oProj qNorm qProj reads ropeBase ropeDims scale vProj

Methods

forward forwardMedia forwardPositioned forwardText

Constructors

constructor

new Qwen3TextAttention<L extends AttentionLinear = QuantizedLinear>(
    weights: Weights,
    config: ModelConfig,
    prefix: string,
    projections: QwenAttentionProjections<L>,
    reads?: AttentionReadStrategy,
): Qwen3TextAttention<L>
Type Parameters
- L extends AttentionLinear = QuantizedLinear
Parameters
- weights: Weights
- config: ModelConfig
- prefix: string
- projections: QwenAttentionProjections<L>
- reads: AttentionReadStrategy = cacheRead
Returns Qwen3TextAttention<L>
Overrides Qwen3Attention.constructor
- Defined in packages/inference/src/models/qwen/blocks.ts:384

Properties

`Readonly`headDim

headDim: number

`Readonly`kNorm

kNorm: RMSNorm

`Readonly`kProj

kProj: L

`Readonly`nHeads

nHeads: number

`Readonly`nKvHeads

nKvHeads: number

`Readonly`oProj

oProj: L

`Readonly`qNorm

qNorm: RMSNorm

`Readonly`qProj

qProj: L

`Readonly`reads

reads: AttentionReadStrategy = cacheRead

`Readonly`ropeBase

ropeBase: number

`Readonly`ropeDims

ropeDims: number

`Readonly`scale

scale: number

`Readonly`vProj

vProj: L

Methods

forward

forward(x: MlxArray, cache: Cache, phase: ReadPhase): MlxArray
x [B, L, hidden] (borrowed) to an owned [B, L, hidden], appending to cache and attending through the read phase names. Media forwards supply their own positions in mrope.
Parameters
- x: MlxArray
- cache: Cache
- phase: ReadPhase
Returns MlxArray
Overrides Qwen3Attention.forward
- Defined in packages/inference/src/models/qwen/blocks.ts:387

forwardMedia

forwardMedia(
    x: MlxArray,
    cache: Cache,
    phase: ReadPhase,
    mrope: MropeForwardState,
): MlxArray
Parameters
- x: MlxArray
- cache: Cache
- phase: ReadPhase
- mrope: MropeForwardState
Returns MlxArray
Inherited from Qwen3Attention.forwardMedia
- Defined in packages/inference/src/models/qwen/blocks.ts:306

`Protected`forwardPositioned

forwardPositioned(
    x: MlxArray,
    cache: Cache,
    phase: ReadPhase,
    position: (value: MlxArray) => MlxArray,
): MlxArray
Parameters
- x: MlxArray
- cache: Cache
- phase: ReadPhase
- position: (value: MlxArray) => MlxArray
Returns MlxArray
Inherited from Qwen3Attention.forwardPositioned
- Defined in packages/inference/src/models/qwen/blocks.ts:310

forwardText

forwardText(x: MlxArray, cache: Cache, phase: ReadPhase): MlxArray
Parameters
- x: MlxArray
- cache: Cache
- phase: ReadPhase
Returns MlxArray
Inherited from Qwen3Attention.forwardText
- Defined in packages/inference/src/models/qwen/blocks.ts:298