Class PlainRouter

Ordinary router slice, with no compiled-trace form selection.

Hierarchy

Router
- PlainRouter

Index

Constructors

Properties

eps layerIdx normWeight numExperts perExpertScale proj topK

Methods

Constructors

constructor

new PlainRouter(
    weights: Weights,
    config: ModelConfig,
    prefix: string,
): PlainRouter
Parameters
- weights: Weights
- config: ModelConfig
- prefix: string
Returns PlainRouter
Overrides Router.constructor
- Defined in packages/inference/src/models/gemma4/written-blocks.ts:214

Properties

`Readonly`eps

eps: number

`Readonly`layerIdx

layerIdx: number

Decoder layer index (parsed from the weight prefix) — for E0 tracing.

`Readonly`normWeight

normWeight: MlxArray

scale · hidden_size^-0.5, precomputed (identical ops to the per-call product in the reference: bf16 array × weak scalar).

`Readonly`numExperts

numExperts: number

`Readonly`perExpertScale

perExpertScale: MlxArray

`Readonly`proj

proj: QuantizedLinear

`Readonly`topK

topK: number

Methods

forward

forward(x: MlxArray): { indices: MlxArray; weights: MlxArray }
x [B, L, H] → { indices [B, L, k] (uint32), weights [B, L, k] }.
Parameters
- x: MlxArray
Returns { indices: MlxArray; weights: MlxArray }
Overrides Router.forward
- Defined in packages/inference/src/models/gemma4/written-blocks.ts:217