Class GateDownMLP

A gate/up operation already includes the activation; its down projection is another operation the graph names. Both borrow their input.

Index

Constructors

Properties

Methods

Constructors

constructor

new GateDownMLP(gateUp: RowProjection, down: RowProjection): GateDownMLP
Parameters
- gateUp: RowProjection
- down: RowProjection
Returns GateDownMLP
- Defined in packages/inference/src/models/qwen/written-layers.ts:91

Properties

`Readonly`down

down: RowProjection

`Readonly`gateUp

gateUp: RowProjection

Methods

forward

forward(x: MlxArray): MlxArray
Parameters
- x: MlxArray
Returns MlxArray
- Defined in packages/inference/src/models/qwen/written-layers.ts:92