Class AffineMlp

constructor

• new AffineMlp(
      gate: QuantizedLinear,
      up: QuantizedLinear,
      down: QuantizedLinear,
  ): AffineMlp

  Parameters

  • gate: QuantizedLinear
  • up: QuantizedLinear
  • down: QuantizedLinear

  Returns AffineMlp

Readonlydown

Readonlygate

Readonlykind

Readonlyup

forward

• forward(x: MlxArray, phase: ReadPhase, _width: number): MlxArray

  x [.., hidden] (borrowed) to an owned [.., hidden], with the projection arithmetic phase names; every width class takes the same kernels.

  Parameters

  • x: MlxArray
  • phase: ReadPhase
  • _width: number

  Returns MlxArray