Class UnsortedSwitchGLU

constructor

• new UnsortedSwitchGLU(
      base: SwitchGLU,
      activation: { forward(gate: MlxArray, up: MlxArray): MlxArray },
  ): UnsortedSwitchGLU

  Parameters

  • base: SwitchGLU
  • activation: { forward(gate: MlxArray, up: MlxArray): MlxArray }

  Returns UnsortedSwitchGLU

Readonlyactivation

Readonlybase

forward

• forward(x: MlxArray, indices: MlxArray): MlxArray

  Parameters

  • x: MlxArray
  • indices: MlxArray

  Returns MlxArray