Class SortedSwitchGLU

constructor

• new SortedSwitchGLU(
      base: SwitchGLU,
      activation: { forward(gate: MlxArray, up: MlxArray): MlxArray },
  ): SortedSwitchGLU

  Parameters

  • base: SwitchGLU
  • activation: { forward(gate: MlxArray, up: MlxArray): MlxArray }

  Returns SortedSwitchGLU

Readonlyactivation

Readonlybase

forward

• forward(x: MlxArray, indices: MlxArray): MlxArray

  Parameters

  • x: MlxArray
  • indices: MlxArray

  Returns MlxArray