Class Glm52CanonicalQ4MetalExecutor

Q4 (packed nibbles, affine zero-point 8) kernel family for the GLM-5.2 production geometry.

Hierarchy

Glm52CanonicalMetalExecutor
- Glm52CanonicalQ4MetalExecutor

Index

Constructors

Methods

dispose execute

Constructors

constructor

new Glm52CanonicalQ4MetalExecutor(): Glm52CanonicalQ4MetalExecutor
Returns Glm52CanonicalQ4MetalExecutor
Overrides Glm52CanonicalMetalExecutor.constructor
- Defined in packages/inference/src/kernels/glm52/streamed-experts.ts:332

Methods

dispose

dispose(): void
Returns void
Inherited from Glm52CanonicalMetalExecutor.dispose
- Defined in packages/inference/src/kernels/glm52/streamed-experts.ts:321

execute

execute(
    input: MlxArray,
    slot: MlxArray,
    layout: Glm52CanonicalMetalLayout,
): MlxArray
Parameters
- input: MlxArray
- slot: MlxArray
- layout: Glm52CanonicalMetalLayout
Returns MlxArray
Inherited from Glm52CanonicalMetalExecutor.execute
- Defined in packages/inference/src/kernels/glm52/streamed-experts.ts:263