Class PackedMixedScope

Group geometry and ownership for written packed operations. The graph supplies each layer's direct calls; this scope selects no numerical operation.

Index

Constructors

Properties

Methods

[dispose] accept finish

Constructors

constructor

new PackedMixedScope(
groups: readonly MlxPhaseGroup[],
embed: (ids: MlxArray) => MlxArray,
): PackedMixedScope
Parameters
- groups: readonly MlxPhaseGroup[]
- embed: (ids: MlxArray) => MlxArray
Returns PackedMixedScope
- Defined in packages/inference/src/input/packed-mixed.ts:12

Properties

`Readonly`groups

groups: readonly MlxPhaseGroup[]

Methods

[dispose]

"[dispose]"(): void
Returns void
- Defined in packages/inference/src/input/packed-mixed.ts:42

accept

accept(
    layer: number,
    attention: (
        hidden: MlxArray,
        cache: Cache,
        phase: "window" | "decode",
    ) => MlxArray,
    mlp: (hidden: MlxArray) => MlxArray,
): void
Parameters
- layer: number
- attention: (hidden: MlxArray, cache: Cache, phase: "window" | "decode") => MlxArray
- mlp: (hidden: MlxArray) => MlxArray
Returns void
- Defined in packages/inference/src/input/packed-mixed.ts:17

finish

finish(layer: number, norm: (hidden: MlxArray) => MlxArray): MlxArray[]
Parameters
- layer: number
- norm: (hidden: MlxArray) => MlxArray
Returns MlxArray[]
- Defined in packages/inference/src/input/packed-mixed.ts:33