Class AneWeightShares

Program/buffer ownership shared by written ANE bindings. Shape lookup only shares resources; the graph supplies the operation and row capacity.

Index

Constructors

Properties

affine mlp owned

Methods

[dispose] projection

Constructors

constructor

new AneWeightShares(): AneWeightShares

Returns AneWeightShares

Properties

`Readonly`affine

affine: Map<string, AneAffineSplit> = ...

mlp

mlp: AneMlpSplit | undefined

`Readonly`owned

owned: { dispose(): void }[] = []

Methods

[dispose]

"[dispose]"(): void
Returns void
- Defined in packages/inference/src/models/qwen/written-layers.ts:45

projection

projection(
    linear: QuantizedLinear,
    Split: typeof AneAffineSplit,
    fraction: number,
    rows: number,
    slices?: number,
    gpuRows?: AneGpuRows,
): AneAffineSplit
Parameters
- linear: QuantizedLinear
- Split: typeof AneAffineSplit
- fraction: number
- rows: number
- Optionalslices: number
- OptionalgpuRows: AneGpuRows
Returns AneAffineSplit
- Defined in packages/inference/src/models/qwen/written-layers.ts:38