Class ColibriGlm52ResidentWeights

Dense/shared/router-only view of the direct Colibri artifact. Even if an owning safetensors shard also contains routed tensors, this boundary refuses their names so the streamed model cannot silently fall back to mmap.

Implements

Glm52WeightSource

Index

Properties

container source weightsBytes

Accessors

mappedShardBytes mappedShardCount

Methods

dequantized dispose embedding has linear tensor open

Properties

`Readonly`container

container: ColibriGlm52Container

`Readonly`source

source: ColibriGlm52Weights

`Readonly`weightsBytes

weightsBytes: number

Accessors

mappedShardBytes

get mappedShardBytes(): number
Returns number
- Defined in packages/inference/src/artifacts/glm52/resident-weights.ts:59

mappedShardCount

get mappedShardCount(): number
Returns number
- Defined in packages/inference/src/artifacts/glm52/resident-weights.ts:55

Methods

dequantized

dequantized(name: string, outputRows: number, inputColumns: number): MlxArray
Parameters
- name: string
- outputRows: number
- inputColumns: number
Returns MlxArray
Implementation of Glm52WeightSource.dequantized
- Defined in packages/inference/src/artifacts/glm52/resident-weights.ts:72

dispose

dispose(): void
Returns void
Implementation of Glm52WeightSource.dispose
- Defined in packages/inference/src/artifacts/glm52/resident-weights.ts:125

embedding

embedding(
    ids: MlxArray,
    name: string,
    vocabSize: number,
    hiddenSize: number,
): MlxArray
Parameters
- ids: MlxArray
- name: string
- vocabSize: number
- hiddenSize: number
Returns MlxArray
Implementation of Glm52WeightSource.embedding
- Defined in packages/inference/src/artifacts/glm52/resident-weights.ts:115

has

has(name: string): boolean
Parameters
- name: string
Returns boolean
Implementation of Glm52WeightSource.has
- Defined in packages/inference/src/artifacts/glm52/resident-weights.ts:63

linear

linear(
    input: MlxArray,
    name: string,
    outputRows: number,
    inputColumns: number,
): MlxArray
Parameters
- input: MlxArray
- name: string
- outputRows: number
- inputColumns: number
Returns MlxArray
Implementation of Glm52WeightSource.linear
- Defined in packages/inference/src/artifacts/glm52/resident-weights.ts:81

tensor

tensor(name: string): MlxArray
Parameters
- name: string
Returns MlxArray
Implementation of Glm52WeightSource.tensor
- Defined in packages/inference/src/artifacts/glm52/resident-weights.ts:67

`Static`open

open(
modelDir: string,
options?: { includeMtp?: boolean },
): ColibriGlm52ResidentWeights
Parameters
- modelDir: string
- options: { includeMtp?: boolean } = {}
Returns ColibriGlm52ResidentWeights
- Defined in packages/inference/src/artifacts/glm52/resident-weights.ts:31