Class ShardedSafetensors

A sharded model directory: index json + N safetensors files.

Index

Constructors

Properties

files tensorToFile

Accessors

Methods

info pointer view open

Constructors

constructor

new ShardedSafetensors(): ShardedSafetensors

Returns ShardedSafetensors

Properties

`Readonly`files

files: Map<string, SafetensorsFile> = ...

`Readonly`tensorToFile

tensorToFile: Map<string, SafetensorsFile> = ...

Accessors

tensorNames

get tensorNames(): string[]
Returns string[]
- Defined in packages/inference/src/artifacts/safetensors.ts:143

Methods

info

info(name: string): TensorInfo
Parameters
- name: string
Returns TensorInfo
- Defined in packages/inference/src/artifacts/safetensors.ts:153

pointer

pointer(name: string): number
Parameters
- name: string
Returns number
- Defined in packages/inference/src/artifacts/safetensors.ts:157

view

view(name: string): Uint8Array
Parameters
- name: string
Returns Uint8Array
- Defined in packages/inference/src/artifacts/safetensors.ts:161

`Static`open

open(modelDir: string): Promise<ShardedSafetensors>
Parameters
- modelDir: string
Returns Promise<ShardedSafetensors>
- Defined in packages/inference/src/artifacts/safetensors.ts:113