mlx-bun library API
Documentation
Preparing search index...
@mlx-bun/inference
@mlx-bun/inference/artifacts
Module @mlx-bun/inference/artifacts
Classes
FileArtifactIdentityStore
MmapFile
SafetensorsFile
ShardedSafetensors
ShardedWriter
WeightAudit
Weights
Interfaces
ArtifactIdentityFile
ArtifactIdentityStore
Glm52Config
NamedTensor
OffloadEntry
OffloadManifest
SafetensorsIndex
ShardInfo
TensorInfo
TurboQuantFold
WeightsNativeBindings
WeightsOpenOptions
WeightsView
WriteOpts
WriteResult
Type Aliases
Glm52IndexerType
SafetensorsDtype
Variables
DEFAULT_SHARD_BYTES
DRAFT_VOCAB_FILE
DTYPE_SIZE
TURBOQUANT_FOLD_FILE
Functions
activateExpertOffload
artifactIdentity
buildOffloadFile
configFingerprint
ensureOffloadFile
expertOffloadArray
isExpertOffload
loadGlm52Config
modelWeightsIdentity
parseGlm52Config
readDraftVocabulary
readTurboQuantFold
tensorFingerprint
tensorUsed
writeShardedSafetensors
References
copyAuxFiles
→
copyAuxFiles
KvQuantSpec
→
KvQuantSpec
loadModelConfig
→
loadModelConfig
ModelConfig
→
ModelConfig
parseQuantization
→
parseQuantization
parseTurboQuantScheme
→
parseTurboQuantScheme
quantFor
→
quantFor
QuantizationConfig
→
QuantizationConfig
QuantSpec
→
QuantSpec
RopeParams
→
RopeParams
TextConfig
→
TextConfig
TrellisSpec
→
TrellisSpec
TURBOQUANT_VALID_KBITS
→
TURBOQUANT_VALID_KBITS
TURBOQUANT_VALID_VBITS
→
TURBOQUANT_VALID_VBITS
TurboQuantScheme
→
TurboQuantScheme
Settings
Member Visibility
Protected
Inherited
External
Theme
OS
Light
Dark
On This Page
Classes
File
Artifact
Identity
Store
Mmap
File
Safetensors
File
Sharded
Safetensors
Sharded
Writer
Weight
Audit
Weights
Interfaces
Artifact
Identity
File
Artifact
Identity
Store
Glm52
Config
Named
Tensor
Offload
Entry
Offload
Manifest
Safetensors
Index
Shard
Info
Tensor
Info
Turbo
Quant
Fold
Weights
Native
Bindings
Weights
Open
Options
Weights
View
Write
Opts
Write
Result
Type Aliases
Glm52
Indexer
Type
Safetensors
Dtype
Variables
DEFAULT_
SHARD_
BYTES
DRAFT_
VOCAB_
FILE
DTYPE_
SIZE
TURBOQUANT_
FOLD_
FILE
Functions
activate
Expert
Offload
artifact
Identity
build
Offload
File
config
Fingerprint
ensure
Offload
File
expert
Offload
Array
is
Expert
Offload
load
Glm52
Config
model
Weights
Identity
parse
Glm52
Config
read
Draft
Vocabulary
read
Turbo
Quant
Fold
tensor
Fingerprint
tensor
Used
write
Sharded
Safetensors
References
copy
Aux
Files
Kv
Quant
Spec
load
Model
Config
Model
Config
parse
Quantization
parse
Turbo
Quant
Scheme
quant
For
Quantization
Config
Quant
Spec
Rope
Params
Text
Config
Trellis
Spec
TURBOQUANT_
VALID_
KBITS
TURBOQUANT_
VALID_
VBITS
Turbo
Quant
Scheme
Documentation
mlx-bun library API
Loading...