Class ColibriGlm52Container

Readonlyfiles

Readonlytensors

capabilities

• capabilities(config: Glm52Config): Glm52ContainerCapabilities

  Parameters

  • config: Glm52Config

  Returns Glm52ContainerCapabilities

has

• has(name: string): boolean

  Parameters

  • name: string

  Returns boolean

info

• info(name: string): ColibriTensorInfo

  Parameters

  • name: string

  Returns ColibriTensorInfo

quantized

• quantized(
      name: string,
      outputRows: number,
      inputColumns: number,
  ): ColibriQuantTensorInfo

  Validate a converted 2-D tensor and infer int4 group geometry from scales.

  Parameters

  • name: string
  • outputRows: number
  • inputColumns: number

  Returns ColibriQuantTensorInfo

Staticopen

• open(modelDir: string): ColibriGlm52Container

  Parameters

  • modelDir: string

  Returns ColibriGlm52Container