mlx-bun library API
    Preparing search index...

    The operations a lease may expose, keyed by ModelOperation (adapters is offered on a model that mounts adapters).

    interface ModelOperations {
        adapters: AdapterOperation;
        transcribe: TranscriptionOperation;
        embed(
            inputs: readonly string[],
            instruction?: string,
        ): Promise<readonly { tokens: number; vector: Float32Array }[]>;
        generate(request: Request): Promise<Response>;
    }
    Index
    • Parameters

      • inputs: readonly string[]
      • Optionalinstruction: string

      Returns Promise<readonly { tokens: number; vector: Float32Array }[]>