mlx-bun library API
    Preparing search index...

    Server-lifetime owner of the draft machinery (the loaded draft model). Its grouped rows are how every request drafts, one request or several.

    Implements

    Index
    gamma: number

    The trained block width — the server pins numDraftTokens to this so the group never asks for more positions than the block was trained for.

    id: string

    Human-readable id (registry id / path tail) for logs + cache namespacing.

    weightsBytes: number