Interface DraftProviderKind

interface DraftProviderKind {
    artifact: boolean;
    bundledCompanion?: string;
    fallback?: boolean;
    kind: string;
    detect?(artifact: DraftArtifact): Promise<boolean>;
    load(request: DraftLoadRequest): Promise<LoadedDraft>;
}

Index

Properties

artifact bundledCompanion? fallback? kind

Methods

Properties

`Readonly`artifact

artifact: boolean

False for a model-free kind: it takes no artifact and is chosen only by name.

`Optional` `Readonly`bundledCompanion

bundledCompanion?: string

Subdirectory of a target artifact that bundles this kind's companion.

`Optional` `Readonly`fallback

fallback?: boolean

A catch-all: asked only after every other kind declined, wherever it was registered, so a kind added later is still detected ahead of it.

`Readonly`kind

kind: string

Methods

`Optional`detect

detect?(artifact: DraftArtifact): Promise<boolean>
Whether the artifact is this kind's. Absent: the kind is chosen only by name. Kinds are asked in registration order.
Parameters
- artifact: DraftArtifact
Returns Promise<boolean>
- Defined in packages/inference/src/generation/speculative/draft-registry.ts:59

load

load(request: DraftLoadRequest): Promise<LoadedDraft>
Load the provider and settle its round width; the provider is owned by the caller on return and disposed here on failure.
Parameters
- request: DraftLoadRequest
Returns Promise<LoadedDraft>
- Defined in packages/inference/src/generation/speculative/draft-registry.ts:65