Class EngineSession<Metrics>

Lifecycle and bounded delivery only. No graph, cache, sampler, or method branches.

Type Parameters

Metrics

Implements

GenerationSession<Metrics>

Index

Constructors

Properties

events id result

Accessors

Methods

Constructors

constructor

new EngineSession<Metrics>(
    id: string,
    prepare: (cancellation: Cancellation) => Promise<ExecutionPlan<Metrics>>,
    control: RunControl,
    resources: SessionResources,
    onTerminal: () => void,
): EngineSession<Metrics>
Type Parameters
- Metrics
Parameters
- id: string
- prepare: (cancellation: Cancellation) => Promise<ExecutionPlan<Metrics>>
- control: RunControl
- resources: SessionResources
- onTerminal: () => void
Returns EngineSession<Metrics>
- Defined in packages/inference/src/execution/session.ts:40

Properties

`Readonly`events

events: AsyncIterable<GenerationEvent>

Single consumer. Stream mode starts on first next(); collect mode has no events.

`Readonly`id

id: string

`Readonly`result

result: Promise<GenerationOutcome<Metrics>>

Always resolves with one terminal outcome, after native resources are released.

Accessors

state

get state(): SessionState
Returns SessionState
Implementation of GenerationSession.state
- Defined in packages/inference/src/execution/session.ts:58

Methods

cancel

cancel(reason?: CancelReason): Promise<void>
Parameters
- reason: CancelReason = "requested"
Returns Promise<void>
Implementation of GenerationSession.cancel
- Defined in packages/inference/src/execution/session.ts:60

close

close(): Promise<void>
Returns Promise<void>
Implementation of GenerationSession.close
- Defined in packages/inference/src/execution/session.ts:73