Class ExecutionCoordinator

Shared worker activity; exclusive managed jobs. FIFO writers cannot starve behind newly arriving inference. This coordinates execution, not memory size.

Index

Constructors

Properties

Methods

Constructors

constructor

new ExecutionCoordinator(maxQueued?: number): ExecutionCoordinator
Parameters
- maxQueued: number = 64
Returns ExecutionCoordinator
- Defined in packages/inference/src/execution/coordinator.ts:21

Properties

`Readonly`maxQueued

maxQueued: number = 64

Methods

acquire

acquire(mode: Mode, cancellation?: Cancellation): Promise<DisposableResource>
Parameters
- mode: Mode
- Optionalcancellation: Cancellation
Returns Promise<DisposableResource>
- Defined in packages/inference/src/execution/coordinator.ts:24

close

close(): void
Returns void
- Defined in packages/inference/src/execution/coordinator.ts:64