Class AdmissionPool

FIFO reservations. A cancelled waiter releases no active owner's capacity.

Index

Constructors

Properties

capacity maxQueued

Accessors

Methods

Constructors

constructor

new AdmissionPool(capacity: number, maxQueued?: number): AdmissionPool
Parameters
- capacity: number
- maxQueued: number = 64
Returns AdmissionPool
- Defined in packages/inference/src/execution/admission.ts:14

Properties

`Readonly`capacity

capacity: number

`Readonly`maxQueued

maxQueued: number = 64

Accessors

active

get active(): number
Returns number
- Defined in packages/inference/src/execution/admission.ts:18

queued

get queued(): number
Returns number
- Defined in packages/inference/src/execution/admission.ts:19

Methods

acquire

acquire(cancellation?: Cancellation): Promise<DisposableResource>
Parameters
- Optionalcancellation: Cancellation
Returns Promise<DisposableResource>
- Defined in packages/inference/src/execution/admission.ts:21

close

close(): void
Returns void
- Defined in packages/inference/src/execution/admission.ts:53