Class SpillQueue

constructor

• new SpillQueue(
      capBytes: number,
      bytesOf: (caches: Cache[]) => number,
      store: (item: SpillItem) => Promise<unknown>,
      disposeClones: (caches: Cache[]) => void,
      canDrop?: (item: SpillItem) => boolean,
  ): SpillQueue

  Parameters

  • capBytes: number
  • bytesOf: (caches: Cache[]) => number

    Byte size of a clone set (prompt-cache's cacheBytes).

  • store: (item: SpillItem) => Promise<unknown>

    The asynchronous storage operation.

  • disposeClones: (caches: Cache[]) => void

    Clone disposal — frees the pinned GPU memory.

  • canDrop: (item: SpillItem) => boolean = ...

    Zero-byte control barriers may need to survive capacity shedding.

  Returns SpillQueue

ReadonlybytesOf

ReadonlycanDrop

ReadonlycapBytes

ReadonlydisposeClones

Readonlystore

droppedCount

• get droppedCount(): number

  Spills dropped by the cap since start (each = one future cache miss).

  Returns number

failedCount

• get failedCount(): number

  Store calls that threw or returned false.

  Returns number

pendingBytes

• get pendingBytes(): number

  Bytes pinned by queued (not yet flushed) clones.

  Returns number

pendingCount

• get pendingCount(): number

  Returns number

cancelWhere

• cancelWhere(matches: (item: SpillItem) => boolean): void

  Cancel queued ownership, excluding the write already in flight.

  Parameters

  • matches: (item: SpillItem) => boolean

  Returns void

drain

• drain(): Promise<void>

  Settles when everything enqueued so far has flushed or dropped (tests and graceful shutdown).

  Returns Promise<void>

enqueue

• enqueue(item: SpillItem): Promise<boolean>

  Parameters

  • item: SpillItem

  Returns Promise<boolean>