Interface ObjectCache<Value>

Exact reusable work, independent of token-prefix matching. The same cache owner chooses residency and persistence for objects and conversation state.

interface ObjectCache<Value> {
put(key: string, value: Value): void;
take(key: string): Promise<{ value: Value; dispose(): void } | null>;
}

Type Parameters

Value

Index

Methods

Methods

put

put(key: string, value: Value): void
Successful return transfers ownership, including immediate eviction.
Parameters
- key: string
- value: Value
Returns void
- Defined in packages/inference/src/contracts/portable/object-cache.ts:7

take

take(key: string): Promise<{ value: Value; dispose(): void } | null>
Borrow immutable data through an owned lease. A miss permits recompute.
Parameters
- key: string
Returns Promise<{ value: Value; dispose(): void } | null>
- Defined in packages/inference/src/contracts/portable/object-cache.ts:5