Function withModelUsageFlush

withModelUsageFlush<T>(model: MlxModelMemory, run: () => Promise<T>): Promise<T>
Apply generate()'s usage safe-point to direct/non-generator paths.
Type Parameters
- T
Parameters
- model: MlxModelMemory
- run: () => Promise<T>
Returns Promise<T>
- Defined in packages/inference/src/generation/scopes.ts:145