Function composeGraphCaches

composeGraphCaches(
    graph: { cacheLayers: readonly MlxCacheLayer[]; cachePaging?: boolean },
    composition: {
        kv: KvStorageScheme;
        pagedKv: { blockSize: number; direct?: boolean } | null;
    },
): Cache[]
The loader composes a request's cache legos from the file's declaration.
Parameters
- graph: { cacheLayers: readonly MlxCacheLayer[]; cachePaging?: boolean }
- composition: { kv: KvStorageScheme; pagedKv: { blockSize: number; direct?: boolean } | null }
Returns Cache[]
- Defined in packages/inference/src/models/cache-composition.ts:14