Function cacheLayerKind

cacheLayerKind(config: Pick<ModelConfig, "text">, layer: number): CacheLayerKind
The cache layout the config declares for a layer. A layer the config does not list is full attention. The one place a layer-type spelling is read.
Parameters
- config: Pick<ModelConfig, "text">
- layer: number
Returns CacheLayerKind
- Defined in packages/inference/src/state/kv-scheme.ts:29