Function planRuntimeMemory

planRuntimeMemory(
    modelDir: string,
    config: ModelConfig,
    options?: {
        contextTokens?: number;
        machineBytes?: number;
        profiles?: ResolveModelProfileOptions;
    },
): Promise<MemoryPlan | null>
The memory plan a planned runtime would run under on this machine, or null when the model has none (its caller estimates from resident weights). Reads artifact headers only.
Parameters
- modelDir: string
- config: ModelConfig
- options: {
      contextTokens?: number;
      machineBytes?: number;
      profiles?: ResolveModelProfileOptions;
  } = {}
Returns Promise<MemoryPlan | null>
- Defined in packages/inference/src/models/memory-plan.ts:23