Function createInferenceEngine

createInferenceEngine<Request, Metrics>(
planner: ExecutionPlanner<Request, Metrics>,
options: EngineOptions,
): InferenceEngine<Request, Metrics>
Type Parameters
- Request
- Metrics
Parameters
- planner: ExecutionPlanner<Request, Metrics>
- options: EngineOptions
Returns InferenceEngine<Request, Metrics>
- Defined in packages/inference/src/execution/engine.ts:16