The benchmarks module. The host implements jobs (the eval-serve task kind, exclusive of the GPU), storage, modelHost (which model is served) and catalog (its directory).
jobs
eval-serve
storage
modelHost
catalog
The benchmarks module. The host implements
jobs(theeval-servetask kind, exclusive of the GPU),storage,modelHost(which model is served) andcatalog(its directory).