Stars
★ 2.8k
Agent Skill
Active
Apache-2.0
NVIDIA/Model-Optimizer/launching-evals
Run, monitor, analyze, and debug LLM evaluations via nemo-evaluator-launcher.
Quality score 84/100
Installation
Install this skill (Claude Code)
# Clone and copy the skill into your project
git clone https://github.com/NVIDIA/skills.git
mkdir -p .claude/skills
cp -r skills/skills/Model-Optimizer/launching-evals .claude/skills/
# Or for personal use: ~/.claude/skills/Related in Model-Optimizer
Agent Skill
Active
NVIDIA/Model-Optimizer/accessing-mlflow
Query and browse evaluation results stored in MLflow.
Agent Skill
Active
NVIDIA/Model-Optimizer/debug
Run commands inside a remote Docker container via the file-based command relay (tools/debugger).
Agent Skill
Active
NVIDIA/Model-Optimizer/deployment
Serve a quantized or unquantized LLM checkpoint as an OpenAI-compatible API endpoint using vLLM, SGLang, or TRT-LLM.
Agent Skill
Active
NVIDIA/Model-Optimizer/evaluation
Evaluates accuracy of quantized or unquantized LLMs using NeMo Evaluator Launcher (NEL).
Agent Skill
Active
NVIDIA/Model-Optimizer/monitor
Monitor submitted jobs (PTQ, evaluation, deployment) on SLURM clusters.
Agent Skill
Active
NVIDIA/Model-Optimizer/ptq
This skill should be used when the user asks to "quantize a model", "run PTQ", "post-training quantization", "NVFP4 quantization", "FP8 quantization", "INT8 quantization", "INT4 AW...