Stars
★ 2.8k
This skill should be used when the user asks to "quantize a model", "run PTQ", "post-training quantization", "NVFP4 quantization", "FP8 quantization", "INT8 quantization", "INT4 AW...
Install this skill (Claude Code)
# Clone and copy the skill into your project
git clone https://github.com/NVIDIA/skills.git
mkdir -p .claude/skills
cp -r skills/skills/Model-Optimizer/ptq .claude/skills/
# Or for personal use: ~/.claude/skills/Query and browse evaluation results stored in MLflow.
Run commands inside a remote Docker container via the file-based command relay (tools/debugger).
Serve a quantized or unquantized LLM checkpoint as an OpenAI-compatible API endpoint using vLLM, SGLang, or TRT-LLM.
Evaluates accuracy of quantized or unquantized LLMs using NeMo Evaluator Launcher (NEL).
Run, monitor, analyze, and debug LLM evaluations via nemo-evaluator-launcher.
Monitor submitted jobs (PTQ, evaluation, deployment) on SLURM clusters.