~ / leaderboard / skill / nemo-evaluator-sdk
Skill · #3576

nemo-evaluator-sdk

Evaluates LLMs across 100+ benchmarks from 18+ harnesses (MMLU, HumanEval, GSM8K, safety, VLM) with multi-backend execution. Use when needing scalable evaluation on local Docker, Slurm HPC, or cloud p

5rigs use it
0%of all rigs
7.7kavg rig context tax

Get it

$ npx degit KalarisLabs/research-agent-skills/skills/nemo-evaluator-sdk .claude/skills/nemo-evaluator-sdk

From the most-starred rig that ships it: KalarisLabs/research-agent-skills. Same-named skills in different rigs may differ — review before use.

Often used together with

Rigs using nemo-evaluator-sdk (5)

copied ✓