~ / leaderboard / skill / quantizing-models-bitsandbytes
Skill · #3692

quantizing-models-bitsandbytes

Quantizes LLMs to 8-bit or 4-bit for 50-75% memory reduction with minimal accuracy loss. Use when GPU memory is limited, need to fit larger models, or want faster inference. Supports INT8, NF4, FP4 fo

5rigs use it
0%of all rigs
7.4kavg rig context tax

Get it

$ npx degit Yichen-ZJU/lemvo/claude/skills/bitsandbytes .claude/skills/quantizing-models-bitsandbytes

From the most-starred rig that ships it: Yichen-ZJU/lemvo. Same-named skills in different rigs may differ — review before use.

Often used together with

Rigs using quantizing-models-bitsandbytes (5)

copied ✓