← All skills

quantizing-models-bitsandbytes

80 / 100 · Low risk

Fine to try.

By KalarisLabs/research-agent-skills (GitHub) · research · 126 stars · scanned at commit 802bbea

Quantizes LLMs to 8-bit or 4-bit for 50-75% memory reduction with minimal accuracy loss. Use when GPU memory is limited, need to fit larger models, or want faster inference. Supports INT8, NF4, FP4 formats, QLoRA training, and 8-bit optimizers. Works with HuggingFace Transformers.

Works with any agent that supports SKILL.md skills.

Partially scanned — some files couldn't be read; we'll retry on the next scan

What this skill can do

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'quantizing-models-bitsandbytes' ] || [ -L ~/.agents/skills/'quantizing-models-bitsandbytes' ]; then echo 'A skill folder named quantizing-models-bitsandbytes already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/KalarisLabs/research-agent-skills' "$d" && git -C "$d" checkout --quiet '802bbea44e551abac24d6856f83fc55149bbdba3' -- 'skills/quantizing-models-bitsandbytes' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/quantizing-models-bitsandbytes' ~/.agents/skills/'quantizing-models-bitsandbytes' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'quantizing-models-bitsandbytes' ~/.claude/skills/'quantizing-models-bitsandbytes' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for KalarisLabs/research-agent-skills shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/KalarisLabs/research-agent-skills.svg)](https://zalavijaysinh.github.io/skilltrust/repos/KalarisLabs/research-agent-skills/)

Score history