← All skills
gguf-quantization
65 / 100 · Review before installing
Check before installing. Some of what it can do is expected: a coding skill usually runs build and test commands.
By hashgraph-online/awesome-codex-plugins (GitHub) · coding · 1,568 stars · scanned at commit 3e1e6b2
GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.
Works with any agent that supports SKILL.md skills.
What this skill can do
Runs commands on your computer
The author does not mention this. Expected for a coding skill.
Found in 17 places.
Show 14 more
- plugins/KalarisLabs/research-agent-skills/skills/gguf-quantization/SKILL.md, line 91
./llama-cli -m model-q4_k_m.gguf -p "Hello, how are you?" - plugins/KalarisLabs/research-agent-skills/skills/gguf-quantization/SKILL.md, line 133
huggingface-cli download meta-llama/Llama-3.1-8B --local-dir ./llama-3.1-8b - plugins/KalarisLabs/research-agent-skills/skills/gguf-quantization/SKILL.md, line 151
python convert_hf_to_gguf.py ./model --outfile model-f16.gguf - plugins/KalarisLabs/research-agent-skills/skills/gguf-quantization/SKILL.md, line 179
MODEL="llama-3.1-8b-f16.gguf" - plugins/KalarisLabs/research-agent-skills/skills/gguf-quantization/SKILL.md, line 265
./llama-server -m model-q4_k_m.gguf \ - plugins/KalarisLabs/research-agent-skills/skills/gguf-quantization/SKILL.md, line 303
make clean && make GGML_METAL=1 - plugins/KalarisLabs/research-agent-skills/skills/gguf-quantization/SKILL.md, line 320
make clean && make GGML_CUDA=1 - plugins/KalarisLabs/research-agent-skills/skills/gguf-quantization/SKILL.md, line 333
make clean && make - plugins/KalarisLabs/research-agent-skills/skills/gguf-quantization/SKILL.md, line 353
cat > Modelfile << 'EOF' - plugins/KalarisLabs/research-agent-skills/skills/gguf-quantization/SKILL.md, line 379
cp model-q4_k_m.gguf text-generation-webui/models/ - plugins/KalarisLabs/research-agent-skills/skills/gguf-quantization/SKILL.md, line 399
./llama-cli -m model.gguf --mmap - plugins/KalarisLabs/research-agent-skills/skills/gguf-quantization/SKILL.md, line 405
./llama-cli -m model.gguf -ngl 20 # Reduce from 35 - plugins/KalarisLabs/research-agent-skills/skills/gguf-quantization/SKILL.md, line 414
./llama-imatrix -m model-f16.gguf -f calibration.txt -o model.imatrix - plugins/KalarisLabs/research-agent-skills/skills/gguf-quantization/references/advanced-usage.md, line 165
result = subprocess.run(
Downloads and installs other software
The author does not mention this.
Found in 8 places.
Show 5 more
Can call paid AI services billed to you
The author does not mention this.
Found in 2 places.
Sends data to these websites: api.openai.com
The author does not mention this.
Found in 2 places.
Safer alternatives
Low-risk skills in the same category (coding) that look related. Check that one does what you need.
Install
Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.
if [ -e ~/.agents/skills/'gguf-quantization' ] || [ -L ~/.agents/skills/'gguf-quantization' ]; then echo 'A skill folder named gguf-quantization already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/hashgraph-online/awesome-codex-plugins' "$d" && git -C "$d" checkout --quiet '3e1e6b20ffc28f42923e391f29f075c424e19e64' -- 'plugins/KalarisLabs/research-agent-skills/skills/gguf-quantization' && mkdir -p ~/.agents/skills && cp -R "$d"/'plugins/KalarisLabs/research-agent-skills/skills/gguf-quantization' ~/.agents/skills/'gguf-quantization' && rm -rf "$d"; fi
Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'gguf-quantization' ~/.claude/skills/'gguf-quantization' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.
Badge for your README
The badge for hashgraph-online/awesome-codex-plugins shows the score of its lowest-scoring skill.

[](https://zalavijaysinh.github.io/skilltrust/repos/hashgraph-online/awesome-codex-plugins/)
Score history
| Date | Version | Score |
|---|
| 2026-11-13 | 3e1e6b2 | 65 |
| 2026-11-12 | 6d2e63f | 65 |
| 2026-11-11 | 4070676 | 65 |
| 2026-11-10 | f620aba | 65 |
| 2026-11-09 | 3062ea3 | 65 |
| 2026-11-08 | 057d789 | 65 |
| 2026-11-06 | e012fe1 | 65 |