← All skills

awq-quantization

80 / 100 · Low risk

Fine to try.

By Orchestra-Research/AI-Research-SKILLs (GitHub) · research · 14,447 stars · scanned at commit 773a529

Activation-aware weight quantization for 4-bit LLM compression with 3x speedup and minimal accuracy loss. Use when deploying large models (7B-70B) on limited GPU memory, when you need faster inference than GPTQ with better accuracy preservation, or for instruction-tuned and multimodal models. MLSys 2024 Best Paper Award winner.

Works with any agent that supports SKILL.md skills.

What this skill can do

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'awq-quantization' ] || [ -L ~/.agents/skills/'awq-quantization' ]; then echo 'A skill folder named awq-quantization already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/Orchestra-Research/AI-Research-SKILLs' "$d" && git -C "$d" checkout --quiet '773a52944ba4747a18bd4ae9ade53fff041adcbc' -- '10-optimization/awq' && mkdir -p ~/.agents/skills && cp -R "$d"/'10-optimization/awq' ~/.agents/skills/'awq-quantization' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'awq-quantization' ~/.claude/skills/'awq-quantization' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for Orchestra-Research/AI-Research-SKILLs shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/Orchestra-Research/AI-Research-SKILLs.svg)](https://zalavijaysinh.github.io/skilltrust/repos/Orchestra-Research/AI-Research-SKILLs/)

Score history

Also found in

Identical copies of this skill exist at:

• Dicklesworthstone/pi_agent_rust/tests/ext_conformance/artifacts/templates-davila7/cli-tool/components/skills/ai-research/optimization-awq