← All skills

peft-fine-tuning

80 / 100 · Low risk

Fine to try.

By KalarisLabs/research-agent-skills (GitHub) · research · 126 stars · scanned at commit 802bbea

Fine-tunes LLMs with Hugging Face PEFT, using LoRA, QLoRA, IA3, AdaLoRA, prefix tuning, and prompt tuning so that under 1% of parameters are trained. Covers rank, alpha, and target module selection, loading and merging adapters, multi-adapter serving, and integration with TRL SFTTrainer, Axolotl, and vLLM. Use when fine-tuning 7B-70B models on limited GPU memory, when running QLoRA on a single 24GB GPU, when choosing LoRA rank and alpha, when merging or swapping adapters on one base model, or w…

Works with any agent that supports SKILL.md skills.

What this skill can do

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'peft-fine-tuning' ] || [ -L ~/.agents/skills/'peft-fine-tuning' ]; then echo 'A skill folder named peft-fine-tuning already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/KalarisLabs/research-agent-skills' "$d" && git -C "$d" checkout --quiet '802bbea44e551abac24d6856f83fc55149bbdba3' -- 'skills/peft-fine-tuning' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/peft-fine-tuning' ~/.agents/skills/'peft-fine-tuning' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'peft-fine-tuning' ~/.claude/skills/'peft-fine-tuning' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for KalarisLabs/research-agent-skills shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/KalarisLabs/research-agent-skills.svg)](https://zalavijaysinh.github.io/skilltrust/repos/KalarisLabs/research-agent-skills/)

Score history