← All skills

inference-serving-sglang

65 / 100 · Review before installing

Check before installing. Some of what it can do is expected: a coding skill usually runs build and test commands.

By davila7/claude-code-templates (GitHub) · coding · 33,256 stars · scanned at commit a6e6f93

Fast structured generation and serving for LLMs with RadixAttention prefix caching. Use for JSON/regex outputs, constrained decoding, agentic workflows with tool calls, or when you need 5× faster inference than vLLM with prefix sharing. Powers 300,000+ GPUs at xAI, AMD, NVIDIA, and LinkedIn.

Works with any agent that supports SKILL.md skills.

What this skill can do

Safer alternatives

Low-risk skills in the same category (coding) that look related. Check that one does what you need.

• 95 Low risksglang-radix-attentionyanacuti1121/Yana-AI · 13 stars
• 95 Low riskjetson-inference-mem-tuneNVIDIA/skills · 3,933 stars
• 90 Low riskomh-inference-servingrlaope/oh-my-hermes · 5,435 stars

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'inference-serving-sglang' ] || [ -L ~/.agents/skills/'inference-serving-sglang' ]; then echo 'A skill folder named inference-serving-sglang already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/davila7/claude-code-templates' "$d" && git -C "$d" checkout --quiet 'a6e6f93e9a4baaa6ff337aee5505bf5c2bae4ce6' -- 'cli-tool/components/skills/ai-research/inference-serving-sglang' && mkdir -p ~/.agents/skills && cp -R "$d"/'cli-tool/components/skills/ai-research/inference-serving-sglang' ~/.agents/skills/'inference-serving-sglang' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'inference-serving-sglang' ~/.claude/skills/'inference-serving-sglang' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for davila7/claude-code-templates shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/davila7/claude-code-templates.svg)](https://zalavijaysinh.github.io/skilltrust/repos/davila7/claude-code-templates/)

Score history

Also found in

Identical copies of this skill exist at:

• aicodedecode/awesome-muse-skills/skills-imported/inference-serving-sglang