← All skills

serving-llms-vllm

70 / 100 · Review before installing

Check before installing. Some of what it can do is expected: a devops skill usually runs commands, installs tools and uses cloud credentials.

By artubss/SKILLS-CLAUDE-CODE (GitHub) · devops · 11 stars · scanned at commit ac67ed8

Serve LLMs com alta throughput usando PagedAttention do vLLM e continuous batching. Use ao fazer deploy de APIs LLM em produção, otimizar latência/throughput de inferência, ou servir modelos com memória GPU limitada. Suporta endpoints compatíveis com OpenAI, quantização (GPTQ/AWQ/FP8) e tensor parallelism.

Works with any agent that supports SKILL.md skills.

What this skill can do

Safer alternatives

Low-risk skills in the same category (devops) that look related. Check that one does what you need.

• 90 Low riskvllm-deploymentplurigrid/asi · 72 stars
• 92 Low riskhf-cloud-serving-image-selectionhuggingface/skills · 11,346 stars
• 90 Low riskmodel-serving-kubernetesBagelHole/DevOps-Security-Agent-Skills · 1,203 stars

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'serving-llms-vllm' ] || [ -L ~/.agents/skills/'serving-llms-vllm' ]; then echo 'A skill folder named serving-llms-vllm already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/artubss/SKILLS-CLAUDE-CODE' "$d" && git -C "$d" checkout --quiet 'ac67ed85889b15fa9e784e2a93a83f8916870698' -- 'skills/skills/ai-research/inference-serving-vllm' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/skills/ai-research/inference-serving-vllm' ~/.agents/skills/'serving-llms-vllm' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'serving-llms-vllm' ~/.claude/skills/'serving-llms-vllm' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for artubss/SKILLS-CLAUDE-CODE shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/artubss/SKILLS-CLAUDE-CODE.svg)](https://zalavijaysinh.github.io/skilltrust/repos/artubss/SKILLS-CLAUDE-CODE/)

Score history