← All skills
serving-llms-vllm
70 / 100 · Review before installing
Check before installing. Some of what it can do is expected: a coding skill usually runs build and test commands.
By delorenj/skills (GitHub) · coding · 17 stars · scanned at commit ff21323
vLLM: high-throughput LLM serving, OpenAI API, quantization.
Works with any agent that supports SKILL.md skills.
Partially scanned — some files couldn't be read; we'll retry on the next scan
What this skill can do
Downloads and installs other software
The author does not mention this.
Found in 6 places.
Show 3 more
Runs commands on your computer
The author does not mention this. Expected for a coding skill.
Found in 15 places.
Show 12 more
- vllm/SKILL.md, line 105
pip install locust - vllm/SKILL.md, line 118
curl http://localhost:9090/metrics | grep vllm - vllm/SKILL.md, line 132
docker run --gpus all -p 8000:8000 \ - vllm/SKILL.md, line 258
vllm serve TheBloke/Llama-2-70B-AWQ \ - vllm/SKILL.md, line 296
vllm serve MODEL \ - vllm/SKILL.md, line 303
vllm serve MODEL --quantization awq - vllm/SKILL.md, line 310
vllm serve MODEL --enable-prefix-caching - vllm/SKILL.md, line 315
vllm serve MODEL --enable-chunked-prefill - vllm/SKILL.md, line 322
vllm serve MODEL --trust-remote-code - vllm/SKILL.md, line 329
vllm serve MODEL --max-num-seqs 512 - vllm/SKILL.md, line 338
vllm serve MODEL --tensor-parallel-size 4 # Not 3 - vllm/SKILL.md, line 343
vllm serve MODEL --speculative-model DRAFT_MODEL
Can call paid AI services billed to you
This is disclosed by the author in the skill's SKILL.md or README.
Found in 2 places.
Sends data to these websites: api.openai.com
The author does not mention this.
Found in 13 places.
Show 10 more
- vllm/references/server-deployment.md, line 225
curl http://localhost:8000/health - vllm/references/server-deployment.md, line 232
until curl -f http://localhost:8000/health; do - vllm/references/troubleshooting.md, line 207
curl http://localhost:8000/health - vllm/references/troubleshooting.md, line 231
from openai import OpenAI - vllm/references/troubleshooting.md, line 251
session = requests.Session() - vllm/references/troubleshooting.md, line 377
curl http://localhost:9090/metrics - vllm/references/troubleshooting.md, line 380
curl http://localhost:9090/metrics | grep vllm_time_to_first_token - vllm/references/troubleshooting.md, line 394
curl http://localhost:8000/health - vllm/references/troubleshooting.md, line 397
curl http://localhost:8000/v1/models - vllm/references/troubleshooting.md, line 400
curl http://localhost:8000/v1/completions \
Safer alternatives
Low-risk skills in the same category (coding) that look related. Check that one does what you need.
Install
Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.
if [ -e ~/.agents/skills/'serving-llms-vllm' ] || [ -L ~/.agents/skills/'serving-llms-vllm' ]; then echo 'A skill folder named serving-llms-vllm already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/delorenj/skills' "$d" && git -C "$d" checkout --quiet 'ff2132360c4a12602f752a491f896043cb60584a' -- 'vllm' && mkdir -p ~/.agents/skills && cp -R "$d"/'vllm' ~/.agents/skills/'serving-llms-vllm' && rm -rf "$d"; fi
Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'serving-llms-vllm' ~/.claude/skills/'serving-llms-vllm' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.
Badge for your README
The badge for delorenj/skills shows the score of its lowest-scoring skill.
[](https://zalavijaysinh.github.io/skilltrust/repos/delorenj/skills/)
Score history
| Date | Version | Score |
|---|
| 2026-11-09 | ff21323 | 70 |
| 2026-11-07 | f5cafc3 | 70 |