← All skills
vllm
70 / 100 · Review before installing
Check before installing.
By graniet/kheish (GitHub) · other · 213 stars · scanned at commit df50433
Serves LLMs with high throughput using vLLM's PagedAttention and continuous
Works with any agent that supports SKILL.md skills.
What this skill can do
Downloads and installs other software
The author does not mention this.
Found in 8 places.
Show 5 more
Runs commands on your computer
The author does not mention this.
Found in 15 places.
Show 12 more
- skills/mlops/inference/vllm/SKILL.md, line 126
pip install locust - skills/mlops/inference/vllm/SKILL.md, line 139
curl http://localhost:9090/metrics | grep vllm - skills/mlops/inference/vllm/SKILL.md, line 153
docker run --gpus all -p 8000:8000 \ - skills/mlops/inference/vllm/SKILL.md, line 279
vllm serve TheBloke/Llama-2-70B-AWQ \ - skills/mlops/inference/vllm/SKILL.md, line 317
vllm serve MODEL \ - skills/mlops/inference/vllm/SKILL.md, line 324
vllm serve MODEL --quantization awq - skills/mlops/inference/vllm/SKILL.md, line 331
vllm serve MODEL --enable-prefix-caching - skills/mlops/inference/vllm/SKILL.md, line 336
vllm serve MODEL --enable-chunked-prefill - skills/mlops/inference/vllm/SKILL.md, line 343
vllm serve MODEL --trust-remote-code - skills/mlops/inference/vllm/SKILL.md, line 350
vllm serve MODEL --max-num-seqs 512 - skills/mlops/inference/vllm/SKILL.md, line 359
vllm serve MODEL --tensor-parallel-size 4 # Not 3 - skills/mlops/inference/vllm/SKILL.md, line 364
vllm serve MODEL --speculative-model DRAFT_MODEL
Can call paid AI services billed to you
This is disclosed by the author in the skill's SKILL.md or README.
Found in 3 places.
Sends data to these websites: api.openai.com
The author does not mention this.
Found in 14 places.
Show 11 more
- skills/mlops/inference/vllm/references/quantization.md, line 58
from openai import OpenAI - skills/mlops/inference/vllm/references/server-deployment.md, line 225
curl http://localhost:8000/health - skills/mlops/inference/vllm/references/server-deployment.md, line 232
until curl -f http://localhost:8000/health; do - skills/mlops/inference/vllm/references/troubleshooting.md, line 207
curl http://localhost:8000/health - skills/mlops/inference/vllm/references/troubleshooting.md, line 231
from openai import OpenAI - skills/mlops/inference/vllm/references/troubleshooting.md, line 251
session = requests.Session() - skills/mlops/inference/vllm/references/troubleshooting.md, line 377
curl http://localhost:9090/metrics - skills/mlops/inference/vllm/references/troubleshooting.md, line 380
curl http://localhost:9090/metrics | grep vllm_time_to_first_token - skills/mlops/inference/vllm/references/troubleshooting.md, line 394
curl http://localhost:8000/health - skills/mlops/inference/vllm/references/troubleshooting.md, line 397
curl http://localhost:8000/v1/models - skills/mlops/inference/vllm/references/troubleshooting.md, line 400
curl http://localhost:8000/v1/completions \
Safer alternatives
Low-risk skills in the same category (other) that look related. Check that one does what you need.
Install
Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.
if [ -e ~/.agents/skills/'vllm' ] || [ -L ~/.agents/skills/'vllm' ]; then echo 'A skill folder named vllm already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/graniet/kheish' "$d" && git -C "$d" checkout --quiet 'df50433f8d577f832c6812b9e67be8ddb766059d' -- 'skills/mlops/inference/vllm' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/mlops/inference/vllm' ~/.agents/skills/'vllm' && rm -rf "$d"; fi
Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'vllm' ~/.claude/skills/'vllm' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.
Badge for your README
The badge for graniet/kheish shows the score of its lowest-scoring skill.
[](https://zalavijaysinh.github.io/skilltrust/repos/graniet/kheish/)
Score history
| Date | Version | Score |
|---|
| 2026-11-12 | df50433 | 70 |