← All skills
model-serving
72 / 100 · Review before installing
Check before installing.
By ancoleman/ai-design-components (GitHub) · design · 530 stars · scanned at commit 76551b7
LLM and ML model deployment for inference. Use when serving models in production, building AI APIs, or optimizing inference. Covers vLLM (LLM serving), TensorRT-LLM (GPU optimization), Ollama (local), BentoML (ML deployment), Triton (multi-model), LangChain (orchestration), LlamaIndex (RAG), and streaming patterns.
Works with any agent that supports SKILL.md skills.
What this skill can do
Downloads and installs other software
The author does not mention this.
Found in 25 places.
Show 17 more
- skills/model-serving/examples/ollama-local/README.md, line 24
curl -fsSL https://ollama.com/install.sh | sh - skills/model-serving/examples/ollama-local/README.md, line 33
pip install -r requirements.txt - skills/model-serving/examples/vllm-serving/README.md, line 24
pip install -r requirements.txt - skills/model-serving/examples/vllm-serving/README.md, line 27
pip install vllm - skills/model-serving/references/bentoml.md, line 50
pip install bentoml - skills/model-serving/references/bentoml.md, line 53
pip install bentoml[sklearn] - skills/model-serving/references/bentoml.md, line 54
pip install bentoml[pytorch] - skills/model-serving/references/bentoml.md, line 55
pip install bentoml[tensorflow] - skills/model-serving/references/bentoml.md, line 56
pip install bentoml[xgboost] - skills/model-serving/references/langchain-orchestration.md, line 44
pip install langchain - skills/model-serving/references/langchain-orchestration.md, line 47
pip install langchain-openai # OpenAI, Azure OpenAI - skills/model-serving/references/langchain-orchestration.md, line 48
pip install langchain-anthropic # Anthropic Claude - skills/model-serving/references/langchain-orchestration.md, line 49
pip install langchain-google # Google (Gemini, Vertex AI) - skills/model-serving/references/langchain-orchestration.md, line 52
pip install langchain-qdrant - skills/model-serving/references/langchain-orchestration.md, line 53
pip install langchain-chroma - skills/model-serving/references/langchain-orchestration.md, line 54
pip install langchain-pinecone - skills/model-serving/references/langchain-orchestration.md, line 57
pip install langchain-community
and 5 more places
Runs commands on your computer
The author does not mention this.
Found in 3 places.
Can call paid AI services billed to you
This is disclosed by the author in the skill's SKILL.md or README.
Found in 7 places.
Show 4 more
Sends data to these websites: api.openai.com, ollama.com
This is disclosed by the author in the skill's SKILL.md or README.
Found in 41 places.
Show 17 more
- skills/model-serving/SKILL.md, line 418
from openai import OpenAI - skills/model-serving/examples/k8s-vllm-deployment/README.md, line 28
curl http://localhost:8000/v1/models - skills/model-serving/examples/langchain-agents/README.md, line 154
response = requests.get( - skills/model-serving/examples/langchain-agents/README.md, line 162
name="WebSearch", - skills/model-serving/examples/ollama-local/README.md, line 24
curl -fsSL https://ollama.com/install.sh | sh - skills/model-serving/examples/ollama-local/README.md, line 74
response = requests.post("http://localhost:11434/api/generate", json={ - skills/model-serving/examples/ollama-local/README.md, line 85
response = requests.post( - skills/model-serving/examples/ollama-local/README.md, line 106
response = requests.post("http://localhost:11434/api/chat", json={ - skills/model-serving/examples/ollama-local/README.md, line 175
response = requests.post("http://localhost:11434/api/generate", json={ - skills/model-serving/examples/ollama-local/README.md, line 208
response = requests.post("http://localhost:11434/api/generate", ...) - skills/model-serving/examples/ollama-local/README.md, line 211
from openai import OpenAI - skills/model-serving/examples/ollama-local/README.md, line 221
curl http://localhost:11434/api/tags - skills/model-serving/examples/ollama-local/main.py, line 32
response = requests.post(url, json=payload, stream=True) - skills/model-serving/examples/ollama-local/main.py, line 43
response = requests.post(url, json=payload) - skills/model-serving/examples/ollama-local/main.py, line 65
response = requests.post(url, json=payload, stream=True) - skills/model-serving/examples/ollama-local/main.py, line 75
response = requests.post(url, json=payload) - skills/model-serving/examples/ollama-local/main.py, line 82
response = requests.get(url)
and 21 more places
Safer alternatives
Low-risk skills in the same category (design) that look related. Check that one does what you need.
Install
Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.
if [ -e ~/.agents/skills/'model-serving' ] || [ -L ~/.agents/skills/'model-serving' ]; then echo 'A skill folder named model-serving already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/ancoleman/ai-design-components' "$d" && git -C "$d" checkout --quiet '76551b7b19ebc667764ec75da14990d0aef8b6e5' -- 'skills/model-serving' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/model-serving' ~/.agents/skills/'model-serving' && rm -rf "$d"; fi
Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'model-serving' ~/.claude/skills/'model-serving' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.
Badge for your README
The badge for ancoleman/ai-design-components shows the score of its lowest-scoring skill.
[](https://zalavijaysinh.github.io/skilltrust/repos/ancoleman/ai-design-components/)
Score history
| Date | Version | Score |
|---|
| 2026-11-08 | 76551b7 | 100 |
| 2026-11-07 | 76551b7 | 72 |