← All skills

inference-serving-tensorrt-llm

75 / 100 · Review before installing

Check before installing.

By aicodedecode/awesome-muse-skills (GitHub) · design · 54 stars · scanned at commit faf37c0

Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production deployment on NVIDIA GPUs (A100/H100), when you need 10-100x faster inference than PyTorch, or for serving models with quantization (FP8/INT4), in-flight batching, and multi-GPU scaling.

Works with any agent that supports SKILL.md skills.

Partially scanned — some files couldn't be read; we'll retry on the next scan

What this skill can do

Safer alternatives

Low-risk skills in the same category (design) that look related. Check that one does what you need.

• 85 Low riskai-llmdiegosouzapw/awesome-omni-skill · 66 stars
• 85 Low riskagent-llm-architectdiegosouzapw/awesome-omni-skill · 66 stars
• 95 Low riskinference-format-optimizera2ui-project/a2ui · 17,059 stars

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'inference-serving-tensorrt-llm' ] || [ -L ~/.agents/skills/'inference-serving-tensorrt-llm' ]; then echo 'A skill folder named inference-serving-tensorrt-llm already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/aicodedecode/awesome-muse-skills' "$d" && git -C "$d" checkout --quiet 'faf37c0859ebf627bfcb5225e8057d088691e0ae' -- 'skills-imported/inference-serving-tensorrt-llm' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills-imported/inference-serving-tensorrt-llm' ~/.agents/skills/'inference-serving-tensorrt-llm' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'inference-serving-tensorrt-llm' ~/.claude/skills/'inference-serving-tensorrt-llm' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for aicodedecode/awesome-muse-skills shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/aicodedecode/awesome-muse-skills.svg)](https://zalavijaysinh.github.io/skilltrust/repos/aicodedecode/awesome-muse-skills/)

Score history