io-bound-data-processing

97 / 100 · Low risk

Fine to try. Some of what it can do is expected: a data skill usually connects to databases or online services with your credentials.

By pproenca/dot-skills (GitHub) · data · 222 stars · scanned at commit cf93c57

Processing, transforming, or moving datasets that may exceed RAM on a single low-compute box — covers memory discipline (streaming, generators, dtype shrinkage), I/O access patterns (sequential vs random, mmap, async), data formats (Parquet vs CSV vs JSON, predicate pushdown), chunking & batching, spill-to-disk (external merge sort, DuckDB/Polars), pipelining (bounded queues, backpressure, checkpointing), codec selection (zstd/lz4/gzip), concurrency for I/O-bound workloads (asyncio, threads, pr…

Works with any agent that supports SKILL.md skills.

Partially scanned — some files couldn't be read; we'll retry on the next scan

What this skill can do

Connects to the internet

This is disclosed by the author in the skill's SKILL.md or README. Expected for a data skill.

Found in 5 places.

skills/.experimental/io-bound-data-processing/SKILL.md, line 3description: Processing, transforming, or moving datasets that may exceed RAM on a single low-compute box — covers memory discipline (streaming, generators, dty
skills/.experimental/io-bound-data-processing/SKILL.md, line 20- You see one-row-per-RTT writes (`INSERT` per row, `requests.get` per URL, `f.read(32)` per record)
skills/.experimental/io-bound-data-processing/references/conc-thread-pools-for-blocking-io-libraries.md, line 64results = list(pool.map(lambda u: requests.get(u).json(), urls))

Show 2 more

skills/.experimental/io-bound-data-processing/references/io-batch-and-pipeline-network-roundtrips.md, line 55resp = httpx.post("/api/users/batch", json={"ids": user_ids})
skills/.experimental/io-bound-data-processing/references/io-batch-and-pipeline-network-roundtrips.md, line 58async with httpx.AsyncClient(http2=True) as client:

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'io-bound-data-processing' ] || [ -L ~/.agents/skills/'io-bound-data-processing' ]; then echo 'A skill folder named io-bound-data-processing already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/pproenca/dot-skills' "$d" && git -C "$d" checkout --quiet 'cf93c57cac89d6fc3e4194686000411567f5caf3' -- 'skills/.experimental/io-bound-data-processing' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/.experimental/io-bound-data-processing' ~/.agents/skills/'io-bound-data-processing' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'io-bound-data-processing' ~/.claude/skills/'io-bound-data-processing' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for pproenca/dot-skills shows the score of its lowest-scoring skill.

SkillTrust badge for pproenca/dot-skills

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/pproenca/dot-skills.svg)](https://zalavijaysinh.github.io/skilltrust/repos/pproenca/dot-skills/)

Score history

Date	Version	Score
2026-11-07	`cf93c57`	100