data-processing
Use when working with structured data files (CSV, JSON, YAML, TOML, Parquet) — querying, transforming, filtering, aggregating, or converting between formats
Best for Data engineersWorks with GitHubLow risk
⌘source
- author
@jeremylongshore- language
- Python
★2.1kstars
281forks
May 1, 2026
✦overview.md
Key Features
- ·Query JSON with jq
- ·Transform YAML/TOML/XML with yq
- ·Flatten JSON with gron
- ·Process CSV/JSON with miller
- ·Slice CSV with xsv
- ·SQL queries on local files with DuckDB
Use Cases
- →Filter active items from a JSON API response
- →Aggregate sales data from CSV files
- →Convert YAML config to JSON format
- →Join two CSV files by a key column
Best for
- ✓Data engineers
- ✓Ad-hoc data analysis
- ✓CI pipelines
Not ideal for
- !Real-time streaming data
- !Very large datasets without indexing
FAQs
name
data-processing
description
Use when working with structured data files (CSV, JSON, YAML, TOML, Parquet) — querying, transforming, filtering, aggregating, or converting between formats
license
MIT
allowed-tools:["Bash(jq*)","Bash(yq*)","Bash(gron*)","Bash(mlr*)","Bash(xsv*)","Bash(duckdb*)","Read","Glob","Grep"]
version:1.0.0
author:ykotik
Data Processing
When to Use
- Querying, filtering, or transforming JSON files
- Reading or converting YAML, TOML, or XML config files
- Analyzing, aggregating, or joining CSV/TSV/Parquet files
- Running SQL queries against local data files without a database server
- Converting between data formats (JSON to YAML, CSV to JSON, etc.)
- Exploring deeply nested JSON structures
Tools
| Tool | Purpose | Structured output |
|---|---|---|
| jq | Query and transform JSON | Native JSON |
| yq | Query and transform YAML, TOML, XML | -o json for JSON output |
| gron | Flatten JSON into greppable path.to.key = value lines | --ungron to reverse back to JSON |
| miller (mlr) | Transform CSV/JSON/TSV records with awk-like verbs | --json for JSON output |
| xsv | Fast CSV slicing, searching, joining, statistics | CSV native (pipe to xsv table for display) |
| DuckDB | SQL queries on CSV, JSON, Parquet files | -json flag for JSON output |
Patterns
JSON: Filter array elements by field value
jq '.items[] | select(.status == "active")' data.json
JSON: Extract specific fields from array
$install
1-click copynpx skills add jeremylongshore/claude-code-plugins-plus-skills --skill data-processingSafety assessment
★
Clarity score
How clear and easy to understand the SKILL.md instructions are, rated from 1 to 5.
5/ 5
excellentVery clear and well structured, with almost no room for misunderstanding.
◎
Actionability score
How directly an agent can act on the SKILL.md instructions, rated from 1 to 5.
5/ 5
very highHighly actionable with clear, concrete steps that an agent can follow directly.