rodado
fb67c38edd
- move temp scripts to scripts/, cv files to cv/, jobs.csv to results/ - update index.ts and recheck.ts CSV path to results/jobs.csv - fix imports in scripts/ to use ../config.ts and ../fetch.ts - update CLAUDE.md and README.md to reflect new structure - add plans/ with LinkedIn post drafts - update .gitignore: ignore results/, jobs/, cv binaries, .DS_Store
1.1 KiB
Post 3 — Jun 17 · Rodado + datative
Angle: Data engineering at scale, pipeline story
675 GB. 533 datasets. One question: what do you actually do with Brazilian open data?
The government publishes it. The files exist. But they're scattered across formats, encodings, and schemas that change without notice. Most of it is effectively inaccessible to anyone who isn't willing to spend weeks just cleaning.
Rodado is my answer to that: a pipeline that organizes, normalizes, and indexes the full archive of Brazilian public datasets — census data, company registries, electoral records, public spending — into something you can actually query.
On top of that I built datative, an investigation platform that turns any of those datasets into interactive force-graphs. It was designed for journalists and researchers who need to follow connections, not just rows.
Both open source. The pipeline patterns transfer directly to any domain — scientific data, financial records, public health.
🔗 Rodado: git.extrapolo.com/polo/baseldosdados 🔗 datative: github.com/rafapolo/datative