chore: reorganize repo structure and update docs
- move temp scripts to scripts/, cv files to cv/, jobs.csv to results/ - update index.ts and recheck.ts CSV path to results/jobs.csv - fix imports in scripts/ to use ../config.ts and ../fetch.ts - update CLAUDE.md and README.md to reflect new structure - add plans/ with LinkedIn post drafts - update .gitignore: ignore results/, jobs/, cv binaries, .DS_Store
This commit is contained in:
@@ -0,0 +1,18 @@
|
||||
# Post 3 — Jun 17 · Rodado + datative
|
||||
|
||||
**Angle:** Data engineering at scale, pipeline story
|
||||
|
||||
---
|
||||
|
||||
675 GB. 533 datasets. One question: what do you actually do with Brazilian open data?
|
||||
|
||||
The government publishes it. The files exist. But they're scattered across formats, encodings, and schemas that change without notice. Most of it is effectively inaccessible to anyone who isn't willing to spend weeks just cleaning.
|
||||
|
||||
**Rodado** is my answer to that: a pipeline that organizes, normalizes, and indexes the full archive of Brazilian public datasets — census data, company registries, electoral records, public spending — into something you can actually query.
|
||||
|
||||
On top of that I built **datative**, an investigation platform that turns any of those datasets into interactive force-graphs. It was designed for journalists and researchers who need to follow connections, not just rows.
|
||||
|
||||
Both open source. The pipeline patterns transfer directly to any domain — scientific data, financial records, public health.
|
||||
|
||||
🔗 Rodado: git.extrapolo.com/polo/baseldosdados
|
||||
🔗 datative: github.com/rafapolo/datative
|
||||
Reference in New Issue
Block a user