State a breaking schema change in plain language. RippleX migrates every real consumer.

Retype a column, deprecate one, move consumers to a replacement — RippleX reads DataHub's column-level lineage to find every downstream consumer (dbt models, dashboards, ML features), then executes a real expand → migrate → verify → contract migration: real Git PRs, real parallel-run verification against the warehouse, a real deprecation and playbook written back into the catalog.

Six agents, deterministic writes Real PRs, not reports DataHub is the source of truth

How it works

Deterministic code performs every real mutation. The LLM proposes — it never executes a write directly.

1. Cartographer
Two-stage lineage traversal finds every real downstream consumer — dbt models, BI dashboards, ML feature tables — and judges whether the change is breaking.
2. Planner
Sequences an expand → migrate → verify → contract plan, topologically ordered so nothing migrates before its own upstream.
3. Surgeon
Rewrites per-consumer SQL with SQLGlot — never a string replace — and stages the diffs that become real PRs.
4. Verifier
Proves the whole propagated chain correct in one query per consumer against the real warehouse, before anything is staged for real.
5. Scribe
Writes the migration playbook and, on contract, the deprecation (sunset date + replacement pointer) back into DataHub.
6. Reviewer
Gates every real mutation — PRs, warehouse writes, catalog writes — behind human approval.

Proof, not a promise

Real numbers from RippleX's own state DB, computed live on every page load.

Real runs executed
Completed end to end
Recurring targets

Architecture

DataHub on a single GCE VM (not GKE — a deliberate cost call, see NOTES.md), Cloud Run for the stateless service, Cloud SQL for state.

Cloud Run
RippleX FastAPI service, scale-to-zero
DataHub (GCE VM)
GMS + frontend + a RippleX Action as a systemd service
Warehouse (same VM)
Real Postgres + dbt project, the demo estate
Cloud SQL
RippleX's own state & audit DB
GitHub
Real PRs against a real sample-estate repo
Secret Manager
Every credential, never baked into an image
Built for Build with DataHub: The Agent Hackathon (Agents That Do Real Work)Apache 2.0 · Source