Migrants Resilience Collaborative
Turning a 5-million-record database into real-time, actionable insight
Challenge:
As one of India’s largest worker collectives, MRC manages data from millions of migrant households across multiple states. Over time, this data had become fragmented, dashboards were slow to load, and decision-making was delayed. State Coordinators needed a faster way to monitor registrations, applications, and benefits — without depending on analysts for every report.
What we did:
We partnered with MRC to restructure their data architecture and build a scalable data pipeline on Dalgo.
Our work included:
1. Consolidating 5M+ records across disparate datasets into a unified warehouse.
2. Designing data-mart tables to produce scorecards and dashboards at state and district levels.
3. Creating a Google Sheets-based validation framework to test pipeline accuracy in real time.
4. Launching a State Coordinator Dashboard — with tailored metrics, views, and user training.
What changed:
State teams can now access their own data instantly, track progress, and identify bottlenecks — without waiting for backend support. Leadership reviews are anchored in live dashboards, not PowerPoint reports. The pipeline is lightweight, auditable, and scalable — ready to accommodate new programs and data sources.
Result:
MRC can now make data-driven decisions at scale — faster, cheaper, and with greater confidence. Their core tech teams focus on long-term innovation, while program teams handle day-to-day insight themselves.
” You didn’t just build us data pipelines — you built dreamlines. If we could ETL our gratitude, you’d be swimming in tables! “