Enterprise Manufacturing Analytics Platform
ActiveA dbt + Databricks pipeline using a medallion (Bronze→Silver→Gold→Mart) architecture to turn raw ERP data into analytics-ready models for manufacturing, inventory, sales, and workforce reporting.
Tech Stack
Overview
A dbt project running on Databricks that transforms raw ERP data into analytics-ready models. It implements a medallion (Bronze → Silver → Gold → Mart) architecture so cleaned, curated tables can power KPI dashboards, leaderboards, and operational views across multiple manufacturing lines, workforce productivity, pre-production planning, and sales reporting.
Architecture
Data flows through four progressively refined layers, each with a clear responsibility:
- Bronze — raw ingested ERP source tables, landed as-is.
- Silver — cleaned and standardized facts and dimensions (orders, units, sales, scans, employee hours).
- Gold — domain-curated, business-ready models with lead times, production metrics, and remake reasons.
- Mart — analytical views: KPIs, leaderboards, and aggregations consumed by dashboards.
Highlights
- Layered modeling with reusable macros for schema naming and shared transformation logic.
- Data-quality tests and snapshots for slowly changing dimensions.
- Seed-driven reference lookups for reproducible, version-controlled metadata.
- Built on Unity Catalog with managed Iceberg tables for Silver/Gold layers.
My Role
- Took part in the architecture design and deployment of the platform.
- Built a three-tier, AI-powered self-service query application on top of the data layer, letting production teams explore the data they need on their own — without going through the data team.
- Implemented access separation so each role and department can only reach the data it is authorized to see.
Other Projects
Serverless appointment-slot monitor for Australian visa applications — sends real-time alerts when new slots open, built on Playwright, Vercel Cron, and Supabase.
A collection of SQL scripts, pgBadger dashboards, and Python automation tools for diagnosing and resolving slow-query issues in high-traffic PostgreSQL clusters.
Enterprise-grade bidirectional data pipeline connecting NetSuite ERP and Boomi AtomSphere, processing 50k+ transactions per day with sub-3s latency.