Skip to content

Enterprise Manufacturing Analytics Platform

Active

A dbt + Databricks pipeline using a medallion (Bronze→Silver→Gold→Mart) architecture to turn raw ERP data into analytics-ready models for manufacturing, inventory, sales, and workforce reporting.

Tech Stack

dbtDatabricksUnity CatalogApache IcebergPythonSQLMedallion Architecture

Overview

A dbt project running on Databricks that transforms raw ERP data into analytics-ready models. It implements a medallion (Bronze → Silver → Gold → Mart) architecture so cleaned, curated tables can power KPI dashboards, leaderboards, and operational views across multiple manufacturing lines, workforce productivity, pre-production planning, and sales reporting.

Architecture

Data flows through four progressively refined layers, each with a clear responsibility:

  • Bronze — raw ingested ERP source tables, landed as-is.
  • Silver — cleaned and standardized facts and dimensions (orders, units, sales, scans, employee hours).
  • Gold — domain-curated, business-ready models with lead times, production metrics, and remake reasons.
  • Mart — analytical views: KPIs, leaderboards, and aggregations consumed by dashboards.

Highlights

  • Layered modeling with reusable macros for schema naming and shared transformation logic.
  • Data-quality tests.
  • Seed-driven reference lookups for reproducible, version-controlled metadata.
  • Built on Unity Catalog with managed Iceberg tables for Silver/Gold layers.

My Role

  • Took part in the platform's architecture design and built part of it.
  • Built a three-tier, AI-powered self-service query application on top of the data layer, letting production teams explore the data they need on their own — without going through the data team.
  • Implemented access separation so each role and department can only reach the data it is authorized to see.
← Back to Projects

Other Projects

B2B Customer PortalActive

A B2B portal for customers, backed by NetSuite. Deployed to a company server in September 2026 and used internally; not yet open to customers.

.NET 10ASP.NET CoreEF Core
DataHubActive

An internal data hub, rewritten in C#/.NET: an older system split across three services became one ASP.NET Core application. In production since June 2026, released by tag ever since.

.NET 10ASP.NET CoreDapper
jackdeng.cc — Personal HubActive

The site you're reading: the frontend and Payload CMS 3 live in one Next.js 16 app, the data sits in Supabase Postgres, and it deploys to Vercel, in English and Chinese.

Next.js 16Payload CMS 3PostgreSQL