Data Engineering is platform engineering

Most teams build pipelines. The best ones build the foundations others can build on.

As I wrap up another data pipeline, I glance at our backlog. Two other pipelines. One dashboard. One regulatory report. I’ve built versions of these a hundred times. Slightly different inputs and outputs, but more or less the same. What is the point of all this? We are solving the same problems again and again. Why don’t we try to solve them once and fo…