Transform your data with dbt (data build tool). Learn best practices for analytics engineering, SQL-based data modeling, testing, and documenting your modern data stack. Explore our collection of 12 in-depth articles about dbt on DataEngineer Hub. Each tutorial provides practical, hands-on guidance with real-world examples to help you master dbt concepts and best practices.
For years, the pattern was: Airflow sits in one corner of your infrastructure, dbt runs on a server somewhere else, they pass data between each other via manual credential handoffs…
You read about dbt State. You understood the pitch — skip unchanged models, cut compute, stop paying to rebuild what didn’t change. Then you opened your project and stared at…
You have a 400-model dbt project. A junior analyst tweaks one source definition. Every. Single. Model. Rebuilds. Ninety minutes later, you’ve burned $1,200 in warehouse compute for a change that…
You’ve probably heard the buzz: dbt’s new Fusion engine is 30x faster. But what nobody says clearly is faster at what, for whom, and does it break your project? The answer is…
TL;DR→ Delta Lake is easier to start with, especially if you’re already on Databricks→ Iceberg wins on engine flexibility — works natively with Spark, Flink, Trino, Snowflake, and more without…
I passed the SnowPro Gen AI certification not too long ago. Within the same week I was back at my desk staring at a broken pipeline that no multiple-choice question…
Three practical methods to query Snowflake data in DuckDB — via Iceberg tables, ADBC, or a hybrid architecture — with real cost breakdowns showing 70–90% savings on BI and dev workloads.
I’ve been running dbt in production for a while now. And I’ll be honest — there was a phase where I genuinely believed that if my dbt tests were green,…
How I Wired Snowflake’s Native dbt Projects to Airflow — And Finally Got True End-to-End Orchestration I’ll be honest with you — for a long time I was running dbt…
The Moment Everything Changed It was a Tuesday morning when I finally snapped. My dbt project had grown to 147 models, and the daily run was taking 2 hours and…
Run dbt Core Directly in Snowflake Without Infrastructure Snowflake native dbt integration announced at Summit 2025 eliminates the need for separate containers or VMs to run dbt Core. Data teams…
If you’ve ever inherited a dbt project, you know there are two kinds: the clean, logical, and easy-to-navigate project, and the other kind—a tangled mess of models that makes you…