Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
Forem
Close
#
dataengineering
Follow
Hide
Posts
Left menu
đ
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
What's New in dbt 1.10
Hammad Ahmed đ©
Hammad Ahmed đ©
Hammad Ahmed đ©
Follow
Dec 27 '25
What's New in dbt 1.10
#
dbt
#
data
#
datascience
#
dataengineering
3
 reactions
Comments
Add Comment
12 min read
The Day Our Pipeline Went From 10 Minutes to 6 Seconds (Part 2 of 3)
Karthikeyan Rajasekaran
Karthikeyan Rajasekaran
Karthikeyan Rajasekaran
Follow
Dec 26 '25
The Day Our Pipeline Went From 10 Minutes to 6 Seconds (Part 2 of 3)
#
dataengineering
#
dbt
#
dagster
#
data
2
 reactions
Comments
Add Comment
7 min read
How Strategic Image Cropping Transforms Data Ingestion Pipelines
Stefan Vitoria
Stefan Vitoria
Stefan Vitoria
Follow
Dec 26 '25
How Strategic Image Cropping Transforms Data Ingestion Pipelines
#
dataengineering
#
machinelearning
#
performance
1
 reaction
Comments
Add Comment
4 min read
Taming the Data Beast: Build Pipelines That Bend, Not Break by Arvind Sundararajan
Arvind SundaraRajan
Arvind SundaraRajan
Arvind SundaraRajan
Follow
Nov 22 '25
Taming the Data Beast: Build Pipelines That Bend, Not Break by Arvind Sundararajan
#
dataengineering
#
datascience
#
architecture
#
data
Comments
Add Comment
2 min read
Snowflake + Postgres: A Small Feature That Signals a Big Shift
Shrinivas Vishnupurikar
Shrinivas Vishnupurikar
Shrinivas Vishnupurikar
Follow
Dec 26 '25
Snowflake + Postgres: A Small Feature That Signals a Big Shift
#
snowflake
#
postgres
#
database
#
dataengineering
Comments
Add Comment
6 min read
Data Quality at Scale: Why Your Pipeline Needs More Than Green Checkmarks
Pradeep Kalluri
Pradeep Kalluri
Pradeep Kalluri
Follow
Nov 24 '25
Data Quality at Scale: Why Your Pipeline Needs More Than Green Checkmarks
#
dataengineering
#
dataquality
#
bigdata
#
python
Comments
Add Comment
8 min read
Prompt Engineering Patterns: From Zero-Shot to Chain-of-Thought Reasoning
Vinicius Fagundes
Vinicius Fagundes
Vinicius Fagundes
Follow
Dec 5 '25
Prompt Engineering Patterns: From Zero-Shot to Chain-of-Thought Reasoning
#
ai
#
mcp
#
llm
#
dataengineering
1
 reaction
Comments
Add Comment
14 min read
Introduction to the Confluent REST Proxy
Aisalkyn Aidarova
Aisalkyn Aidarova
Aisalkyn Aidarova
Follow
Nov 20 '25
Introduction to the Confluent REST Proxy
#
api
#
architecture
#
dataengineering
2
 reactions
Comments
Add Comment
4 min read
Why We Need Schema Registry in Kafka
Aisalkyn Aidarova
Aisalkyn Aidarova
Aisalkyn Aidarova
Follow
Nov 20 '25
Why We Need Schema Registry in Kafka
#
systemdesign
#
distributedsystems
#
dataengineering
#
architecture
2
 reactions
Comments
Add Comment
17 min read
While We're Measuring Developer Productivity, Won't Someone Think of the Data Engineers?
David Aronchick
David Aronchick
David Aronchick
Follow
Nov 25 '25
While We're Measuring Developer Productivity, Won't Someone Think of the Data Engineers?
#
dataengineering
#
devrel
#
productivity
#
observability
Comments
Add Comment
9 min read
Behind the Scenes of Data Ingestion: How Small Issues Cause Big Headaches
Rutika Khaire
Rutika Khaire
Rutika Khaire
Follow
Dec 24 '25
Behind the Scenes of Data Ingestion: How Small Issues Cause Big Headaches
#
dataingestion
#
medallion
#
dataengineering
#
datafactory
2
 reactions
Comments
2
 comments
3 min read
Modern Data Pipelines: Why Five Layers Changed Everything (Part 1 of 3)
Karthikeyan Rajasekaran
Karthikeyan Rajasekaran
Karthikeyan Rajasekaran
Follow
Dec 24 '25
Modern Data Pipelines: Why Five Layers Changed Everything (Part 1 of 3)
#
dataengineering
#
dbt
#
dagster
#
python
2
 reactions
Comments
Add Comment
6 min read
Azure Synapse Analytics
Aviral Srivastava
Aviral Srivastava
Aviral Srivastava
Follow
Nov 21 '25
Azure Synapse Analytics
#
analytics
#
cloud
#
dataengineering
#
azure
Comments
Add Comment
5 min read
Debugging Windows Race Conditions in Dagster
Steven Hur
Steven Hur
Steven Hur
Follow
Nov 18 '25
Debugging Windows Race Conditions in Dagster
#
devjournal
#
dataengineering
#
python
#
opensource
Comments
Add Comment
3 min read
Design Patterns for Data Engineers: Cleaner ETL with the Builder Pattern.
Cristian Bergamo
Cristian Bergamo
Cristian Bergamo
Follow
Dec 2 '25
Design Patterns for Data Engineers: Cleaner ETL with the Builder Pattern.
#
dataengineering
#
designpatterns
#
python
3
 reactions
Comments
Add Comment
2 min read
đ
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a blogging-forward open source social network where we learn from one another
Log in
Create account