Skip to content

Forem

# dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Cover image for Why Idempotence Is So Important in Data Engineering

Dec 14 '25

Why Idempotence Is So Important in Data Engineering

#architecture #dataengineering #systemdesign #etl

6 min read

Cover image for Reducing Consumer Lag in Apache Kafka

Nov 10 '25

Reducing Consumer Lag in Apache Kafka

#kafka #dataengineering #python #eventdriven

3 min read

Cover image for Analyzing and Optimizing a Parquet ClickHouse Ingestion Pipeline

Mohamed Hussain S

Dec 13 '25

Analyzing and Optimizing a Parquet ClickHouse Ingestion Pipeline

#dataengineering #etl #clickhouse #python

3 min read

Cover image for 🚀 Day 1: Introduction to Apache Spark

Sandeep

Dec 1 '25

🚀 Day 1: Introduction to Apache Spark

#spark #python #dataengineering #bigdata

2 min read

Alberto Cardenas

Dec 13 '25

Shine in Your Next Data Engineering Interview with Pandas

#interview #dataengineering #performance #python

10 min read

Nov 6 '25

Writes, 3 ways: Postgres, Apache Kafka® and Apache Iceberg™

#postgres #dataengineering #learning #database

10 min read

Vinicius Fagundes

Nov 6 '25

Building Custom MCP Servers with Python: A Data Engineer's Guide 🛠️

#dataengineering #software #python #ai

5 min read

Cover image for The Next Era of Databases: When Queries Write Themselves

Nov 6 '25

The Next Era of Databases: When Queries Write Themselves

#dataengineering #naturallanguagequery #dataanalytics #machinelearning

4 min read

Pradeep Kalluri

Dec 8 '25

Why 71,000 Data Engineers Read My Article: What I Learned About Technical Writing

#dataengineering #writing #programming #career

6 min read

Nov 7 '25

Transforming Tableau Performance: How Optimized Data Logic Cut Dashboard Load Time by 98.9%

#analytics #dataengineering #performance #sql

8 min read

Nov 6 '25

rec

#tooling #dataengineering #automation #linux

2 min read

Dec 9 '25

Automating EL pipeline using Azure Functions(Python)

#dataengineering #azurefunctions #eventgrid #python

4 min read

Dec 10 '25

Top Open-Source Data Engineering Tools- Unravelling the Best in 2026

#dataengineering #opensource #dataengineeringtool

10 min read

Cover image for Let's say you have a data lake

Nov 27 '25

Let's say you have a data lake

#dataengineering #data #csvpath #csv

3 min read

Dec 9 '25

Data Engineering in 30 Days - Day 2

#dataengineering #data #python #programming

2 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.