Skip to content

Forem

# dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Cover image for Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Sep 21 '25

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

#systemdesign #dataengineering #architecture #kafka

4 min read

Cover image for Apache Polaris Dev Mailing List — Weekly Digest (Aug 11–17, 2025)

Aug 18 '25

Apache Polaris Dev Mailing List — Weekly Digest (Aug 11–17, 2025)

#database #datascience #dataengineering #data

4 min read

Cover image for Polyglot Data Engineering: Python + Go in the Same Pipeline

Mohamed Hussain S

Sep 19 '25

Polyglot Data Engineering: Python + Go in the Same Pipeline

#dataengineering #python #go #clickhouse

2 min read

Cover image for Apache Kafka & Amazon MSK: The Beating Heart of Real-Time Data

Kachi

Sep 20 '25

Apache Kafka & Amazon MSK: The Beating Heart of Real-Time Data

#dataengineering #architecture #opensource #aws

4 min read

Cover image for 🚀 Why You Should Pick Auto Loader Over Structured Streaming in Azure Databricks (The Funny Truth)

Shagun Khandelwal

Sep 18 '25

🚀 Why You Should Pick Auto Loader Over Structured Streaming in Azure Databricks (The Funny Truth)

#dataengineering #bigdata #python #ai

2 min read

Cover image for Real-Time CDC with Debezium and Kafka for Sharded PostgreSQL Integration

Andrey

Sep 18 '25

Real-Time CDC with Debezium and Kafka for Sharded PostgreSQL Integration

#dataengineering #bigdata #database #analytics

9 min read

Cover image for Apache Kafka in Data Engineering.

Sep 17 '25

Apache Kafka in Data Engineering.

#dataengineering #kafka

1 min read

Cover image for Apache Kafka in Data Engineering for Beginners

Sep 17 '25

Apache Kafka in Data Engineering for Beginners

#dataengineering #kafka

1 min read

Cover image for Beginner guide for Apache Kafka

Michael Kipkorir

Sep 17 '25

Beginner guide for Apache Kafka

#dataengineering #kafka #python

1 min read

Cover image for Sagas vs ACID Transactions: Ensuring Reliability in Distributed Architectures

Andrey

Sep 16 '25

Sagas vs ACID Transactions: Ensuring Reliability in Distributed Architectures

#sql #dataengineering #database #analytics

11 min read

Cover image for Automating Your Local DBT & Snowflake Playground with Python

Arunkumar Panneerselvam

Sep 16 '25

Automating Your Local DBT & Snowflake Playground with Python

#snowflake #dbt #python #dataengineering

10 min read

Sep 15 '25

Apache Arrow dev list digest (Sept 8–12, 2025)

#data #database #datascience #dataengineering

4 min read

Sep 15 '25

Apache Polaris dev list digest (Sept 8–12, 2025)

#data #database #datascience #dataengineering

4 min read

Cover image for Why I’m Switching to Parquet for Data Storage

Sep 15 '25

Why I’m Switching to Parquet for Data Storage

#parquet #datalake #dataengineering

3 min read

Joy Akinyi

Sep 14 '25

Change Data Capture (CDC) in Data Engineering: Concepts, Tools, and Real-World Implementation Strategies

#architecture #database #dataengineering

8 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.