Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
Forem
Close
#
dataengineering
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Skip the Database: Building Analytics Dashboards Directly from S3 Files
JOOJO DONTOH
JOOJO DONTOH
JOOJO DONTOH
Follow
Sep 27 '25
Skip the Database: Building Analytics Dashboards Directly from S3 Files
#
dataengineering
#
architecture
#
analytics
#
aws
17
 reactions
Comments
3
 comments
9 min read
From smog to streams: how data engineering helps us breathe easier.
Oliver Samuel
Oliver Samuel
Oliver Samuel
Follow
Oct 20 '25
From smog to streams: how data engineering helps us breathe easier.
#
architecture
#
dataengineering
#
opensource
1
 reaction
Comments
1
 comment
4 min read
Apache Iceberg dev list digest (Sept 8–12, 2025)
Alex Merced
Alex Merced
Alex Merced
Follow
Sep 15 '25
Apache Iceberg dev list digest (Sept 8–12, 2025)
#
data
#
database
#
datascience
#
dataengineering
1
 reaction
Comments
Add Comment
5 min read
How to Stream OLTP Data to MotherDuck in Real Time with Estuary
Sourabh Gupta
Sourabh Gupta
Sourabh Gupta
Follow
for
Estuary
Sep 26 '25
How to Stream OLTP Data to MotherDuck in Real Time with Estuary
#
duckdb
#
dataengineering
#
motherduck
#
database
1
 reaction
Comments
Add Comment
7 min read
The Ultimate Guide to Open Table Formats: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake
Alex Merced
Alex Merced
Alex Merced
Follow
Sep 25 '25
The Ultimate Guide to Open Table Formats: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake
#
data
#
database
#
datascience
#
dataengineering
3
 reactions
Comments
Add Comment
16 min read
How to Pass the AWS Certified Data Engineer – Associate (DEA-C01) Exam2025
Camille Chang
Camille Chang
Camille Chang
Follow
Sep 24 '25
How to Pass the AWS Certified Data Engineer – Associate (DEA-C01) Exam2025
#
aws
#
certification
#
dataengineering
#
beginners
3
 reactions
Comments
4
 comments
5 min read
Interesting links - August 2025
Robin Moffatt
Robin Moffatt
Robin Moffatt
Follow
Dec 17 '25
Interesting links - August 2025
#
data
#
dataengineering
#
kafka
#
flink
Comments
Add Comment
9 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
kiprotich Nicholas
kiprotich Nicholas
kiprotich Nicholas
Follow
Sep 24 '25
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
#
dataengineering
#
architecture
#
tutorial
#
kafka
1
 reaction
Comments
Add Comment
4 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
KiplangatJaphet
KiplangatJaphet
KiplangatJaphet
Follow
Sep 23 '25
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
#
dataengineering
#
architecture
#
backend
#
kafka
Comments
Add Comment
7 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
Kepha Mwandiki
Kepha Mwandiki
Kepha Mwandiki
Follow
Sep 23 '25
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
#
architecture
#
dataengineering
#
kafka
Comments
Add Comment
4 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
Lagat Josiah
Lagat Josiah
Lagat Josiah
Follow
Sep 23 '25
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
#
architecture
#
dataengineering
#
systemdesign
Comments
Add Comment
10 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
Amos Augo
Amos Augo
Amos Augo
Follow
Sep 22 '25
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
#
kafka
#
dataengineering
1
 reaction
Comments
Add Comment
6 min read
Apache Polaris Dev List Digest (Sept 15–19, 2025)
Alex Merced
Alex Merced
Alex Merced
Follow
Sep 22 '25
Apache Polaris Dev List Digest (Sept 15–19, 2025)
#
dataengineering
#
resources
#
data
#
opensource
Comments
Add Comment
4 min read
Building a Reddit Sentiment Pipeline using Python, PostgreSQL, VADER, Airflow, Grafana, Prometheus and StatsD
Denzel Kanyeki
Denzel Kanyeki
Denzel Kanyeki
Follow
Sep 22 '25
Building a Reddit Sentiment Pipeline using Python, PostgreSQL, VADER, Airflow, Grafana, Prometheus and StatsD
#
dataengineering
#
python
#
data
#
programming
1
 reaction
Comments
1
 comment
5 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
Oliver Samuel
Oliver Samuel
Oliver Samuel
Follow
Sep 21 '25
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
#
architecture
#
dataengineering
#
kafka
Comments
Add Comment
7 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a blogging-forward open source social network where we learn from one another
Log in
Create account
