Forem

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
🎯 The Challenge: Processing TBs of S3 Data Without Breaking the Bank

🎯 The Challenge: Processing TBs of S3 Data Without Breaking the Bank

Comments
5 min read
Why Apache Iceberg is needed?

Why Apache Iceberg is needed?

1
Comments
6 min read
Get Started with Fastest SQL Query Engine - Presto C++ (Prestissimo): Beginner Friendly Setup Guide with Docker.
Cover image for Get Started with Fastest SQL Query Engine - Presto C++ (Prestissimo): Beginner Friendly Setup Guide with Docker.

Get Started with Fastest SQL Query Engine - Presto C++ (Prestissimo): Beginner Friendly Setup Guide with Docker.

Comments
5 min read
Automating NASA’s Astronomy Picture of the Day with Airflow

Automating NASA’s Astronomy Picture of the Day with Airflow

Comments
6 min read
10 Best Platforms to Learn Data Analytics in 2026
Cover image for 10 Best Platforms to Learn Data Analytics in 2026

10 Best Platforms to Learn Data Analytics in 2026

4
Comments 1
4 min read
📘 Foundation Phase Completed - Starting Phase 2 of My Journey
Cover image for 📘 Foundation Phase Completed - Starting Phase 2 of My Journey

📘 Foundation Phase Completed - Starting Phase 2 of My Journey

Comments
3 min read
Streams de Dados: Processamento de Informações em Tempo Real

Streams de Dados: Processamento de Informações em Tempo Real

Comments
3 min read
Paralelismo em Python para Engenharia de Dados: O Segredo das Tarefas I/O-Bound

Paralelismo em Python para Engenharia de Dados: O Segredo das Tarefas I/O-Bound

Comments 1
6 min read
Skip the Database: Building Analytics Dashboards Directly from S3 Files
Cover image for Skip the Database: Building Analytics Dashboards Directly from S3 Files

Skip the Database: Building Analytics Dashboards Directly from S3 Files

17
Comments 3
9 min read
From smog to streams: how data engineering helps us breathe easier.

From smog to streams: how data engineering helps us breathe easier.

1
Comments 1
4 min read
Apache Iceberg dev list digest (Sept 8–12, 2025)

Apache Iceberg dev list digest (Sept 8–12, 2025)

1
Comments
5 min read
How to Stream OLTP Data to MotherDuck in Real Time with Estuary
Cover image for How to Stream OLTP Data to MotherDuck in Real Time with Estuary

How to Stream OLTP Data to MotherDuck in Real Time with Estuary

1
Comments
7 min read
The Ultimate Guide to Open Table Formats: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake
Cover image for The Ultimate Guide to Open Table Formats: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake

The Ultimate Guide to Open Table Formats: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake

3
Comments
16 min read
How to Pass the AWS Certified Data Engineer – Associate (DEA-C01) Exam2025
Cover image for How to Pass the AWS Certified Data Engineer – Associate (DEA-C01) Exam2025

How to Pass the AWS Certified Data Engineer – Associate (DEA-C01) Exam2025

3
Comments 4
5 min read
Interesting links - August 2025

Interesting links - August 2025

Comments
9 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.