Forem

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Personal Picks: Data Product News (October 1, 2025)
sagara profile

Personal Picks: Data Product News (October 1, 2025)

#dataengineering #snowflake #databricks
Comments
7 min read
From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks
Cover image for From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks
kepha_mwandiki profile

From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks

#dataengineering #automation #tutorial #sql
4
Comments 1
10 min read
Git Integration in Microsoft Fabric
anshul_02 profile

Git Integration in Microsoft Fabric

#dataengineering #fabric #microsoft
4
Comments
3 min read
🎯 The Challenge: Processing TBs of S3 Data Without Breaking the Bank
qvfagundes profile

🎯 The Challenge: Processing TBs of S3 Data Without Breaking the Bank

#data #dataengineering #ai
Comments
5 min read
Why Apache Iceberg is needed?
minwook profile

Why Apache Iceberg is needed?

#dataengineering #ai #programming #robotics
1
Comments
6 min read
Automating NASA’s Astronomy Picture of the Day with Airflow
oliver_samuel_028c6f65ad6 profile

Automating NASA’s Astronomy Picture of the Day with Airflow

#postgres #dataengineering #tutorial #architecture
Comments
6 min read
📘 Foundation Phase Completed - Starting Phase 2 of My Journey
Cover image for 📘 Foundation Phase Completed - Starting Phase 2 of My Journey
ramyakaruturi profile

📘 Foundation Phase Completed - Starting Phase 2 of My Journey

#dataengineering #learning #linux #cloudcomputing
Comments
3 min read
10 Best Platforms to Learn Data Analytics in 2026
Cover image for 10 Best Platforms to Learn Data Analytics in 2026
stack_overflowed profile

10 Best Platforms to Learn Data Analytics in 2026

#webdev #dataengineering #datascience #learning
3
Comments
4 min read
Streams de Dados: Processamento de Informações em Tempo Real
programadriano profile

Streams de Dados: Processamento de Informações em Tempo Real

#architecture #data #dataengineering
Comments
3 min read
Paralelismo em Python para Engenharia de Dados: O Segredo das Tarefas I/O-Bound
_richardson_ profile

Paralelismo em Python para Engenharia de Dados: O Segredo das Tarefas I/O-Bound

#python #dataengineering #data #programming
Comments 1
6 min read
Skip the Database: Building Analytics Dashboards Directly from S3 Files
Cover image for Skip the Database: Building Analytics Dashboards Directly from S3 Files
joojodontoh profile

Skip the Database: Building Analytics Dashboards Directly from S3 Files

#dataengineering #architecture #analytics #aws
17
Comments 3
9 min read
From smog to streams: how data engineering helps us breathe easier.
oliver_samuel_028c6f65ad6 profile

From smog to streams: how data engineering helps us breathe easier.

#architecture #dataengineering #opensource
1
Comments 1
4 min read
Apache Iceberg dev list digest (Sept 8–12, 2025)
alexmercedcoder profile

Apache Iceberg dev list digest (Sept 8–12, 2025)

#data #database #datascience #dataengineering
1
Comments
5 min read
How to Stream OLTP Data to MotherDuck in Real Time with Estuary
Cover image for How to Stream OLTP Data to MotherDuck in Real Time with Estuary
techsourabh profile

How to Stream OLTP Data to MotherDuck in Real Time with Estuary

#duckdb #dataengineering #motherduck #database
1
Comments
7 min read
The Ultimate Guide to Open Table Formats: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake
Cover image for The Ultimate Guide to Open Table Formats: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake
alexmercedcoder profile

The Ultimate Guide to Open Table Formats: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake

#data #database #datascience #dataengineering
3
Comments
16 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.