Forem

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Why Apache Airflow is the Cornerstone of Modern Data Engineering
augo_amos profile

Why Apache Airflow is the Cornerstone of Modern Data Engineering

#airflow #dataengineering #apacheairflow
Comments
5 min read
Zero-Downtime Database Migration: The Complete Engineering Guide
Cover image for Zero-Downtime Database Migration: The Complete Engineering Guide
ari-ghosh profile

Zero-Downtime Database Migration: The Complete Engineering Guide

#database #dataengineering #migration #tutorial
11
Comments 4
53 min read
Apache Arrow dev list digest (Aug 25–29 2025)
alexmercedcoder profile

Apache Arrow dev list digest (Aug 25–29 2025)

#database #dataengineering #datascience #opensource
Comments
4 min read
Anomaly Detection in Financial Transactions: Algorithms and Applications
Cover image for Anomaly Detection in Financial Transactions: Algorithms and Applications
andrey_s profile

Anomaly Detection in Financial Transactions: Algorithms and Applications

#analytics #datascience #dataengineering #machinelearning
2
Comments
10 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
Cover image for Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
eric_kahindi_cfbfda3bd0f7 profile

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

#architecture #dataengineering #microservices
Comments 1
6 min read
(I) Principles of Data Model Architecture: Four Layers and Seven Stages
seatunnel profile

(I) Principles of Data Model Architecture: Four Layers and Seven Stages

#bigdata #dataengineering #programming #datawarehouse
5
Comments
7 min read
Revamping Real-Time Data Ingestion for Scalable Media Intelligence
Cover image for Revamping Real-Time Data Ingestion for Scalable Media Intelligence
capestart profile

Revamping Real-Time Data Ingestion for Scalable Media Intelligence

#dataengineering #mediaintelligence #microservices #aienabler
Comments
4 min read
Two Years of Microsoft Fabric: Game Changer or Still Leveling Up? 🚀
Cover image for Two Years of Microsoft Fabric: Game Changer or Still Leveling Up? 🚀
narayan_f8f2c91c99dfd33e6 profile

Two Years of Microsoft Fabric: Game Changer or Still Leveling Up? 🚀

#azure #dataengineering #cloud #microsoftfabric
Comments
2 min read
Docker for Data Engineers: The Complete Beginner’s Guide
Cover image for Docker for Data Engineers: The Complete Beginner’s Guide
dkkinyua profile

Docker for Data Engineers: The Complete Beginner’s Guide

#docker #python #dataengineering #bigdata
3
Comments
6 min read
Dynamic Routing Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg
datapenguin profile

Dynamic Routing Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg

#aws #dataengineering #duckdb #iceberg
6
Comments 4
4 min read
🚀 The Future of Data Engineering: How AI and Automation are Changing the Game
Cover image for 🚀 The Future of Data Engineering: How AI and Automation are Changing the Game
shagun_khandelwal profile

🚀 The Future of Data Engineering: How AI and Automation are Changing the Game

#dataengineering #python #ai #machinelearning
Comments
2 min read
The Blueprint of a Data Team: Roles, Responsibilities, and Specializations
Cover image for The Blueprint of a Data Team: Roles, Responsibilities, and Specializations
andrey_s profile

The Blueprint of a Data Team: Roles, Responsibilities, and Specializations

#datamanagement #dataengineering #bigdata #datagovernance
2
Comments
10 min read
Building an End-to-End Data Engineering Pipeline with DuckDB and Python
Cover image for Building an End-to-End Data Engineering Pipeline with DuckDB and Python
satyam_gupta profile

Building an End-to-End Data Engineering Pipeline with DuckDB and Python

#dataengineering #python #sql #tutorial
Comments 1
5 min read
Data Mesh: The Decentralized Revolution That Will Transform Your Data Architecture
Cover image for Data Mesh: The Decentralized Revolution That Will Transform Your Data Architecture
moubarakmohame4 profile

Data Mesh: The Decentralized Revolution That Will Transform Your Data Architecture

#kafka #algorithms #dataengineering #programming
1
Comments
4 min read
What is the Modern Data Stack?
24mwangi profile

What is the Modern Data Stack?

#dataops #dataengineering #sql
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.