Forem

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
I Built a Personal Knowledge Graph. Apple Had Already Built One on My Laptop.
Cover image for I Built a Personal Knowledge Graph. Apple Had Already Built One on My Laptop.
niclydon profile

I Built a Personal Knowledge Graph. Apple Had Already Built One on My Laptop.

#apple #postgres #privacy #dataengineering
1
Comments 1
6 min read
DatAasee 0.9 Released
Cover image for DatAasee 0.9 Released
gramian profile

DatAasee 0.9 Released

#metadata #lakehouse #dataengineering #database
Comments
1 min read
Add Data Quality Checks to Your Airflow DAG in 5 Minutes
vahid_saber_d47950be99729 profile

Add Data Quality Checks to Your Airflow DAG in 5 Minutes

#airflow #dataengineering #python #dataquality
Comments
3 min read
Managed Iceberg Data Lakes: A Guide
jonisar profile

Managed Iceberg Data Lakes: A Guide

#data #database #dataengineering #opensource
Comments
14 min read
That Time One Field Change Took Down an Entire Production Pipeline
Cover image for That Time One Field Change Took Down an Entire Production Pipeline
reetesh_kumar profile

That Time One Field Change Took Down an Entire Production Pipeline

#backend #dataengineering #distributedsystems #systemdesign
1
Comments
4 min read
Beyond Monitoring: Building AI-Powered Predictive Observability for Retail Data Pipelines published
amaranarun profile

Beyond Monitoring: Building AI-Powered Predictive Observability for Retail Data Pipelines published

#dataengineering #observability #mlops #dataquality
Comments
8 min read
Data Engineer Salaries Are Splitting in Two. Which Side Are You On?
datadriven profile

Data Engineer Salaries Are Splitting in Two. Which Side Are You On?

#dataengineering #career #beginners #interview
Comments
7 min read
Apache NiFi vs Airflow: Which Platform is Better for ETL and Automation?
aarav_singh_743b3b267e1f8 profile

Apache NiFi vs Airflow: Which Platform is Better for ETL and Automation?

#architecture #automation #data #dataengineering
1
Comments 1
6 min read
Folders, Apartments, and Fake Computers: A Guide to Virtual Environments, Docker, and VMs
Cover image for Folders, Apartments, and Fake Computers: A Guide to Virtual Environments, Docker, and VMs
lawrence_murithi profile

Folders, Apartments, and Fake Computers: A Guide to Virtual Environments, Docker, and VMs

#docker #virtualmachine #virtualenvironment #dataengineering
Comments
8 min read
A Step-by-Step Starter Kit for Building a Data Quality Framework
Cover image for A Step-by-Step Starter Kit for Building a Data Quality Framework
balapriya profile

A Step-by-Step Starter Kit for Building a Data Quality Framework

#data #dataengineering #testing #tutorial
Comments
6 min read
Data Series: Understanding ETL & Medallion Architecture — Part 1
deepak_shankar_4421c006b5 profile

Data Series: Understanding ETL & Medallion Architecture — Part 1

#architecture #beginners #dataengineering #tutorial
1
Comments
2 min read
Why Your ADF Pipeline Shows Success But Your Data Is Wrong
chandramouli_kondamudi_82 profile

Why Your ADF Pipeline Shows Success But Your Data Is Wrong

#azure #dataengineering #data #etl
Comments
2 min read
Eradicating Operational Drag: Architecting a Resilient Data Ingestion Pipeline
ankitjswl56 profile

Eradicating Operational Drag: Architecting a Resilient Data Ingestion Pipeline

#systemdesign #architecture #dataengineering #automation
Comments
5 min read
The Medallion Architecture: Turning Messy Data into Business Gold
Cover image for The Medallion Architecture: Turning Messy Data into Business Gold
lawrence_murithi profile

The Medallion Architecture: Turning Messy Data into Business Gold

#architecture #luxdev #dataengineering #warehouse
Comments
9 min read
Apache Data Lakehouse Weekly: April 30–May 6, 2026
Cover image for Apache Data Lakehouse Weekly: April 30–May 6, 2026
alexmercedcoder profile

Apache Data Lakehouse Weekly: April 30–May 6, 2026

#news #data #dataengineering #opensource
Comments
9 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.