Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

longtk26

Apr 17

Overview: Change Data Capture (CDC)

#database #dataengineering #distributedsystems #systemdesign

4 min read

Martin Tuncaydin

Apr 17

The NDC Revolution and What It Means for Data Engineers in Travel Tech

#ndc #dataengineering #airlinetechnology #traveltech

6 min read

Hello Arisyn

Apr 17

The Missing Layer in Your Data Stack Why Semantic Intelligence Matters More Than Another BI Tool

#dataengineering #semanticlayer #datagovernance #naturallanguagequery

4 min read

Anthony Gicheru

Apr 17

Data Pipelines Explained Simply (and How to Build Them with Python)

#etl #python #datapipeline #dataengineering

2 min read

Meng Lin

Apr 16

Building NewHomie property analytics tool — Part 1

#dataengineering #aws #softwareengineering #distributedsystems

8 min read

Cover image for Stop Rewriting the Same LLM Boilerplate: Batch-Process DataFrames in 3 Lines

ptimizeroracle

Apr 16

Stop Rewriting the Same LLM Boilerplate: Batch-Process DataFrames in 3 Lines

#python #opensource #dataengineering #llm

4 min read

Cover image for How to Add a Data Quality Gate to Your Airflow Pipeline in 5 Minutes

Vignesh

Apr 17

How to Add a Data Quality Gate to Your Airflow Pipeline in 5 Minutes

#dataengineering #airflow #etl #programming

4 min read

Wilians Conde

Apr 16

Processing High Frequency Solar Data Without HPC: Real Constraints and Design Decisions in MackSun

#dataengineering #mongodb #systemdesign #bigdata

3 min read

DataDriven

Apr 16

What Spark Interviews Actually Test (Based on 189 Real Interview Reports)

#dataengineering #interview #career #programming

7 min read

Cover image for Why Semantic Layers Need Distributional Validation, Not Just Schema Validation

Anthony Johnson II

Apr 16

Why Semantic Layers Need Distributional Validation, Not Just Schema Validation

#dataquality #semanticlayer #dataengineering #opensource

9 min read

Soumyadeep Basu

Apr 16

AWS Lake Formation: TBAC vs NBAC — The Permission Model Decision That Will Define Your Data Lake

#aws #dataengineering #terraform #cloud

4 min read

Cover image for DuckDB in the Wild: What 6 Minutes of Benchmarking Across 4 Machines Taught Me About Real-World Performance

XIANGWEIXIAO

Apr 16

DuckDB in the Wild: What 6 Minutes of Benchmarking Across 4 Machines Taught Me About Real-World Performance

#database #dataengineering #performance #sql

5 min read

jim kinyua

Apr 16

ETL vs ELT: Understanding the Two Pillars of Modern Data Engineering

#dataengineering #etl #database #beginners

16 min read

Cover image for Financial Data Integration: A Practical Guide

Andrew Tan

Apr 16

Financial Data Integration: A Practical Guide

#architecture #dataengineering #systemdesign #tutorial

7 min read

Cover image for Why Real-Time Data Integration Matters for Modern Applications

Andrew Tan

Apr 16

Why Real-Time Data Integration Matters for Modern Applications

#data #dataengineering #systemdesign #devops

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Forem

# dataengineering

Overview: Change Data Capture (CDC)

The NDC Revolution and What It Means for Data Engineers in Travel Tech

The Missing Layer in Your Data Stack Why Semantic Intelligence Matters More Than Another BI Tool

Data Pipelines Explained Simply (and How to Build Them with Python)

Building NewHomie property analytics tool — Part 1

Stop Rewriting the Same LLM Boilerplate: Batch-Process DataFrames in 3 Lines

How to Add a Data Quality Gate to Your Airflow Pipeline in 5 Minutes

Processing High Frequency Solar Data Without HPC: Real Constraints and Design Decisions in MackSun

What Spark Interviews Actually Test (Based on 189 Real Interview Reports)

Why Semantic Layers Need Distributional Validation, Not Just Schema Validation

AWS Lake Formation: TBAC vs NBAC — The Permission Model Decision That Will Define Your Data Lake

DuckDB in the Wild: What 6 Minutes of Benchmarking Across 4 Machines Taught Me About Real-World Performance

ETL vs ELT: Understanding the Two Pillars of Modern Data Engineering

Financial Data Integration: A Practical Guide

Why Real-Time Data Integration Matters for Modern Applications