Forem

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Day 12: UDF vs Pandas UDF
Cover image for Day 12: UDF vs Pandas UDF
sandeepk27 profile

Day 12: UDF vs Pandas UDF

#python #dataengineering #spark #bigdata
Comments
2 min read
Building a Near Real-Time Analytics Pipeline with AWS Zero-ETL
kienly profile

Building a Near Real-Time Analytics Pipeline with AWS Zero-ETL

#analytics #aws #database #dataengineering
Comments
4 min read
The Data Engineers Descent Into Datetime Hell
taylor_coleman_4efe265a3d profile

The Data Engineers Descent Into Datetime Hell

#data #datascience #dataengineering #python
1
Comments
5 min read
Day 11: Choosing the Right File Format in Spark
Cover image for Day 11: Choosing the Right File Format in Spark
sandeepk27 profile

Day 11: Choosing the Right File Format in Spark

#python #dataengineering #spark #bigdata
Comments
2 min read
Navigating the Future: Key Data Engineering Trends for 2024 and Beyond
dataformathub profile

Navigating the Future: Key Data Engineering Trends for 2024 and Beyond

#news #dataengineering #etl #trends
Comments
6 min read
How to Build Presto from Source - OSS Contribution Guide (Step by Step Tutorial)
Cover image for How to Build Presto from Source - OSS Contribution Guide (Step by Step Tutorial)
saurabhmahawar profile

How to Build Presto from Source - OSS Contribution Guide (Step by Step Tutorial)

#opensource #presto #dataengineering #dataanalytics
Comments
7 min read
Day 7: Mastering Joins, Unions, and GroupBy in PySpark - The Core ETL Operations
Cover image for Day 7: Mastering Joins, Unions, and GroupBy in PySpark - The Core ETL Operations
sandeepk27 profile

Day 7: Mastering Joins, Unions, and GroupBy in PySpark - The Core ETL Operations

#dataengineering #python #spark #bigdata
Comments
2 min read
The evolution of the Modern Data Stack: From RDBMS to the LakeHouse
Cover image for The evolution of the Modern Data Stack: From RDBMS to the LakeHouse
ayokunle profile

The evolution of the Modern Data Stack: From RDBMS to the LakeHouse

#discuss #architecture #dataengineering #learning
6
Comments
11 min read
map
query_filter_591122b53770 profile

map

#database #dataengineering #sql
Comments
1 min read
A Lightweight, Plugin-Oriented ETL Engine for Data Synchronization Built on Akka.NET
oninebx profile

A Lightweight, Plugin-Oriented ETL Engine for Data Synchronization Built on Akka.NET

#architecture #csharp #dataengineering #etl
Comments
4 min read
Data Engineering Isn’t About Tools — It’s About Thinking Like This
browsejobs profile

Data Engineering Isn’t About Tools — It’s About Thinking Like This

#webdev #dataengineering #ai #javascript
1
Comments
2 min read
Proyecto Weather Service (Parte 1): Construyendo el Recolector de Datos con Python y GitHub Actions o Netlify
dalaez profile

Proyecto Weather Service (Parte 1): Construyendo el Recolector de Datos con Python y GitHub Actions o Netlify

#dataengineering #python #spanish #tutorial
2
Comments 1
10 min read
Why Frontend Teams Should Care About Data Modeling for Real-Time Dashboards
Cover image for Why Frontend Teams Should Care About Data Modeling for Real-Time Dashboards
mdflaher profile

Why Frontend Teams Should Care About Data Modeling for Real-Time Dashboards

#dataengineering #analytics
Comments
2 min read
Refactoring a Mature Airflow Project: A Practical Guide to Scaling from Solo Development to Team Collaboration
ajitkumar profile

Refactoring a Mature Airflow Project: A Practical Guide to Scaling from Solo Development to Team Collaboration

#airflow #python #datascience #dataengineering
Comments
4 min read
Apache Dev List Digest: Iceberg, Polaris, Arrow & Parquet (Nov 24-Dec 8, 2025)
Cover image for Apache Dev List Digest: Iceberg, Polaris, Arrow & Parquet (Nov 24-Dec 8, 2025)
alexmercedcoder profile

Apache Dev List Digest: Iceberg, Polaris, Arrow & Parquet (Nov 24-Dec 8, 2025)

#dataengineering #opensource #architecture #community
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.