Skip to content

Forem

# dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Cover image for Day 26: Spark Streaming Joins

Sandeep

Dec 26 '25

Day 26: Spark Streaming Joins

#dataengineering #spark #bigdata #python

1 min read

Aki for AWS Community Builders

Jan 17

Exploring the Potential of AWS Glue Python Shell as a Long-Running Batch Execution Environment

#aws #dataengineering

7 min read

Cover image for DataOps 101: What It Is and Why Enterprises Can’t Ignore It in 2026

Rushikesh Langale

Dec 26 '25

DataOps 101: What It Is and Why Enterprises Can’t Ignore It in 2026

#beginners #dataengineering #devops

2 min read

Cover image for Day 25: Streaming Aggregations in Spark

Sandeep

Dec 25 '25

Day 25: Streaming Aggregations in Spark

#dataengineering #spark #bigdata #python

1 min read

Cover image for What Is Data Fabric Architecture? A Beginner’s Guide (Explained Simply)

Rushikesh Langale

Dec 26 '25

What Is Data Fabric Architecture? A Beginner’s Guide (Explained Simply)

#data #architecture #beginners #dataengineering

2 min read

Jan 30

Building Scalable Data Pipelines with Airflow, Docker, and Python: A SightSearch Case Study

#automation #dataengineering #docker #python

3 min read

Alexander Alten

Dec 29 '25

Data Processing Does Not Belong in the Message Broker

#kafka #dataengineering #data

3 min read

Dec 30 '25

Can you describe a complex data architecture you’ve designed or implemented in the past?

#discuss #data #dataengineering

1 min read

Apache SeaTunnel

Jan 9

Apache SeaTunnel Community Year-End Review 2025

#news #community #dataengineering #opensource

7 min read

Cover image for SellerSprite Alternative: Building a Cost-Effective Amazon Data Pipeline with Pangolinfo API

Mox Loop

Jan 29

SellerSprite Alternative: Building a Cost-Effective Amazon Data Pipeline with Pangolinfo API

#dataengineering #ecommerce #python #postgressql

6 min read

Cover image for Day 24: Spark Structured Streaming

Sandeep

Dec 24 '25

Day 24: Spark Structured Streaming

#dataengineering #spark #bigdata #python

1 min read

Vinicius Fagundes

Jan 28

Tools of the Trade: What Powers Modern Data Engineering

#datascience #career #dataengineering #python

5 min read

Ng'ang'a Njongo

Jan 17

Basics of Git and GitHub

#git #github #dataengineering #datascience

4 min read

Cover image for Day 23: Spark Shuffle Optimization

Sandeep

Dec 23 '25

Day 23: Spark Shuffle Optimization

#dataengineering #spark #bigdata #python

1 min read

Drishti Jain for AWS Community Builders

Jan 27

RAG Is a Data Engineering Problem Disguised as AI

#rag #ai #aws #dataengineering

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.