Skip to content

Forem

# dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Pradip Panjiyar

Oct 3 '25

How I Built a MongoDB Archiving System for Crawled Data

#dataengineering #database #architecture #mongodb

7 min read

Cover image for Complete Guide: Dockerizing Spark, Kafka, and Jupyter for YouTube Pipeline

Oct 4 '25

Complete Guide: Dockerizing Spark, Kafka, and Jupyter for YouTube Pipeline

#dataengineering #architecture #docker #tutorial

9 min read

Cover image for Dockerized Spark and Kafka: YouTube Data Pipeline Implementation

Oct 4 '25

Dockerized Spark and Kafka: YouTube Data Pipeline Implementation

#dataengineering #architecture #docker #tutorial

7 min read

Cover image for RIP Amazon Data Firehose Change Data Capture

Paul SANTUS for AWS Community Builders

Oct 2 '25

RIP Amazon Data Firehose Change Data Capture

#dataengineering #aws #cloud #firehose

4 min read

Sep 5 '25

Event-Driven Architectures on AWS: Beyond Lambda

#blog #aws #dataengineering #lambda

2 min read

Cover image for YouTube Data Processing Pipeline

Oct 3 '25

YouTube Data Processing Pipeline

#postgres #python #dataengineering #architecture

4 min read

Cover image for 🔄 ETL vs ELT: What’s the Difference and Why It Matters?

Shagun Khandelwal

Aug 31 '25

🔄 ETL vs ELT: What’s the Difference and Why It Matters?

#dataengineering #python #sql #datawarehouse

2 min read

Cover image for CDC in AWS: Content Data Capture from AWS RDS MySQL into AWS MSK Kafka topic using Debezium

Roman Tsypuk for AWS Community Builders

Sep 22 '25

CDC in AWS: Content Data Capture from AWS RDS MySQL into AWS MSK Kafka topic using Debezium

#dataengineering #mysql #aws #kafka

5 min read

Cover image for LLPY-03: Extracción y Procesamiento Inteligente de Datos Legales

Jesus Oviedo Riquelme

Oct 2 '25

LLPY-03: Extracción y Procesamiento Inteligente de Datos Legales

#dataengineering #spanish #rag #llm

21 min read

Cover image for Create a Microsoft Fabric Lakehouse

lotanna obianefo

Oct 2 '25

Create a Microsoft Fabric Lakehouse

#database #dataengineering #cloudcomputing #datascience

6 min read

Aug 29 '25

🏗️ The Role of a Data Engineer: Beyond Pipelines

#datascience #dataengineering #bigdata #career

2 min read

Cover image for Beyond Flat Tables: Model Hierarchical Data in Supabase with Recursive Queries

Oct 1 '25

Beyond Flat Tables: Model Hierarchical Data in Supabase with Recursive Queries

#postgres #database #fullstack #dataengineering

7 min read

Sagara

Oct 1 '25

Personal Picks: Data Product News (October 1, 2025)

#dataengineering #snowflake #databricks

7 min read

Cover image for From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks

Oct 1 '25

From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks

#dataengineering #automation #tutorial #sql

10 min read

Sep 30 '25

Git Integration in Microsoft Fabric

#dataengineering #fabric #microsoft

3 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.