Skip to content

Forem

# dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Jan 12

Context Engineering (Part 1): The Architecture of Recall

#dataengineering #rags #informationretrieval #vectorsearch

3 min read

Cover image for Day 9: Spark SQL Deep Dive - Temp Views, Query Execution & Optimization Tips for Data Engineers

Sandeep

Dec 9 '25

Day 9: Spark SQL Deep Dive - Temp Views, Query Execution & Optimization Tips for Data Engineers

#python #dataengineering #spark #bigdata

2 min read

Cover image for AWSChallenge - Week 2

Andres

Dec 5 '25

AWSChallenge - Week 2

#ai #dataengineering #aws #programming

4 min read

Cover image for Day 10: Partitioning vs Bucketing - The Spark Optimization Guide Every Data Engineer Needs

Sandeep

Dec 9 '25

Day 10: Partitioning vs Bucketing - The Spark Optimization Guide Every Data Engineer Needs

#python #dataengineering #spark #bigdata

2 min read

Steven Hur

Dec 4 '25

Deepening My Roots in the Data Ecosystem - Choosing Depth Over Breadth

#career #dataengineering #devjournal

2 min read

Cover image for Automate Python Manual Extraction: Build End-to-End PDF -> LLM -> SQL Flows with CocoIndex, Ollama, and Postgres

Dec 4 '25

Automate Python Manual Extraction: Build End-to-End PDF -> LLM -> SQL Flows with CocoIndex, Ollama, and Postgres

#python #llm #dataengineering #etl

3 min read

Cover image for The Boring Debug Checklist That Fixes Most “RAG Failures”

Dec 5 '25

The Boring Debug Checklist That Fixes Most “RAG Failures”

#rag #dataengineering #llm #architecture

2 min read

Aki for AWS Community Builders

Jan 8

AWS Lambda and AWS Glue Python Shell in the Context of Lightweight ETL

#aws #dataengineering #etl

7 min read

Cover image for SQL: Doing GROUP BY in CsvPath

Dec 4 '25

SQL: Doing GROUP BY in CsvPath

#sql #dataengineering #csv #csvpath

5 min read

Cover image for 🔥 Day 3: RDDs - The Foundation of Spark

Sandeep

Dec 3 '25

🔥 Day 3: RDDs - The Foundation of Spark

#distributedsystems #interview #dataengineering #tutorial

2 min read

Cover image for 🔥 Day 4: RDD Internals - Partitions, Shuffles & Repartitioning Demystified

Sandeep

Dec 4 '25

🔥 Day 4: RDD Internals - Partitions, Shuffles & Repartitioning Demystified

#spark #dataengineering #bigdata #python

2 min read

Cover image for The Developer's Guide to Normalizing Historical Airline Flight Data for Machine Learning

Dec 4 '25

The Developer's Guide to Normalizing Historical Airline Flight Data for Machine Learning

#dataengineering #datascience #machinelearning

6 min read

Dec 2 '25

Overview of Real-Time Data Synchronization from MySQL to VeloDB

#database #aws #dataengineering #mysql

5 min read

The AI/Data Engineer

Dec 4 '25

Stop Writing df.describe(): Automate EDA with D-Tale (The Lazy Engineer's Way)

#python #dataengineering #productivity #beginners

3 min read

wanjiang

Jan 6

Build a Local Lead Gen Machine: Scraping Google Maps with n8n (Reliably)

#n8n #automation #api #dataengineering

3 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.