Forem

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
A 2026 Introduction to Apache Iceberg
Cover image for A 2026 Introduction to Apache Iceberg
alexmercedcoder profile

A 2026 Introduction to Apache Iceberg

#beginners #dataengineering #opensource #tutorial
Comments
6 min read
Designing a Layered YouTube Analytics Pipeline with AWS Bedrock (Architecture Overview)
Cover image for Designing a Layered YouTube Analytics Pipeline with AWS Bedrock (Architecture Overview)
geets_a1be902588b38e52740 profile

Designing a Layered YouTube Analytics Pipeline with AWS Bedrock (Architecture Overview)

#aws #llm #architecture #dataengineering
Comments
2 min read
Data Is Not a Department — It’s a Decision Architecture
Cover image for Data Is Not a Department — It’s a Decision Architecture
fadydesokysaeedabdelaziz profile

Data Is Not a Department — It’s a Decision Architecture

#dataengineering #systemthinking #enterprisearchitecture #processoptimization
4
Comments
2 min read
Ditch 10,000 Intermediate Tables—Compute Outside the Database with Open-Source SPL
esproc_spl profile
Judy

Ditch 10,000 Intermediate Tables—Compute Outside the Database with Open-Source SPL

#architecture #database #dataengineering #opensource
5
Comments
8 min read
How Analysts Translate Messy Data, DAX, and Dashboards into Action Using Power BI
nganga_njongo profile

How Analysts Translate Messy Data, DAX, and Dashboards into Action Using Power BI

#analytics #microsoft #datascience #dataengineering
1
Comments
4 min read
Why NL2SQL Breaks in Production (And How Data Correlation Fixes It)
hello_arisyn_0dc948aa82b3 profile

Why NL2SQL Breaks in Production (And How Data Correlation Fixes It)

#nl2sql #datacorrelation #largelanguagemodels #dataengineering
Comments
2 min read
Hardcoded Selectors vs. AI Prompts: A Resilience Benchmark on Etsy
Cover image for Hardcoded Selectors vs. AI Prompts: A Resilience Benchmark on Etsy
sommic profile

Hardcoded Selectors vs. AI Prompts: A Resilience Benchmark on Etsy

#webscraping #python #dataengineering #devops
Comments 1
5 min read
Chatting with 3 Billion Base Pairs: Building a RAG Index for Your Personal Genome (WGS)
beck_moulton profile

Chatting with 3 Billion Base Pairs: Building a RAG Index for Your Personal Genome (WGS)

#dataengineering #ai #rag #python
Comments
4 min read
Apache Data Lakehouse Weekly: February 4-11, 2026
Cover image for Apache Data Lakehouse Weekly: February 4-11, 2026
alexmercedcoder profile

Apache Data Lakehouse Weekly: February 4-11, 2026

#news #data #dataengineering #opensource
Comments
6 min read
Code is the execution. Thinking is the strategy.
Cover image for Code is the execution. Thinking is the strategy.
fscosta1 profile

Code is the execution. Thinking is the strategy.

#sql #dataengineering #mysql #developer
1
Comments
1 min read
Your ML Model Is Training on the Future
Cover image for Your ML Model Is Training on the Future
gauthierpiarrette profile

Your ML Model Is Training on the Future

#machinelearning #dataengineering #datascience #sql
Comments
7 min read
Data Engineer Career Progression: A Practical Roadmap (SQL Modern Analytics Engineering)
Cover image for Data Engineer Career Progression: A Practical Roadmap (SQL Modern Analytics Engineering)
borisgigovic profile

Data Engineer Career Progression: A Practical Roadmap (SQL Modern Analytics Engineering)

#dataengineering #sql #cloud #analytics
Comments
5 min read
Why NL2SQL Fails Without Relationship Graphs And How Arisyn Makes NL2SQL Actually Work
hello_arisyn_0dc948aa82b3 profile

Why NL2SQL Fails Without Relationship Graphs And How Arisyn Makes NL2SQL Actually Work

#ai #dataengineering #database #nlp
Comments
3 min read
Building a 'Living' Market Intelligence Dashboard with Python and Streamlit
Cover image for Building a 'Living' Market Intelligence Dashboard with Python and Streamlit
withatte profile

Building a 'Living' Market Intelligence Dashboard with Python and Streamlit

#webscraping #python #devops #dataengineering
1
Comments 2
5 min read
How I Redesigned a Failing Data Pipeline to Eliminate Cascading Failures
itsmarwaahmed_ profile

How I Redesigned a Failing Data Pipeline to Eliminate Cascading Failures

#aws #eventdriven #dataengineering #terraform
Comments
9 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.