Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
Forem
Close
#
dataengineering
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Data Processing Does Not Belong in the Message Broker
Alexander Alten
Alexander Alten
Alexander Alten
Follow
Dec 29 '25
Data Processing Does Not Belong in the Message Broker
#
kafka
#
dataengineering
#
data
Comments
Add Comment
3 min read
Can you describe a complex data architecture you’ve designed or implemented in the past?
Shruti Nakum
Shruti Nakum
Shruti Nakum
Follow
Dec 30 '25
Can you describe a complex data architecture you’ve designed or implemented in the past?
#
discuss
#
data
#
dataengineering
Comments
Add Comment
1 min read
Apache SeaTunnel Community Year-End Review 2025
Apache SeaTunnel
Apache SeaTunnel
Apache SeaTunnel
Follow
Jan 9
Apache SeaTunnel Community Year-End Review 2025
#
news
#
community
#
dataengineering
#
opensource
1
 reaction
Comments
Add Comment
7 min read
Day 24: Spark Structured Streaming
Sandeep
Sandeep
Sandeep
Follow
Dec 24 '25
Day 24: Spark Structured Streaming
#
dataengineering
#
spark
#
bigdata
#
python
Comments
Add Comment
1 min read
Tools of the Trade: What Powers Modern Data Engineering
Vinicius Fagundes
Vinicius Fagundes
Vinicius Fagundes
Follow
Jan 28
Tools of the Trade: What Powers Modern Data Engineering
#
datascience
#
career
#
dataengineering
#
python
4
 reactions
Comments
1
 comment
5 min read
Basics of Git and GitHub
Ng'ang'a Njongo
Ng'ang'a Njongo
Ng'ang'a Njongo
Follow
Jan 17
Basics of Git and GitHub
#
git
#
github
#
dataengineering
#
datascience
2
 reactions
Comments
Add Comment
4 min read
Day 23: Spark Shuffle Optimization
Sandeep
Sandeep
Sandeep
Follow
Dec 23 '25
Day 23: Spark Shuffle Optimization
#
dataengineering
#
spark
#
bigdata
#
python
Comments
Add Comment
1 min read
RAG Is a Data Engineering Problem Disguised as AI
Drishti Jain
Drishti Jain
Drishti Jain
Follow
for
AWS Community Builders
Jan 27
RAG Is a Data Engineering Problem Disguised as AI
#
rag
#
ai
#
aws
#
dataengineering
Comments
1
 comment
5 min read
4th Winter Data & AI Meetup
Lyudmyla Makarenko
Lyudmyla Makarenko
Lyudmyla Makarenko
Follow
Jan 26
4th Winter Data & AI Meetup
#
ai
#
community
#
data
#
dataengineering
1
 reaction
Comments
Add Comment
1 min read
Learning SQL Server the Hard Way: 16 Days of Real-World Database Work
Luis Faria
Luis Faria
Luis Faria
Follow
Jan 26
Learning SQL Server the Hard Way: 16 Days of Real-World Database Work
#
sql
#
sqlserver
#
database
#
dataengineering
2
 reactions
Comments
2
 comments
8 min read
Day 22: Spark Shuffle Deep Dive
Sandeep
Sandeep
Sandeep
Follow
Dec 22 '25
Day 22: Spark Shuffle Deep Dive
#
dataengineering
#
spark
#
bigdata
#
python
Comments
Add Comment
1 min read
Day 20: Handling Bad Records & Data Quality in Spark
Sandeep
Sandeep
Sandeep
Follow
Dec 22 '25
Day 20: Handling Bad Records & Data Quality in Spark
#
dataengineering
#
spark
#
bigdata
#
python
Comments
Add Comment
1 min read
Data-Architect-Master-Professional-Workbook
Usman Zafar
Usman Zafar
Usman Zafar
Follow
Dec 22 '25
Data-Architect-Master-Professional-Workbook
#
python
#
dataengineering
#
opensource
#
architecture
Comments
Add Comment
1 min read
Day 18: Spark Performance Tuning
Sandeep
Sandeep
Sandeep
Follow
Dec 22 '25
Day 18: Spark Performance Tuning
#
dataengineering
#
spark
#
bigdata
#
python
Comments
Add Comment
1 min read
Day 19: Spark Broadcasting & Caching
Sandeep
Sandeep
Sandeep
Follow
Dec 22 '25
Day 19: Spark Broadcasting & Caching
#
dataengineering
#
spark
#
bigdata
#
python
Comments
Add Comment
1 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a blogging-forward open source social network where we learn from one another
Log in
Create account