Skip to content

Forem

# dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Cover image for Amazon S3 Files: from Kafka to S3 via NFS

Alexander Smirnoff

Apr 13

Amazon S3 Files: from Kafka to S3 via NFS

#architecture #aws #dataengineering #tutorial

11 min read

Cover image for 50,000 Cells. One Network. How Do You Know Which One Is Quietly Breaking?

SESHA GONABOYINA

Mar 21

50,000 Cells. One Network. How Do You Know Which One Is Quietly Breaking?

#python #snowflake #dataengineering #telecom

5 min read

Cover image for Snowflake vs Redshift vs BigQuery: Which One Should You Use?

Mar 21

Snowflake vs Redshift vs BigQuery: Which One Should You Use?

#sql #beginners #snowflake #dataengineering

4 min read

Cover image for Getting Data from Different Sources in Power BI

Abdulganeey Abdulazeez

Apr 3

Getting Data from Different Sources in Power BI

#analytics #dataengineering #microsoft #tutorial

13 min read

Cover image for 5 Data Engineering Techniques That Increased Our LLM Efficiency by 70%

Mar 20

5 Data Engineering Techniques That Increased Our LLM Efficiency by 70%

#dataengineering #machinelearning #llm #ai

1 min read

Cover image for A Day in the Life of a Data Engineer (Real Talk, No Filter)

Mar 24

A Day in the Life of a Data Engineer (Real Talk, No Filter)

#dataengineering #career #beginners #sql

5 min read

Cover image for Monitoring and Observability for Real-Time Streaming Pipelines

beefed.ai

Mar 24

Monitoring and Observability for Real-Time Streaming Pipelines

#dataengineering

10 min read

Cover image for AI Won't Stop Itself From Being Stupid - That's YOUR Job

Mar 20

AI Won't Stop Itself From Being Stupid - That's YOUR Job

#ai #devops #productivity #dataengineering

8 min read

Cover image for Apache Data Lakehouse Weekly: March 10–17, 2026

Mar 19

Apache Data Lakehouse Weekly: March 10–17, 2026

#news #data #dataengineering #opensource

8 min read

Cover image for Scaling multi-node GPU data pipelines using Dask on Kubernetes

beefed.ai

Mar 19

Scaling multi-node GPU data pipelines using Dask on Kubernetes

#dataengineering #gpu

10 min read

Cover image for AI Citation Registries and Structured Record Requirements for AI Interpretation

David Rau

Mar 22

AI Citation Registries and Structured Record Requirements for AI Interpretation

#ai #machinelearning #dataengineering #govtech

3 min read

Apr 1

Soda Moved to ELv2. Provero Is Apache 2.0.

#python #opensource #dataengineering #devops

3 min read

Cover image for Credit data is messier than equity data, always

Mar 18

Credit data is messier than equity data, always

#fintech #dataengineering #graphdatabases #python

7 min read

Vijay Ashley Rodrigues

Mar 18

Building with Snowflake Cortex Analyst — What I Learned About Semantic Layers and Guardrails

#dataengineering #snowflake #architecture #mcp

2 min read

Mar 18

🚀 Apache Spark Just Killed the Microbatch Barrier (And Why Flink Should Be Worried)

#dataengineering #apachespark #bigdata #cloudcomputing

3 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.