Skip to content

Forem

# dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Cover image for Databricks Platform: Unlocking Big Data Analytics and Machine Learning at Scale

Anil Kumar Moka

Mar 12 '25

Databricks Platform: Unlocking Big Data Analytics and Machine Learning at Scale

#databricks #machinelearning #datascience #dataengineering

4 min read

Cover image for InsightFlow Part 1: Building an Integrated Retail & Economic Data Pipeline - Project Introduction

Pizofreude

Apr 9 '25

InsightFlow Part 1: Building an Integrated Retail & Economic Data Pipeline - Project Introduction

#dezoomcamp #dataengineering #sideprojects #devjournal

4 min read

Eric Katumo for LuxDevHQ

Apr 7 '25

Building an Automated Weather Data Pipeline with Apache Kafka and Cassandra

#dataengineering #data #apachekafka

10 min read

Apr 6 '25

Understanding Data Pipelines: The Backbone of Modern Data Systems

#dataengineering #etl #python #gcp

3 min read

Cover image for 🚀 Building an ETL Pipeline with Python to Scrape Internship Jobs and Load into Excel

Apr 6 '25

🚀 Building an ETL Pipeline with Python to Scrape Internship Jobs and Load into Excel

#dataengineering #python #programming

4 min read

Cover image for Stock Data Extraction Using Apache Kafka

Milcah03

Apr 6 '25

Stock Data Extraction Using Apache Kafka

#apachekafka #python #cassandra #dataengineering

4 min read

kination

Apr 6 '25

Time of YAML/JSON for data engineer

#dataengineering #programming #config

2 min read

Cover image for Building Automated Data Reports from Supabase with GitHub Actions and R Markdown

Akan

Apr 5 '25

Building Automated Data Reports from Supabase with GitHub Actions and R Markdown

#automation #analytics #dataengineering #tutorial

12 min read

Cover image for "Our GPUs Are Melting": Building a Real-Time Streaming System with Go and Redpanda Ghibli Style

SNEHASISH DUTTA

Apr 2 '25

"Our GPUs Are Melting": Building a Real-Time Streaming System with Go and Redpanda Ghibli Style

#go #kafka #eventdriven #dataengineering

10 min read

Cover image for How to Optimize SQL Queries for Speed and Efficiency

BiKodes

Mar 31 '25

How to Optimize SQL Queries for Speed and Efficiency

#sql #sqlserver #database #dataengineering

5 min read

Eric Katumo for LuxDevHQ

Mar 31 '25

Building an Automated Bitcoin Price ETL Pipeline with Airflow and PostgreSQL

#dataengineering #data #apacheairflow

3 min read

Mar 30 '25

Apache Airflow for Data Engineering: Best Practices and Real-World Examples

#dataengineering #data #apacheairflow

7 min read

Cover image for Stop flattening your JSON just to export it to Excel

Alexandre Manuel

Mar 27 '25

Stop flattening your JSON just to export it to Excel

#python #excel #programming #dataengineering

2 min read

Cover image for Azure Data Factory

Mar 27 '25

Azure Data Factory

#azure #dataengineering #beginners #basic

1 min read

Cover image for SQLite Database GUI Tool | Design and Visualize with DbSchema

Roxana-Maria Haidiner

Mar 26 '25

SQLite Database GUI Tool | Design and Visualize with DbSchema

#database #sql #dataengineering #development

4 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.