Forem

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Big Data Fundamentals: real-time analytics project

Big Data Fundamentals: real-time analytics project

Comments
6 min read
Data Mesh: The Decentralized Revolution That Will Transform Your Data Architecture
Cover image for Data Mesh: The Decentralized Revolution That Will Transform Your Data Architecture

Data Mesh: The Decentralized Revolution That Will Transform Your Data Architecture

Comments
4 min read
The Case for Apache Airflow and Kafka in Data Engineering
Cover image for The Case for Apache Airflow and Kafka in Data Engineering

The Case for Apache Airflow and Kafka in Data Engineering

1
Comments
2 min read
🛠️ SiliconPrimeX – Healing AWS Glue Jobs Autonomously with Gemini & Lambda 🚑✨

🛠️ SiliconPrimeX – Healing AWS Glue Jobs Autonomously with Gemini & Lambda 🚑✨

Comments
2 min read
What is the Modern Data Stack?

What is the Modern Data Stack?

Comments
3 min read
Real-Time Fraud Detection Using Kafka and Machine Learning
Cover image for Real-Time Fraud Detection Using Kafka and Machine Learning

Real-Time Fraud Detection Using Kafka and Machine Learning

Comments
5 min read
🔄 ETL vs ELT: The Backbone of Data Engineering

🔄 ETL vs ELT: The Backbone of Data Engineering

1
Comments
1 min read
🕒 Cumulative Data Without the Pain: PostgreSQL Rollups with Time Buckets
Cover image for 🕒 Cumulative Data Without the Pain: PostgreSQL Rollups with Time Buckets

🕒 Cumulative Data Without the Pain: PostgreSQL Rollups with Time Buckets

Comments
3 min read
Check Out 3 Awesome Open Source Tabular Data Wrangling Apps

Check Out 3 Awesome Open Source Tabular Data Wrangling Apps

1
Comments
3 min read
15 Core Concepts of Data Engineering

15 Core Concepts of Data Engineering

Comments
9 min read
Building a Food Price & Inflation Analysis Pipeline in Kenya (2006–2024)
Cover image for Building a Food Price & Inflation Analysis Pipeline in Kenya (2006–2024)

Building a Food Price & Inflation Analysis Pipeline in Kenya (2006–2024)

Comments
3 min read
Understanding Data Warehousing for Retail Analytics: A Comprehensive Guide
Cover image for Understanding Data Warehousing for Retail Analytics: A Comprehensive Guide

Understanding Data Warehousing for Retail Analytics: A Comprehensive Guide

1
Comments
3 min read
Building a Modern Data Warehouse in SQL Server with Medallion Architecture
Cover image for Building a Modern Data Warehouse in SQL Server with Medallion Architecture

Building a Modern Data Warehouse in SQL Server with Medallion Architecture

Comments
11 min read
Benefits of OLAP and OLTP in Data Management.
Cover image for Benefits of OLAP and OLTP in Data Management.

Benefits of OLAP and OLTP in Data Management.

Comments
2 min read
Building High-Load API Services in Go: From Design to Production
Cover image for Building High-Load API Services in Go: From Design to Production

Building High-Load API Services in Go: From Design to Production

2
Comments
23 min read
Why We Built Confidence Scoring Into Our Date Parser (And Why Every API Should)
Cover image for Why We Built Confidence Scoring Into Our Date Parser (And Why Every API Should)

Why We Built Confidence Scoring Into Our Date Parser (And Why Every API Should)

Comments 1
3 min read
Understanding PRAGMA SERIALLY_REUSABLE in Oracle PL/SQL: A Complete Guide

Understanding PRAGMA SERIALLY_REUSABLE in Oracle PL/SQL: A Complete Guide

5
Comments
3 min read
⏰ If You Haven’t Shifted to Data Engineering Yet… Wake Up!
Cover image for ⏰ If You Haven’t Shifted to Data Engineering Yet… Wake Up!

⏰ If You Haven’t Shifted to Data Engineering Yet… Wake Up!

Comments
2 min read
Data Modeling: From Basics to Advanced Techniques for Business Impact
Cover image for Data Modeling: From Basics to Advanced Techniques for Business Impact

Data Modeling: From Basics to Advanced Techniques for Business Impact

2
Comments
13 min read
Kubernetes in Depth - Storage, Security, and Advanced Features
Cover image for Kubernetes in Depth - Storage, Security, and Advanced Features

Kubernetes in Depth - Storage, Security, and Advanced Features

1
Comments
6 min read
Building a Resilient Exception Strategy with Apache Beam and DLQ

Building a Resilient Exception Strategy with Apache Beam and DLQ

Comments
3 min read
Well-formed, Valid, Canonical, and Correct

Well-formed, Valid, Canonical, and Correct

1
Comments
4 min read
Why we use Apache Airflow for Data Engineering

Why we use Apache Airflow for Data Engineering

Comments
2 min read
Building ML Infrastructure in TypeScript - Part 1: The Vision

Building ML Infrastructure in TypeScript - Part 1: The Vision

5
Comments
3 min read
Lightweight ETL with AWS Lambda, DuckDB, and delta-rs

Lightweight ETL with AWS Lambda, DuckDB, and delta-rs

4
Comments
5 min read
loading...