Dataengineering Page 14

Cover image for Building an Automated YouTube Analytics Dashboard with Airflow, PySpark, MinIO, PostgreSQL & Grafana

Oliver Samuel

Oct 7

Building an Automated YouTube Analytics Dashboard with Airflow, PySpark, MinIO, PostgreSQL & Grafana

#dataengineering #analytics #architecture #python

7

5 min read

Cover image for Composable Analytics with Agents: Leveraging Virtual Datasets and the Semantic Layer

Alex Merced

Sep 17

Composable Analytics with Agents: Leveraging Virtual Datasets and the Semantic Layer

#dataengineering #analytics #architecture #ai

1

3 min read

Vinicius Fagundes

Oct 6

When to Choose Scala Over Python for Apache Spark: A Performance-Driven Analysis

#datascience #dataengineering #ai

1

4 min read

Sunkanmi Otitolaye

Oct 6

⚽ The Data XI: Building a Modern Football Data Platform — Chapter 1: Taming the Data Beast

#dataengineering #webscraping #python #webdev

2

1

3 min read

Rethan Kumar cv

Oct 7

📊 Understanding 6 Common Data Formats in Data Analytics

#dataengineering #analytics #datascience #database

4 min read

Cover image for Self-Adapting Data Pipelines: The Intelligent Future of Data Engineering

Aarav Rana

Oct 6

Self-Adapting Data Pipelines: The Intelligent Future of Data Engineering

#ai #architecture #dataengineering

5

17 min read

Cover image for Introduction to Apache Kafka for Beginners

John Kioko

Oct 6

Introduction to Apache Kafka for Beginners

#kafka #dataengineering #tutorial #beginners

1

5 min read

Kemboijebby

Sep 25

Apache Kafka — Deep Dive: Core Concepts, Data-Engineering Applications, and Real-World Production Practices

#dataengineering #programming #ai

1

4 min read

Alex Merced

Sep 2

Apache Iceberg Dev List Digest August 25-29

#database #datascience #dataengineering

5 min read

Pradip Panjiyar

Oct 3

How I Built a MongoDB Archiving System for Crawled Data

#dataengineering #database #architecture #mongodb

1

2

7 min read

Cover image for Complete Guide: Dockerizing Spark, Kafka, and Jupyter for YouTube Pipeline

Lagat Josiah

Oct 4

Complete Guide: Dockerizing Spark, Kafka, and Jupyter for YouTube Pipeline

#dataengineering #architecture #docker #tutorial

9 min read

Cover image for Dockerized Spark and Kafka: YouTube Data Pipeline Implementation

Lagat Josiah

Oct 4

Dockerized Spark and Kafka: YouTube Data Pipeline Implementation

#dataengineering #architecture #docker #tutorial

7 min read

Cover image for RIP Amazon Data Firehose Change Data Capture

Paul SANTUS for AWS Community Builders

Oct 2

RIP Amazon Data Firehose Change Data Capture

#dataengineering #aws #cloud #firehose

7

3

4 min read

Nidhi Thakore

Sep 5

Event-Driven Architectures on AWS: Beyond Lambda

#blog #aws #dataengineering #lambda

4

2 min read

Cover image for 🔄 ETL vs ELT: What’s the Difference and Why It Matters?

Shagun Khandelwal

Aug 31

🔄 ETL vs ELT: What’s the Difference and Why It Matters?

#dataengineering #python #sql #datawarehouse

2 min read

Cover image for YouTube Data Processing Pipeline

Lagat Josiah

Oct 3

YouTube Data Processing Pipeline

#postgres #python #dataengineering #architecture

1

4 min read

Cover image for CDC in AWS: Content Data Capture from AWS RDS MySQL into AWS MSK Kafka topic using Debezium

Roman Tsypuk for AWS Community Builders

Sep 22

CDC in AWS: Content Data Capture from AWS RDS MySQL into AWS MSK Kafka topic using Debezium

#dataengineering #mysql #aws #kafka

1

5 min read

Cover image for LLPY-03: Extracción y Procesamiento Inteligente de Datos Legales

Jesus Oviedo Riquelme

Oct 2

LLPY-03: Extracción y Procesamiento Inteligente de Datos Legales

#dataengineering #spanish #rag #llm

21 min read

Parth Maniar

Aug 29

🏗️ The Role of a Data Engineer: Beyond Pipelines

#datascience #dataengineering #bigdata #career

2 min read

Cover image for Beyond Flat Tables: Model Hierarchical Data in Supabase with Recursive Queries

Roel Peters

Oct 1

Beyond Flat Tables: Model Hierarchical Data in Supabase with Recursive Queries

#postgres #database #fullstack #dataengineering

2

7 min read

Cover image for 🌍 The Journey of Data: From Raw Logs to Insights

Shagun Khandelwal

Aug 28

🌍 The Journey of Data: From Raw Logs to Insights

#dataengineering #bigdata #etl #python

2 min read

Vinicius Fagundes

Sep 30

🎯 The Challenge: Processing TBs of S3 Data Without Breaking the Bank

#data #dataengineering #ai

5 min read

Minwook Je

Sep 19

Why Apache Iceberg is needed?

#dataengineering #ai #programming #robotics

1

6 min read

Cover image for Do Caos à Orquestração: Como o DataOps Está Transformando Dados em Valor

Guilherme de Almeida Gasque

Aug 27

Do Caos à Orquestração: Como o DataOps Está Transformando Dados em Valor

#data #podcast #devops #dataengineering

1 min read

Cover image for International SaaS Nightmare: Timezone Edge Cases (And How to Solve Them Once and For All)

Tom Stone

Aug 28

International SaaS Nightmare: Timezone Edge Cases (And How to Solve Them Once and For All)

#api #saas #timezone #dataengineering

2 min read

Forem

# dataengineering

Building an Automated YouTube Analytics Dashboard with Airflow, PySpark, MinIO, PostgreSQL & Grafana

Composable Analytics with Agents: Leveraging Virtual Datasets and the Semantic Layer

When to Choose Scala Over Python for Apache Spark: A Performance-Driven Analysis

⚽ The Data XI: Building a Modern Football Data Platform — Chapter 1: Taming the Data Beast

📊 Understanding 6 Common Data Formats in Data Analytics

Self-Adapting Data Pipelines: The Intelligent Future of Data Engineering

Introduction to Apache Kafka for Beginners

Apache Kafka — Deep Dive: Core Concepts, Data-Engineering Applications, and Real-World Production Practices

Apache Iceberg Dev List Digest August 25-29

How I Built a MongoDB Archiving System for Crawled Data

Complete Guide: Dockerizing Spark, Kafka, and Jupyter for YouTube Pipeline

Dockerized Spark and Kafka: YouTube Data Pipeline Implementation

RIP Amazon Data Firehose Change Data Capture

Event-Driven Architectures on AWS: Beyond Lambda

🔄 ETL vs ELT: What’s the Difference and Why It Matters?

YouTube Data Processing Pipeline

CDC in AWS: Content Data Capture from AWS RDS MySQL into AWS MSK Kafka topic using Debezium

LLPY-03: Extracción y Procesamiento Inteligente de Datos Legales

🏗️ The Role of a Data Engineer: Beyond Pipelines

Beyond Flat Tables: Model Hierarchical Data in Supabase with Recursive Queries

🌍 The Journey of Data: From Raw Logs to Insights

🎯 The Challenge: Processing TBs of S3 Data Without Breaking the Bank

Why Apache Iceberg is needed?

Do Caos à Orquestração: Como o DataOps Está Transformando Dados em Valor

International SaaS Nightmare: Timezone Edge Cases (And How to Solve Them Once and For All)