Dataengineering Page 38

Cover image for Uncertain Number but Regular Column to Row Conversion — From SQL to SPL #7

Judith-Data-Processing-Hacks

Mar 5

Uncertain Number but Regular Column to Row Conversion — From SQL to SPL #7

#sql #dataengineering #opensource #esprocspl

7

1

2 min read

Cover image for Study Notes 5.1.1-2 Introduction to Batch Processing & spark

Pizofreude

Mar 4

Study Notes 5.1.1-2 Introduction to Batch Processing & spark

#dataengineering #dezoomcamp #batchprocessing #spark

1

6 min read

Cover image for Study Notes 5.4.1-3 Anatomy of a Spark Cluster GroupBy & Joins in Spark

Pizofreude

Mar 4

Study Notes 5.4.1-3 Anatomy of a Spark Cluster GroupBy & Joins in Spark

#dataengineering #dezoomcamp #sql #spark

11 min read

Cover image for Study Notes 5.6.3-4 Setting up a Dataproc Cluster & Connecting Spark to Big Query

Pizofreude

Mar 4

Study Notes 5.6.3-4 Setting up a Dataproc Cluster & Connecting Spark to Big Query

#dataengineering #dezoomcamp #spark #bigquery

8 min read

Cover image for Study Notes 5.6.1-2 Spark on cloud & local

Pizofreude

Mar 4

Study Notes 5.6.1-2 Spark on cloud & local

#dataengineering #dezoomcamp #spark #cloud

1

7 min read

Cover image for Study Notes 5.5.1-2 Operations on Spark RDDs & Spark RDD mapPartition

Pizofreude

Mar 4

Study Notes 5.5.1-2 Operations on Spark RDDs & Spark RDD mapPartition

#dataengineering #dezoomcamp #spark #rdd

9 min read

Cover image for Study Notes 5.3.1-2 First Look at Spark/PySpark & Spark Dataframes

Pizofreude

Mar 4

Study Notes 5.3.1-2 First Look at Spark/PySpark & Spark Dataframes

#dataengineering #dezoomcamp #pyspark #sparkdataframe

9 min read

Cover image for Study Notes 5.3.3-4 Data Processing & SQL with Spark

Pizofreude

Mar 4

Study Notes 5.3.3-4 Data Processing & SQL with Spark

#dataengineering #dezoomcamp #sql #spark

1

9 min read

carmen

Jan 25

Busco profesores AWS y python

#aws #dataengineering #teacher

1 min read

Cover image for How We Built OpenETL: A Simple, Scalable Data Migration Tool for Everyone 🚀

Rusab Naeem Khan

Jan 25

How We Built OpenETL: A Simple, Scalable Data Migration Tool for Everyone 🚀

#python #programming #beginners #dataengineering

3 min read

John Aitchison

Feb 27

Unified Data Analytics via a Semantic Layer

#analytics #dataengineering

3 min read

Cover image for An Introduction to Data Engineering in Google Cloud Platform

priya sharma

Jan 24

An Introduction to Data Engineering in Google Cloud Platform

#googlecloud #dataengineering #softwareengineering #computerscience

5 min read

Dinesh

Feb 26

Data Transformation

#dataengineering #sql #dbt #bigdata

1

1 min read

Cover image for Introdução à Engenharia de Dados

Cadu Magalhães

Feb 25

Introdução à Engenharia de Dados

#braziliandevs #dataengineering

10

6 min read

Cover image for Study Notes 4.4.1 | 4.4.2 : Deployment Using dbt Cloud and Locally

Pizofreude

Feb 25

Study Notes 4.4.1 | 4.4.2 : Deployment Using dbt Cloud and Locally

#dataengineering #dezoomcamp #dbtcore #dbtcloud

3 min read

Cover image for Study Notes 4.5.2: Visualizing Data with Metabase (Alternative B)

Pizofreude

Feb 25

Study Notes 4.5.2: Visualizing Data with Metabase (Alternative B)

#dataengineering #dezoomcamp #dbt #metabase

1

4 min read

Cover image for Study Notes 4.3.1 - Build the First dbt Models

Pizofreude

Feb 25

Study Notes 4.3.1 - Build the First dbt Models

#dataengineering #dezoomcamp #dbt #datamodeling

4 min read

Cover image for Study Notes 4.3.2 - Testing and Documenting the Project

Pizofreude

Feb 25

Study Notes 4.3.2 - Testing and Documenting the Project

#dataengineering #dezoomcamp #dbt #documentation

3 min read

Cover image for Study Notes 4.1.2: What is dbt?

Pizofreude

Feb 25

Study Notes 4.1.2: What is dbt?

#dataengineering #dezoomcamp #dbt #analyticsengineering

3 min read

Cover image for Study Notes 4.2.1 | 4.2.2: DBT Project Setup

Pizofreude

Feb 25

Study Notes 4.2.1 | 4.2.2: DBT Project Setup

#dataengineering #dezoomcamp #dbt #analyticsengineering

2 min read

Cover image for Study Notes 4.1.1 - Analytics Engineering Basics

Pizofreude

Feb 25

Study Notes 4.1.1 - Analytics Engineering Basics

#dataengineering #dezoomcamp #dbt #analyticsengineering

4 min read

Cover image for From LLM to Data Warehousing: How to Achieve AI-Driven Data Processing and Analysis

ksanaka

Feb 24

From LLM to Data Warehousing: How to Achieve AI-Driven Data Processing and Analysis

#llm #datascience #database #dataengineering

7 min read

Cover image for Streaming SQL in Stateful DataFlows

Deb

Feb 22

Streaming SQL in Stateful DataFlows

#sql #rust #distributedsystems #dataengineering

32

2 min read

Cover image for Complement a certain average value to ensure that the total sum remains unchanged — From SQL to SPL #3

Judith-Data-Processing-Hacks

Feb 21

Complement a certain average value to ensure that the total sum remains unchanged — From SQL to SPL #3

#programming #opensource #sql #dataengineering

7

1

2 min read

Cover image for 8 Tools Every AI Engineer Should Know in 2025

Just Determined

Feb 19

8 Tools Every AI Engineer Should Know in 2025

#ai #machinelearning #datascience #dataengineering

1

2 min read

Forem

# dataengineering

Uncertain Number but Regular Column to Row Conversion — From SQL to SPL #7

Study Notes 5.1.1-2 Introduction to Batch Processing & spark

Study Notes 5.4.1-3 Anatomy of a Spark Cluster GroupBy & Joins in Spark

Study Notes 5.6.3-4 Setting up a Dataproc Cluster & Connecting Spark to Big Query

Study Notes 5.6.1-2 Spark on cloud & local

Study Notes 5.5.1-2 Operations on Spark RDDs & Spark RDD mapPartition

Study Notes 5.3.1-2 First Look at Spark/PySpark & Spark Dataframes

Study Notes 5.3.3-4 Data Processing & SQL with Spark

Busco profesores AWS y python

How We Built OpenETL: A Simple, Scalable Data Migration Tool for Everyone 🚀

Unified Data Analytics via a Semantic Layer

An Introduction to Data Engineering in Google Cloud Platform

Data Transformation

Introdução à Engenharia de Dados

Study Notes 4.4.1 | 4.4.2 : Deployment Using dbt Cloud and Locally

Study Notes 4.5.2: Visualizing Data with Metabase (Alternative B)

Study Notes 4.3.1 - Build the First dbt Models

Study Notes 4.3.2 - Testing and Documenting the Project

Study Notes 4.1.2: What is dbt?

Study Notes 4.2.1 | 4.2.2: DBT Project Setup

Study Notes 4.1.1 - Analytics Engineering Basics

From LLM to Data Warehousing: How to Achieve AI-Driven Data Processing and Analysis

Streaming SQL in Stateful DataFlows

Complement a certain average value to ensure that the total sum remains unchanged — From SQL to SPL #3

8 Tools Every AI Engineer Should Know in 2025