Forem

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
The Underrated Soft Skills That Make Great Data Engineers

The Underrated Soft Skills That Make Great Data Engineers

2
Comments 2
2 min read
MongoDB Relationships - Embedded vs Referenced | Tutorial 2025
Cover image for MongoDB Relationships - Embedded vs Referenced | Tutorial 2025

MongoDB Relationships - Embedded vs Referenced | Tutorial 2025

7
Comments 1
4 min read
How PostgreSQL logical decoding and plugins work
Cover image for How PostgreSQL logical decoding and plugins work

How PostgreSQL logical decoding and plugins work

1
Comments
6 min read
Why Denormalizing in ClickHouse will come back to bite you

Why Denormalizing in ClickHouse will come back to bite you

Comments
3 min read
Ultimate guide to creating a pipeline(Apache Airflow)
Cover image for Ultimate guide to creating a pipeline(Apache Airflow)

Ultimate guide to creating a pipeline(Apache Airflow)

11
Comments
5 min read
Extracting Data from an API using Python (requests)
Cover image for Extracting Data from an API using Python (requests)

Extracting Data from an API using Python (requests)

Comments
4 min read
Unlocking Business Potential with Big Data Analytics Services

Unlocking Business Potential with Big Data Analytics Services

Comments
3 min read
A Practical Guide to MLOps on AWS: Transforming Raw Data into AI-Ready Datasets with AWS Glue (Phase 02)

A Practical Guide to MLOps on AWS: Transforming Raw Data into AI-Ready Datasets with AWS Glue (Phase 02)

1
Comments 2
8 min read
Personal Picks: Data Product News (April 16, 2025)

Personal Picks: Data Product News (April 16, 2025)

Comments
8 min read
Find the Superset from the Relationship Table — From SQL to SPL #19
Cover image for Find the Superset from the Relationship Table — From SQL to SPL #19

Find the Superset from the Relationship Table — From SQL to SPL #19

1
Comments 1
1 min read
Building a Gold (XAUUSD) Trend Tracker with Python and SQLite

Building a Gold (XAUUSD) Trend Tracker with Python and SQLite

2
Comments 1
4 min read
Big data analytics process

Big data analytics process

1
Comments
1 min read
Python 101:The Ultimate Beginner’s Guide
Cover image for Python 101:The Ultimate Beginner’s Guide

Python 101:The Ultimate Beginner’s Guide

1
Comments
4 min read
Common Mistakes to Avoid in Data Engineering Job Interviews (And How to Nail Them)

Common Mistakes to Avoid in Data Engineering Job Interviews (And How to Nail Them)

Comments
3 min read
Is Big Data Dying?
Cover image for Is Big Data Dying?

Is Big Data Dying?

1
Comments
7 min read
Supercharging Databricks Asset Bundles

Supercharging Databricks Asset Bundles

1
Comments
4 min read
How Pandas Simplifies ETL Data Cleaning
Cover image for How Pandas Simplifies ETL Data Cleaning

How Pandas Simplifies ETL Data Cleaning

Comments
6 min read
Git Branching and Merging: A Data Engineer's Guide to Efficient Code Management
Cover image for Git Branching and Merging: A Data Engineer's Guide to Efficient Code Management

Git Branching and Merging: A Data Engineer's Guide to Efficient Code Management

Comments
5 min read
Detailed Logic for RDF Conversion and Use in RDH (Robust Data Hub)

Detailed Logic for RDF Conversion and Use in RDH (Robust Data Hub)

Comments
6 min read
Stop Using CSVs in Big Data: Here's Why You Should Learn Apache Iceberg

Stop Using CSVs in Big Data: Here's Why You Should Learn Apache Iceberg

Comments
1 min read
Number Non-Null Values in Order within the Group — From SQL to SPL #17
Cover image for Number Non-Null Values in Order within the Group — From SQL to SPL #17

Number Non-Null Values in Order within the Group — From SQL to SPL #17

6
Comments 1
2 min read
🚿 Data Cleaning in Python, 2025 Edition

🚿 Data Cleaning in Python, 2025 Edition

Comments
1 min read
Step-by-Step: Create & Load Data into a Lakehouse in Microsoft Fabric
Cover image for Step-by-Step: Create & Load Data into a Lakehouse in Microsoft Fabric

Step-by-Step: Create & Load Data into a Lakehouse in Microsoft Fabric

3
Comments
3 min read
Data Engineering Concepts: A project based introduction
Cover image for Data Engineering Concepts: A project based introduction

Data Engineering Concepts: A project based introduction

4
Comments
11 min read
Building an Automated Crypto Price ETL Pipeline with Airflow and PostgreSQL

Building an Automated Crypto Price ETL Pipeline with Airflow and PostgreSQL

5
Comments 5
3 min read
loading...