Forem

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Anomaly Detection in Financial Transactions: Algorithms and Applications
Cover image for Anomaly Detection in Financial Transactions: Algorithms and Applications

Anomaly Detection in Financial Transactions: Algorithms and Applications

2
Comments
10 min read
The Ultimate Guide to Open Table Formats: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake
Cover image for The Ultimate Guide to Open Table Formats: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake

The Ultimate Guide to Open Table Formats: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake

1
Comments
16 min read
How to Pass the AWS Certified Data Engineer – Associate (DEA-C01) Exam2025
Cover image for How to Pass the AWS Certified Data Engineer – Associate (DEA-C01) Exam2025

How to Pass the AWS Certified Data Engineer – Associate (DEA-C01) Exam2025

Comments
5 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Comments
7 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
Cover image for Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Comments
4 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
Cover image for Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Comments
10 min read
🦆 DuckDB: The SQLite of Analytics You Didn’t Know You Needed
Cover image for 🦆 DuckDB: The SQLite of Analytics You Didn’t Know You Needed

🦆 DuckDB: The SQLite of Analytics You Didn’t Know You Needed

Comments
3 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

1
Comments
6 min read
Personal Picks: Data Product News (August 20, 2025)

Personal Picks: Data Product News (August 20, 2025)

Comments
6 min read
Apache Polaris Dev List Digest (Sept 15–19, 2025)

Apache Polaris Dev List Digest (Sept 15–19, 2025)

Comments
4 min read
Building a Reddit Sentiment Pipeline using Python, PostgreSQL, VADER, Airflow, Grafana, Prometheus and StatsD
Cover image for Building a Reddit Sentiment Pipeline using Python, PostgreSQL, VADER, Airflow, Grafana, Prometheus and StatsD

Building a Reddit Sentiment Pipeline using Python, PostgreSQL, VADER, Airflow, Grafana, Prometheus and StatsD

1
Comments 1
5 min read
Kimball vs. Inmon: High-Level Design Strategies for Data Warehousing
Cover image for Kimball vs. Inmon: High-Level Design Strategies for Data Warehousing

Kimball vs. Inmon: High-Level Design Strategies for Data Warehousing

1
Comments
6 min read
Is Prompt Engineering Just Hype for Now?
Cover image for Is Prompt Engineering Just Hype for Now?

Is Prompt Engineering Just Hype for Now?

7
Comments
3 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Comments
7 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices
Cover image for Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

1
Comments
4 min read
Apache Polaris Dev Mailing List — Weekly Digest (Aug 11–17, 2025)
Cover image for Apache Polaris Dev Mailing List — Weekly Digest (Aug 11–17, 2025)

Apache Polaris Dev Mailing List — Weekly Digest (Aug 11–17, 2025)

Comments
4 min read
How ETL Pipelines Power Modern Data Analytics

How ETL Pipelines Power Modern Data Analytics

Comments
1 min read
Polyglot Data Engineering: Python + Go in the Same Pipeline
Cover image for Polyglot Data Engineering: Python + Go in the Same Pipeline

Polyglot Data Engineering: Python + Go in the Same Pipeline

3
Comments 2
2 min read
Data Mesh vs. Data Fabric: The Future of Data Management
Cover image for Data Mesh vs. Data Fabric: The Future of Data Management

Data Mesh vs. Data Fabric: The Future of Data Management

1
Comments
6 min read
🚀 Why You Should Pick Auto Loader Over Structured Streaming in Azure Databricks (The Funny Truth)
Cover image for 🚀 Why You Should Pick Auto Loader Over Structured Streaming in Azure Databricks (The Funny Truth)

🚀 Why You Should Pick Auto Loader Over Structured Streaming in Azure Databricks (The Funny Truth)

Comments
2 min read
Apache Kafka in Data Engineering.
Cover image for Apache Kafka in Data Engineering.

Apache Kafka in Data Engineering.

Comments
1 min read
Beginner guide for Apache Kafka
Cover image for Beginner guide for Apache Kafka

Beginner guide for Apache Kafka

Comments
1 min read
Apache Kafka in Data Engineering for Beginners
Cover image for Apache Kafka in Data Engineering for Beginners

Apache Kafka in Data Engineering for Beginners

Comments
1 min read
SeaTunnel Community Rocked July: New Features, Major Optimizations, All-Star Contributors

SeaTunnel Community Rocked July: New Features, Major Optimizations, All-Star Contributors

Comments
11 min read
Automating Your Local DBT & Snowflake Playground with Python
Cover image for Automating Your Local DBT & Snowflake Playground with Python

Automating Your Local DBT & Snowflake Playground with Python

2
Comments
10 min read
loading...