Forem

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Why we use Apache Airflow for Data Engineering
joy_akinyi_115689d7dff92f profile

Why we use Apache Airflow for Data Engineering

#dataengineering #airflow
Comments
2 min read
Building ML Infrastructure in TypeScript - Part 1: The Vision
baldrvivaldelli profile

Building ML Infrastructure in TypeScript - Part 1: The Vision

#typescript #machinelearning #dataengineering #fullstack
5
Comments
3 min read
Lightweight ETL with AWS Lambda, DuckDB, and delta-rs
datapenguin profile

Lightweight ETL with AWS Lambda, DuckDB, and delta-rs

#aws #dataengineering #delta
4
Comments
5 min read
Building a News Sentiment Analysis Pipeline with Apache Airflow and Snowflake
Cover image for Building a News Sentiment Analysis Pipeline with Apache Airflow and Snowflake
milcah03 profile

Building a News Sentiment Analysis Pipeline with Apache Airflow and Snowflake

#news #airflow #snowflake #dataengineering
11
Comments
3 min read
Interesting links - July 2025
rmoff profile

Interesting links - July 2025

#data #dataengineering #kafka #flink
Comments
6 min read
Data Mesh vs. Data Fabric: The Future of Data Management
Cover image for Data Mesh vs. Data Fabric: The Future of Data Management
andrey_s profile

Data Mesh vs. Data Fabric: The Future of Data Management

#datamanagement #dataengineering #datamesh #datafabric
1
Comments
6 min read
第2章：Qlib数据层深度解析
henry_lin_3ac6363747f45b4 profile

第2章：Qlib数据层深度解析

#dataengineering #datascience #machinelearning #tutorial
1
Comments
6 min read
The @dataclass Decorator In Python
m-nt-s-no profile

The @dataclass Decorator In Python

#python #programming #datascience #dataengineering
Comments
1 min read
Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg
datapenguin profile

Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg

#aws #duckdb #iceberg #dataengineering
5
Comments
4 min read
Kimball vs. Inmon: High-Level Design Strategies for Data Warehousing
Cover image for Kimball vs. Inmon: High-Level Design Strategies for Data Warehousing
andrey_s profile

Kimball vs. Inmon: High-Level Design Strategies for Data Warehousing

#datamanagement #dataengineering #database #bigdata
1
Comments
6 min read
Build a Lightweight Serverless ETL Pipeline to Iceberg Tables with AWS Lambda Athena
datapenguin profile

Build a Lightweight Serverless ETL Pipeline to Iceberg Tables with AWS Lambda Athena

#aws #iceberg #dataengineering
2
Comments
4 min read
Reading CSVs with varying column counts that pandas cannot read using DuckDB
nk_maker profile

Reading CSVs with varying column counts that pandas cannot read using DuckDB

#dataengineering #duckdb #csv #programming
1
Comments
3 min read
Building a Data Career: The Skills That Truly Matter
Cover image for Building a Data Career: The Skills That Truly Matter
datalane profile

Building a Data Career: The Skills That Truly Matter

#datascience #dataengineering #career #sql
10
Comments
5 min read
You Can't Trust COUNT and SUM: Scalable Data Validation with Merkle Trees
Cover image for You Can't Trust COUNT and SUM: Scalable Data Validation with Merkle Trees
andrey_s profile

You Can't Trust COUNT and SUM: Scalable Data Validation with Merkle Trees

#dataengineering #dataquality #datamonitoring #sql
2
Comments 1
8 min read
Snowflake RBAC 101 – Episode 2: Role Hierarchies & Least Privilege
qvfagundes profile

Snowflake RBAC 101 – Episode 2: Role Hierarchies & Least Privilege

#dataengineering #dataprivacy #datawarehouse #snowflake
Comments
1 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.