Forem

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
The @dataclass Decorator In Python
m-nt-s-no profile

The @dataclass Decorator In Python

#python #programming #datascience #dataengineering
Comments
1 min read
Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg
datapenguin profile

Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg

#aws #duckdb #iceberg #dataengineering
5
Comments
4 min read
Tableau Sales Dashboard Performance (Updated for 2025)
vamshi_e_eebe5a6287a27142 profile

Tableau Sales Dashboard Performance (Updated for 2025)

#datascience #dataengineering
1
Comments
4 min read
Kimball vs. Inmon: High-Level Design Strategies for Data Warehousing
Cover image for Kimball vs. Inmon: High-Level Design Strategies for Data Warehousing
andrey_s profile

Kimball vs. Inmon: High-Level Design Strategies for Data Warehousing

#datamanagement #dataengineering #database #bigdata
1
Comments
6 min read
Build a Lightweight Serverless ETL Pipeline to Iceberg Tables with AWS Lambda Athena
datapenguin profile

Build a Lightweight Serverless ETL Pipeline to Iceberg Tables with AWS Lambda Athena

#aws #iceberg #dataengineering
2
Comments
4 min read
🧊 Snowflake RBAC 101 – Episode 3: Ongoing Access Management
qvfagundes profile

🧊 Snowflake RBAC 101 – Episode 3: Ongoing Access Management

#dataengineering #datawarehouse #snowflake
Comments
1 min read
What Is Change Data Capture (CDC) and How It Works on Google Cloud
_richardson_ profile

What Is Change Data Capture (CDC) and How It Works on Google Cloud

#gcp #bigquery #dataengineering #database
Comments
2 min read
đź’ľ Parquet or Avro? CSV or JSON?
aleksei_aleinikov profile

đź’ľ Parquet or Avro? CSV or JSON?

#data #bigdata #dataengineering #webdev
Comments
1 min read
Reading CSVs with varying column counts that pandas cannot read using DuckDB
nk_maker profile

Reading CSVs with varying column counts that pandas cannot read using DuckDB

#dataengineering #duckdb #csv #programming
1
Comments
3 min read
Working with Apache to automate collection of Weather data for Kenya’s major Agricultural Areas
Cover image for Working with Apache to automate collection of Weather data for Kenya’s major Agricultural Areas
amolo_hillary profile

Working with Apache to automate collection of Weather data for Kenya’s major Agricultural Areas

#dataengineering #dataanalytics #apacheairflow #luxdev
Comments
5 min read
Building a Data Career: The Skills That Truly Matter
Cover image for Building a Data Career: The Skills That Truly Matter
datalane profile

Building a Data Career: The Skills That Truly Matter

#datascience #dataengineering #career #sql
10
Comments
5 min read
You Can't Trust COUNT and SUM: Scalable Data Validation with Merkle Trees
Cover image for You Can't Trust COUNT and SUM: Scalable Data Validation with Merkle Trees
andrey_s profile

You Can't Trust COUNT and SUM: Scalable Data Validation with Merkle Trees

#dataengineering #dataquality #datamonitoring #sql
2
Comments 1
8 min read
Unable to emit metadata to DataHub GMS with Airflow - a solution
Cover image for Unable to emit metadata to DataHub GMS with Airflow - a solution
ivicak profile

Unable to emit metadata to DataHub GMS with Airflow - a solution

#airflow #dataengineering #datahub #data
Comments
4 min read
Snowflake RBAC 101 – Episode 2: Role Hierarchies & Least Privilege
qvfagundes profile

Snowflake RBAC 101 – Episode 2: Role Hierarchies & Least Privilege

#dataengineering #dataprivacy #datawarehouse #snowflake
Comments
1 min read
Lightweight ETL with AWS Glue Python Shell, DuckDB, and PyIceberg
datapenguin profile

Lightweight ETL with AWS Glue Python Shell, DuckDB, and PyIceberg

#aws #iceberg #dataengineering #duckdb
5
Comments 1
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.