Forem

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Peer Review 2: TfL Station Footfall Data Analysis Pipeline (Part 1)
Cover image for Peer Review 2: TfL Station Footfall Data Analysis Pipeline (Part 1)

Peer Review 2: TfL Station Footfall Data Analysis Pipeline (Part 1)

Comments
3 min read
Big Data Processing - Case Study 4 (Hadoop) 02:36

Big Data Processing - Case Study 4 (Hadoop)

1
Comments
1 min read
[Snowflake's New Feature]Snowflake Programmatic Access Tokens: Easy Authentication for BI Tools like Tableau & Power BI

[Snowflake's New Feature]Snowflake Programmatic Access Tokens: Easy Authentication for BI Tools like Tableau & Power BI

2
Comments
4 min read
Apache Iceberg: A Comprehensive Guide

Apache Iceberg: A Comprehensive Guide

1
Comments
4 min read
Building and Deploying My First Python ETL Package to PyPI
Cover image for Building and Deploying My First Python ETL Package to PyPI

Building and Deploying My First Python ETL Package to PyPI

1
Comments 1
3 min read
Peer Review 1: Poland's Real Estate Market Dashboards and Insights with Streamlit (Part 2)
Cover image for Peer Review 1: Poland's Real Estate Market Dashboards and Insights with Streamlit (Part 2)

Peer Review 1: Poland's Real Estate Market Dashboards and Insights with Streamlit (Part 2)

Comments
3 min read
Peer Review 1: Analyzing Poland's Real Estate Market (Part 1)
Cover image for Peer Review 1: Analyzing Poland's Real Estate Market (Part 1)

Peer Review 1: Analyzing Poland's Real Estate Market (Part 1)

Comments
3 min read
Personal Picks: Data Product News (April 30, 2025)

Personal Picks: Data Product News (April 30, 2025)

Comments
6 min read
InsightFlow Part 9: Workflow Orchestration with Kestra
Cover image for InsightFlow Part 9: Workflow Orchestration with Kestra

InsightFlow Part 9: Workflow Orchestration with Kestra

Comments
4 min read
InsightFlow Part 8: Setting Up AWS Athena for Data Analysis in InsightFlow
Cover image for InsightFlow Part 8: Setting Up AWS Athena for Data Analysis in InsightFlow

InsightFlow Part 8: Setting Up AWS Athena for Data Analysis in InsightFlow

Comments
3 min read
InsightFlow Part 7: Data Quality Implementation & Best Practices for InsightFlow
Cover image for InsightFlow Part 7: Data Quality Implementation & Best Practices for InsightFlow

InsightFlow Part 7: Data Quality Implementation & Best Practices for InsightFlow

Comments
3 min read
InsightFlow Part 6: Implementing ETL Processes with AWS Glue for InsightFlow
Cover image for InsightFlow Part 6: Implementing ETL Processes with AWS Glue for InsightFlow

InsightFlow Part 6: Implementing ETL Processes with AWS Glue for InsightFlow

Comments
3 min read
InsightFlow Part 5: Designing the Data Model & Schema with dbt for InsightFlow
Cover image for InsightFlow Part 5: Designing the Data Model & Schema with dbt for InsightFlow

InsightFlow Part 5: Designing the Data Model & Schema with dbt for InsightFlow

Comments
3 min read
InsightFlow Part 4: Data Exploration & Understanding the Datasets
Cover image for InsightFlow Part 4: Data Exploration & Understanding the Datasets

InsightFlow Part 4: Data Exploration & Understanding the Datasets

Comments
3 min read
InsightFlow Part 3: Building the Data Ingestion Layer with AWS Batch
Cover image for InsightFlow Part 3: Building the Data Ingestion Layer with AWS Batch

InsightFlow Part 3: Building the Data Ingestion Layer with AWS Batch

1
Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.