Skip to content

Forem

# dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Cover image for Data ingestion using AWS Services, Part 1

Oteng Isaac for AWS Community Builders

Dec 25 '24

Data ingestion using AWS Services, Part 1

#dataengineering #aws #awsbigdata #awsdatalake

9 min read

Cover image for Data Warehousing Architectures

Dec 20 '24

Data Warehousing Architectures

#datascience #dataengineering #architecture #database

5 min read

Cover image for Can AI finally generate best practice code? I think so.

Quinton for Airbyte

Dec 19 '24

Can AI finally generate best practice code? I think so.

#ai #dataengineering #python

6 min read

Cover image for Query 1B Rows in PostgreSQL >25x Faster with Squirrels!

Tim Huang

Dec 18 '24

Query 1B Rows in PostgreSQL >25x Faster with Squirrels!

#postgres #dataengineering #analytics #bigdata

5 min read

Cover image for 📊 AI Dashboard Builder: Create Insightful Dashboards just Droppping your Data

Pablo

Dec 15 '24

📊 AI Dashboard Builder: Create Insightful Dashboards just Droppping your Data

#dataengineering #datascience #llm #python

2 min read

Hiswill Thompson

Dec 14 '24

Introduction to Data lakes: The future of big data storage

#bigdata #dataengineering

2 min read

Cover image for Explorer l'API de 360Learning : de l'agilité de Power Query à la robustesse de la Modern Data Stack

Yann Barrault for Onepoint

Dec 14 '24

Explorer l'API de 360Learning : de l'agilité de Power Query à la robustesse de la Modern Data Stack

#adventoftech2024 #dataengineering #airbyte #dbt

12 min read

Muhammad Mahdi Ramadhan

Nov 9 '24

Data Pipeline Filters 101: Choosing Between Static and Dynamic Approaches

#dataengineering #etl #dataanalyst #database

1 min read

Dec 11 '24

The Apache Iceberg™ Small File Problem

#bigdata #apacheiceberg #datalakehouse #dataengineering

3 min read

BuzzGK

Nov 7 '24

Ensuring Data Quality: Best Practices and Automation

#data #dataengineering

6 min read

Vikas76

Nov 10 '24

Data Science Simplified: Tips for Aspiring Data Scientists in 2025

#datascience #dataengineering #data #roadmap

4 min read

Cover image for 2025 Guide to Architecting an Iceberg Lakehouse

Dec 9 '24

2025 Guide to Architecting an Iceberg Lakehouse

#apacheiceberg #database #dataengineering #datascience

14 min read

Cover image for Data Engineer as a Real-Time Algo Trader – Turning Pipelines into Profit (or at Least Trying)!

SNEHASISH DUTTA

Dec 9 '24

Data Engineer as a Real-Time Algo Trader – Turning Pipelines into Profit (or at Least Trying)!

#sql #python #dataengineering #eventdriven

13 min read

Cover image for One Off to One Data Platform: Design with Intent [Part 2]

Lulu Cheng for jarrid.xyz

Dec 8 '24

One Off to One Data Platform: Design with Intent [Part 2]

#data #architecture #dataengineering #startup

5 min read

Cover image for Case Study: Creating an ETL Data Pipeline using AWS Services - Real-World Problem

M. Abdullah Bin Aftab

Dec 6 '24

Case Study: Creating an ETL Data Pipeline using AWS Services - Real-World Problem

#aws #dataengineering #data #cloudcomputing

2 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.