Skip to content

Forem

# dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Cover image for Why Data Quality Dimensions Are the Secret Ingredient for Data-Driven Success

ramya N

Dec 31 '24

Why Data Quality Dimensions Are the Secret Ingredient for Data-Driven Success

#data #dataquality #database #dataengineering

3 min read

Cover image for Easily Integrate Databend Test Environment with Testcontainers

ksanaka

Dec 20 '24

Easily Integrate Databend Test Environment with Testcontainers

#dataengineering #rust #testcontainers #opensource

4 min read

Cover image for When to use Apache Xtable or Delta Lake Uniform for Data Lakehouse Interoperability

Jan 7 '25

When to use Apache Xtable or Delta Lake Uniform for Data Lakehouse Interoperability

#dataengineering #dataanalytics #datascience #bigdata

5 min read

Cover image for Why Feature Scaling Should Be Done After Splitting Your Dataset into Training and Test Sets

Gervais Yao Amoah

Jan 3 '25

Why Feature Scaling Should Be Done After Splitting Your Dataset into Training and Test Sets

#machinelearning #datascience #dataengineering #softwareengineering

3 min read

Cover image for Exploring OSM changesets via DuckDB

Pavel P.

Dec 28 '24

Exploring OSM changesets via DuckDB

#osm #dataengineering #duckdb #database

9 min read

Cover image for Creating Stripe Test Data in Python

Quinton for Airbyte

Dec 26 '24

Creating Stripe Test Data in Python

#stripe #python #dataengineering #airbyte

4 min read

Cover image for Data Warehousing Architectures

Dec 20 '24

Data Warehousing Architectures

#datascience #dataengineering #architecture #database

5 min read

Cover image for Can AI finally generate best practice code? I think so.

Quinton for Airbyte

Dec 19 '24

Can AI finally generate best practice code? I think so.

#ai #dataengineering #python

6 min read

Cover image for Query 1B Rows in PostgreSQL >25x Faster with Squirrels!

Tim Huang

Dec 18 '24

Query 1B Rows in PostgreSQL >25x Faster with Squirrels!

#postgres #dataengineering #analytics #bigdata

5 min read

Cover image for 📊 AI Dashboard Builder: Create Insightful Dashboards just Droppping your Data

Pablo

Dec 15 '24

📊 AI Dashboard Builder: Create Insightful Dashboards just Droppping your Data

#dataengineering #datascience #llm #python

2 min read

Hiswill Thompson

Dec 14 '24

Introduction to Data lakes: The future of big data storage

#bigdata #dataengineering

2 min read

Cover image for Explorer l'API de 360Learning : de l'agilité de Power Query à la robustesse de la Modern Data Stack

Yann Barrault for Onepoint

Dec 14 '24

Explorer l'API de 360Learning : de l'agilité de Power Query à la robustesse de la Modern Data Stack

#adventoftech2024 #dataengineering #airbyte #dbt

12 min read

Dec 11 '24

The Apache Iceberg™ Small File Problem

#bigdata #apacheiceberg #datalakehouse #dataengineering

3 min read

Cover image for 2025 Guide to Architecting an Iceberg Lakehouse

Dec 9 '24

2025 Guide to Architecting an Iceberg Lakehouse

#apacheiceberg #database #dataengineering #datascience

14 min read

Cover image for Data Engineer as a Real-Time Algo Trader – Turning Pipelines into Profit (or at Least Trying)!

SNEHASISH DUTTA

Dec 9 '24

Data Engineer as a Real-Time Algo Trader – Turning Pipelines into Profit (or at Least Trying)!

#sql #python #dataengineering #eventdriven

13 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.