Forem

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How DiDi Scaled to Hundreds of Petabytes with Apache Ozone
wtrue profile

How DiDi Scaled to Hundreds of Petabytes with Apache Ozone

#architecture #dataengineering #opensource #performance
Comments
4 min read
Building Scalable Data Pipelines with Airflow, Docker, and Python: A SightSearch Case Study
oliver_samuel_028c6f65ad6 profile

Building Scalable Data Pipelines with Airflow, Docker, and Python: A SightSearch Case Study

#automation #dataengineering #docker #python
Comments
3 min read
Introduction to Linux for Data Engineers, Beginner Friendly Approach
kihoro_codes_c959f8c68a9c profile

Introduction to Linux for Data Engineers, Beginner Friendly Approach

#linux #dataengineering #datascience
Comments
2 min read
XLTable: Bringing the OLAP Experience Back to Excel on Modern Data Warehouses
xltable profile

XLTable: Bringing the OLAP Experience Back to Excel on Modern Data Warehouses

#excel #dataengineering #analytics #datawarehouse
Comments
4 min read
How to Implement Data Modelling in Power BI
Cover image for How to Implement Data Modelling in Power BI
gathurum profile

How to Implement Data Modelling in Power BI

#dataengineering #datascience #bigdata #beginners
2
Comments
2 min read
AI Data Engineer vs Data Engineer: What Actually Changed? (50+ Job Analysis)
Cover image for AI Data Engineer vs Data Engineer: What Actually Changed? (50+ Job Analysis)
panualaluusua profile

AI Data Engineer vs Data Engineer: What Actually Changed? (50+ Job Analysis)

#dataengineering #careerdevelopment #rag
Comments
4 min read
SellerSprite Alternative: Building a Cost-Effective Amazon Data Pipeline with Pangolinfo API
Cover image for SellerSprite Alternative: Building a Cost-Effective Amazon Data Pipeline with Pangolinfo API
loopsthings profile

SellerSprite Alternative: Building a Cost-Effective Amazon Data Pipeline with Pangolinfo API

#dataengineering #ecommerce #python #postgressql
5
Comments
6 min read
Mitigating 'Scraping Shock': Engineering Cost-Aware Data Pipelines
Cover image for Mitigating 'Scraping Shock': Engineering Cost-Aware Data Pipelines
withatte profile

Mitigating 'Scraping Shock': Engineering Cost-Aware Data Pipelines

#webscraping #dataengineering #observability
Comments
5 min read
JSONPath Is In! The AI Assistant Will See You Now
Cover image for JSONPath Is In! The AI Assistant Will See You Now
david_kershaw_b6916404da6 profile

JSONPath Is In! The AI Assistant Will See You Now

#dataengineering #promptengineering #json #python
Comments
4 min read
How I automated MongoDB JSON Flattening for Analytics (No ETL)
Cover image for How I automated MongoDB JSON Flattening for Analytics (No ETL)
donald_wono_2494bee04aa88 profile

How I automated MongoDB JSON Flattening for Analytics (No ETL)

#showdev #mongodb #dataengineering #database
Comments
2 min read
Custom Functions FTW
Cover image for Custom Functions FTW
david_kershaw_b6916404da6 profile

Custom Functions FTW

#data #dataengineering #python #qc
Comments
4 min read
Apache Data Lakehouse Weekly: January 20–27, 2026
alexmercedcoder profile

Apache Data Lakehouse Weekly: January 20–27, 2026

#news #data #dataengineering #opensource
Comments
5 min read
Observability: Monitoring Spiders with Prometheus and Grafana
Cover image for Observability: Monitoring Spiders with Prometheus and Grafana
deepak_mishra_35863517037 profile

Observability: Monitoring Spiders with Prometheus and Grafana

#webscraping #grafana #prometheus #dataengineering
Comments
12 min read
SCHEMAS AND DATA MODELLING IN POWER BI
Cover image for SCHEMAS AND DATA MODELLING IN POWER BI
jedidah_ondiso_887753d76e profile

SCHEMAS AND DATA MODELLING IN POWER BI

#analytics #database #dataengineering #microsoft
1
Comments 1
2 min read
Comparing Validatar to CsvPath Validation
Cover image for Comparing Validatar to CsvPath Validation
david_kershaw_b6916404da6 profile

Comparing Validatar to CsvPath Validation

#dataengineering #data #python #programming
Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.