Forem

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Metadata for win — Apache Parquet
rahuldubey391 profile

Metadata for win — Apache Parquet

#python #bigdata #datascience #dataengineering
Comments
5 min read
Remove unwanted partition data in Azure Synapse (SQL DW)
ayush9892 profile

Remove unwanted partition data in Azure Synapse (SQL DW)

#dataengineering #sqlserver #azure
1
Comments
6 min read
Replacing Saas ETL with Python dlt: A painless experience for Yummy.eu
aman_gupta_7c59c96e9e167a profile

Replacing Saas ETL with Python dlt: A painless experience for Yummy.eu

#saasetl #dataengineering #python
2
Comments
3 min read
Simplifying SDMX Data Integration with Python
aman_gupta_7c59c96e9e167a profile

Simplifying SDMX Data Integration with Python

#dataengineering #pipeline #etl #sdmx
2
Comments
3 min read
Clustering vs Partitioning your Apache Iceberg Tables
Cover image for Clustering vs Partitioning your Apache Iceberg Tables
alexmercedcoder profile

Clustering vs Partitioning your Apache Iceberg Tables

#database #datascience #dataengineering #data
7
Comments
8 min read
From Messy Data to Super Mario Pipeline: My First Adventure in Data Engineering
Cover image for From Messy Data to Super Mario Pipeline: My First Adventure in Data Engineering
jampamatos profile

From Messy Data to Super Mario Pipeline: My First Adventure in Data Engineering

#dataengineering #python #automation #sql
1
Comments
12 min read
The Data Professions
Cover image for The Data Professions
moubarakmohame4 profile

The Data Professions

#data #datascience #dataengineering #datastructures
1
Comments
3 min read
Database generated events: LiveSync’s database connector vs CDC
Cover image for Database generated events: LiveSync’s database connector vs CDC
zknill profile
Zak for Ably

Database generated events: LiveSync’s database connector vs CDC

#database #dataengineering #architecture
4
Comments
5 min read
MySQL: Using and Enhancing `DATETIME` and `TIMESTAMP`
salmazz profile

MySQL: Using and Enhancing `DATETIME` and `TIMESTAMP`

#mysql #database #data #dataengineering
1
Comments
3 min read
Working with Parquet files in Java using Carpet
jerolba profile

Working with Parquet files in Java using Carpet

#parquet #java #bigdata #dataengineering
1
Comments 1
6 min read
Analyzing Svenskalag Data using DBT and DuckDB
Cover image for Analyzing Svenskalag Data using DBT and DuckDB
calleo profile

Analyzing Svenskalag Data using DBT and DuckDB

#dataengineering #dbt #duckdb #football
1
Comments
4 min read
How I've implemented the Medallion architecture using Apache Spark and Apache Hdoop
Cover image for How I've implemented the Medallion architecture using Apache Spark and Apache Hdoop
fadygrab profile

How I've implemented the Medallion architecture using Apache Spark and Apache Hdoop

#dataengineering #apachespark #data #opensource
12
Comments
6 min read
Working with Dates and Times in SQL: Tips and Tricks
Cover image for Working with Dates and Times in SQL: Tips and Tricks
tinapyp profile

Working with Dates and Times in SQL: Tips and Tricks

#datascience #database #dataengineering #tutorial
Comments
3 min read
FastAPI for Data Applications: From Concept to Creation. Part I
Cover image for FastAPI for Data Applications: From Concept to Creation. Part I
felipe_de_godoy profile

FastAPI for Data Applications: From Concept to Creation. Part I

#fastapi #dataengineering #datascience #llmops
4
Comments
5 min read
Usando Consultas de Percolação do Elasticsearch, Netflix Aperfeiçoa Buscas Reversas Eficientemente
salgado profile

Usando Consultas de Percolação do Elasticsearch, Netflix Aperfeiçoa Buscas Reversas Eficientemente

#elasticsearch #reversesearch #dataengineering #netflix
1
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.