Forem

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Introduction to Apache Hadoop & MapReduce
Cover image for Introduction to Apache Hadoop & MapReduce
shvshydv profile

Introduction to Apache Hadoop & MapReduce

#hadoop #dataengineering #bigdata #datascience
5
Comments
3 min read
Analytics don't want duplicated data, so get it exactly-once with Flink/Kafka
kination profile

Analytics don't want duplicated data, so get it exactly-once with Flink/Kafka

#flink #kafka #dataengineering
Comments
3 min read
Metadata for win — Apache Parquet
rahuldubey391 profile

Metadata for win — Apache Parquet

#python #bigdata #datascience #dataengineering
Comments
5 min read
Remove unwanted partition data in Azure Synapse (SQL DW)
ayush9892 profile

Remove unwanted partition data in Azure Synapse (SQL DW)

#dataengineering #sqlserver #azure
1
Comments
6 min read
Replacing Saas ETL with Python dlt: A painless experience for Yummy.eu
aman_gupta_7c59c96e9e167a profile

Replacing Saas ETL with Python dlt: A painless experience for Yummy.eu

#saasetl #dataengineering #python
2
Comments
3 min read
Simplifying SDMX Data Integration with Python
aman_gupta_7c59c96e9e167a profile

Simplifying SDMX Data Integration with Python

#dataengineering #pipeline #etl #sdmx
2
Comments
3 min read
Clustering vs Partitioning your Apache Iceberg Tables
Cover image for Clustering vs Partitioning your Apache Iceberg Tables
alexmercedcoder profile

Clustering vs Partitioning your Apache Iceberg Tables

#database #datascience #dataengineering #data
7
Comments
8 min read
From Messy Data to Super Mario Pipeline: My First Adventure in Data Engineering
Cover image for From Messy Data to Super Mario Pipeline: My First Adventure in Data Engineering
jampamatos profile

From Messy Data to Super Mario Pipeline: My First Adventure in Data Engineering

#dataengineering #python #automation #sql
1
Comments
12 min read
The Data Professions
Cover image for The Data Professions
moubarakmohame4 profile

The Data Professions

#data #datascience #dataengineering #datastructures
1
Comments
3 min read
Database generated events: LiveSync’s database connector vs CDC
Cover image for Database generated events: LiveSync’s database connector vs CDC
zknill profile
Zak for Ably

Database generated events: LiveSync’s database connector vs CDC

#database #dataengineering #architecture
4
Comments
5 min read
MySQL: Using and Enhancing `DATETIME` and `TIMESTAMP`
salmazz profile

MySQL: Using and Enhancing `DATETIME` and `TIMESTAMP`

#mysql #database #data #dataengineering
1
Comments
3 min read
Working with Parquet files in Java using Carpet
jerolba profile

Working with Parquet files in Java using Carpet

#parquet #java #bigdata #dataengineering
1
Comments 1
6 min read
Analyzing Svenskalag Data using DBT and DuckDB
Cover image for Analyzing Svenskalag Data using DBT and DuckDB
calleo profile

Analyzing Svenskalag Data using DBT and DuckDB

#dataengineering #dbt #duckdb #football
1
Comments
4 min read
How I've implemented the Medallion architecture using Apache Spark and Apache Hdoop
Cover image for How I've implemented the Medallion architecture using Apache Spark and Apache Hdoop
fadygrab profile

How I've implemented the Medallion architecture using Apache Spark and Apache Hdoop

#dataengineering #apachespark #data #opensource
12
Comments
6 min read
Working with Dates and Times in SQL: Tips and Tricks
Cover image for Working with Dates and Times in SQL: Tips and Tricks
tinapyp profile

Working with Dates and Times in SQL: Tips and Tricks

#datascience #database #dataengineering #tutorial
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.