Forem

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Apache Doris for log and time series data analysis in NetEase, why not Elasticsearch and InfluxDB?
apachedoris profile

Apache Doris for log and time series data analysis in NetEase, why not Elasticsearch and InfluxDB?

#datascience #database #dataengineering #opensource
1
Comments
9 min read
MapReduce Vs Tez
Cover image for MapReduce Vs Tez
shvshydv profile

MapReduce Vs Tez

#hadoop #dataengineering #database #datascience
6
Comments
2 min read
Azure Synapse Analytics Security: Data Protection
ayush9892 profile

Azure Synapse Analytics Security: Data Protection

#azure #sqlserver #dataengineering
3
Comments
6 min read
Leveraging PySpark.Pandas for Efficient Data Pipelines
Cover image for Leveraging PySpark.Pandas for Efficient Data Pipelines
felipe_de_godoy profile

Leveraging PySpark.Pandas for Efficient Data Pipelines

#dataengineering #spark #pandas #python
Comments
3 min read
Why Apache Doris is the Best Open Source Alternative to Rockset
apachedoris profile

Why Apache Doris is the Best Open Source Alternative to Rockset

#database #bigdata #dataengineering #openai
3
Comments
3 min read
Apache Spark-Structured Streaming :: Cab Aggregator Use-case
Cover image for Apache Spark-Structured Streaming :: Cab Aggregator Use-case
datasosneh profile

Apache Spark-Structured Streaming :: Cab Aggregator Use-case

#apachespark #dataengineering #streaming #realtimedata
1
Comments
4 min read
Introduction to Apache Hadoop & MapReduce
Cover image for Introduction to Apache Hadoop & MapReduce
shvshydv profile

Introduction to Apache Hadoop & MapReduce

#hadoop #dataengineering #bigdata #datascience
5
Comments
3 min read
Analytics don't want duplicated data, so get it exactly-once with Flink/Kafka
kination profile

Analytics don't want duplicated data, so get it exactly-once with Flink/Kafka

#flink #kafka #dataengineering
Comments
3 min read
Metadata for win — Apache Parquet
rahuldubey391 profile

Metadata for win — Apache Parquet

#python #bigdata #datascience #dataengineering
Comments
5 min read
Remove unwanted partition data in Azure Synapse (SQL DW)
ayush9892 profile

Remove unwanted partition data in Azure Synapse (SQL DW)

#dataengineering #sqlserver #azure
1
Comments
6 min read
Replacing Saas ETL with Python dlt: A painless experience for Yummy.eu
aman_gupta_7c59c96e9e167a profile

Replacing Saas ETL with Python dlt: A painless experience for Yummy.eu

#saasetl #dataengineering #python
2
Comments
3 min read
Simplifying SDMX Data Integration with Python
aman_gupta_7c59c96e9e167a profile

Simplifying SDMX Data Integration with Python

#dataengineering #pipeline #etl #sdmx
2
Comments
3 min read
Unlocking the Power of Large Language Models (LLMs): Your Ultimate Guide
futuristicgeeks profile

Unlocking the Power of Large Language Models (LLMs): Your Ultimate Guide

#webdev #llm #python #dataengineering
6
Comments
1 min read
Clustering vs Partitioning your Apache Iceberg Tables
Cover image for Clustering vs Partitioning your Apache Iceberg Tables
alexmercedcoder profile

Clustering vs Partitioning your Apache Iceberg Tables

#database #datascience #dataengineering #data
7
Comments
8 min read
From Messy Data to Super Mario Pipeline: My First Adventure in Data Engineering
Cover image for From Messy Data to Super Mario Pipeline: My First Adventure in Data Engineering
jampamatos profile

From Messy Data to Super Mario Pipeline: My First Adventure in Data Engineering

#dataengineering #python #automation #sql
1
Comments
12 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.