Skip to content
Navigation menu
Search
Powered by
Search
Algolia
Log in
Create account
Forem
Close
#
dataengineering
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
[Snowflake's New Feature] Introducing Generation 2 Standard Warehouses: A Performance Comparison
Sagara
Sagara
Sagara
Follow
May 6
[Snowflake's New Feature] Introducing Generation 2 Standard Warehouses: A Performance Comparison
#
snowflake
#
dataengineering
5
reactions
Comments
Add Comment
5 min read
Building a Self-Optimizing Data Pipeline
Shreyash Singh
Shreyash Singh
Shreyash Singh
Follow
Apr 1
Building a Self-Optimizing Data Pipeline
#
dataengineering
#
datapipeline
#
etl
#
selfoptimizing
Comments
Add Comment
3 min read
Automating Cryptocurrency Data with Python, Apache Airflow and PostgreSQL
Milcah03
Milcah03
Milcah03
Follow
Apr 1
Automating Cryptocurrency Data with Python, Apache Airflow and PostgreSQL
#
apacheairflow
#
python
#
dataengineering
#
datascience
Comments
Add Comment
3 min read
A Quick Developer’s Guide to Effective Data Engineering
Jakob Stanley
Jakob Stanley
Jakob Stanley
Follow
May 5
A Quick Developer’s Guide to Effective Data Engineering
#
dataengineering
#
data
#
development
1
reaction
Comments
Add Comment
3 min read
Creating a new Airbyte connector from scratch
Luiz Gustavo Erthal
Luiz Gustavo Erthal
Luiz Gustavo Erthal
Follow
Mar 31
Creating a new Airbyte connector from scratch
#
airbyte
#
data
#
dataengineering
#
python
Comments
Add Comment
4 min read
Introduction to Data Engineering Concepts |18| The Power of Dremio in the Modern Lakehouse
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |18| The Power of Dremio in the Modern Lakehouse
#
data
#
datascience
#
dataengineering
#
database
Comments
Add Comment
5 min read
Introduction to Data Engineering Concepts |1| What is Data Engineering?
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |1| What is Data Engineering?
#
dataengineering
#
data
#
datascience
#
database
2
reactions
Comments
Add Comment
3 min read
Introduction to Data Engineering Concepts |15| Cloud Data Platforms and the Modern Stack
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |15| Cloud Data Platforms and the Modern Stack
#
data
#
datascience
#
database
#
dataengineering
Comments
Add Comment
4 min read
Introduction to Data Engineering Concepts |17| Apache Iceberg, Arrow, and Polaris
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |17| Apache Iceberg, Arrow, and Polaris
#
data
#
datascience
#
database
#
dataengineering
Comments
Add Comment
4 min read
Introduction to Data Engineering Concepts |16| Data Lakehouse Architecture Explained
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |16| Data Lakehouse Architecture Explained
#
data
#
datascience
#
database
#
dataengineering
Comments
Add Comment
4 min read
Introduction to Data Engineering Concepts |13| Building Scalable Pipelines
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |13| Building Scalable Pipelines
#
data
#
datascience
#
database
#
dataengineering
Comments
Add Comment
4 min read
Introduction to Data Engineering Concepts |14| DevOps for Data Engineering
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |14| DevOps for Data Engineering
#
data
#
datascience
#
database
#
dataengineering
Comments
Add Comment
4 min read
Introduction to Data Engineering Concepts |12| Scheduling and Workflow Orchestration
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |12| Scheduling and Workflow Orchestration
#
data
#
datascience
#
database
#
dataengineering
Comments
Add Comment
4 min read
Introduction to Data Engineering Concepts |8| Data Lakes Explained
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |8| Data Lakes Explained
#
data
#
datascience
#
dataengineering
#
database
Comments
Add Comment
4 min read
Introduction to Data Engineering Concepts |10| Data Quality and Validation
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |10| Data Quality and Validation
#
data
#
datascience
#
database
#
dataengineering
Comments
Add Comment
4 min read
Introduction to Data Engineering Concepts |7| Data Warehousing Fundamentals
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |7| Data Warehousing Fundamentals
#
data
#
datascience
#
database
#
dataengineering
Comments
Add Comment
4 min read
Introduction to Data Engineering Concepts |9| Storage Formats and Compression
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |9| Storage Formats and Compression
#
data
#
datascience
#
database
#
dataengineering
Comments
Add Comment
4 min read
Introduction to Data Engineering Concepts |6| Data Modeling Basics
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |6| Data Modeling Basics
#
data
#
datascience
#
dataengineering
#
database
Comments
Add Comment
4 min read
Introduction to Data Engineering Concepts |5| Streaming Data Fundamentals
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |5| Streaming Data Fundamentals
#
database
#
datascience
#
dataengineering
#
data
Comments
Add Comment
4 min read
Introduction to Data Engineering Concepts |4| Batch Processing Fundamentals
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |4| Batch Processing Fundamentals
#
database
#
dataengineering
#
data
#
datascience
Comments
Add Comment
4 min read
Introduction to Data Engineering Concepts |2| Understanding Data Sources and Ingestion
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |2| Understanding Data Sources and Ingestion
#
database
#
dataengineering
#
datascience
#
data
1
reaction
Comments
Add Comment
4 min read
Introduction to Data Engineering Concepts |3| ETL vs ELT – Understanding Data Pipelines
Alex Merced
Alex Merced
Alex Merced
Follow
May 2
Introduction to Data Engineering Concepts |3| ETL vs ELT – Understanding Data Pipelines
#
data
#
datascience
#
dataengineering
#
database
Comments
Add Comment
4 min read
When Small Parquet Files Become a Big Problem (and How I Ended Up Writing a Compactor in PyArrow)
Olga Braginskaya
Olga Braginskaya
Olga Braginskaya
Follow
May 9
When Small Parquet Files Become a Big Problem (and How I Ended Up Writing a Compactor in PyArrow)
#
dataengineering
#
python
#
data
#
tutorial
17
reactions
Comments
2
comments
5 min read
Big Data Processing - Case Study 4 (Hadoop)
02:36
Afrar Malakooth
Afrar Malakooth
Afrar Malakooth
Follow
May 1
Big Data Processing - Case Study 4 (Hadoop)
#
bigdata
#
hadoop
#
dataengineering
1
reaction
Comments
Add Comment
1 min read
[Snowflake's New Feature]Snowflake Programmatic Access Tokens: Easy Authentication for BI Tools like Tableau & Power BI
Sagara
Sagara
Sagara
Follow
May 1
[Snowflake's New Feature]Snowflake Programmatic Access Tokens: Easy Authentication for BI Tools like Tableau & Power BI
#
snowflake
#
dataengineering
#
tableau
1
reaction
Comments
Add Comment
4 min read
loading...
We're a blogging-forward open source social network where we learn from one another
Log in
Create account