DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Exploring OSM changesets via DuckDB
gis_nuke profile

Exploring OSM changesets via DuckDB

#osm #dataengineering #duckdb #database
1
Comments
9 min read
Creating Stripe Test Data in Python
quintonwall profile

Creating Stripe Test Data in Python

#stripe #python #dataengineering #airbyte
2
Comments
4 min read
Setting up memory for Flink - Configuration
kination profile

Setting up memory for Flink - Configuration

#dataengineering #flink #memory #tuning
Comments
3 min read
Are AWS Certifications Worth It in 2025?
skillboosttrainer profile

Are AWS Certifications Worth It in 2025?

#aws #awscertification #dataengineering #cloudservices
3
Comments
2 min read
Query 1B Rows in PostgreSQL >25x Faster with Squirrels!
tim_huang profile

Query 1B Rows in PostgreSQL >25x Faster with Squirrels!

#postgres #dataengineering #analytics #bigdata
1
Comments 8
5 min read
Talend vs. Apache Kafka: Which Data Tool Drives Better Business Insights?
hana_sato profile

Talend vs. Apache Kafka: Which Data Tool Drives Better Business Insights?

#datascience #devops #dataengineering #datastructures
Comments
6 min read
📊 AI Dashboard Builder: Create Insightful Dashboards just Droppping your Data
pnmartinez profile

📊 AI Dashboard Builder: Create Insightful Dashboards just Droppping your Data

#dataengineering #datascience #llm #python
2
Comments
2 min read
Introduction to Data lakes: The future of big data storage
hiswill_thompson_e33923d1 profile

Introduction to Data lakes: The future of big data storage

#bigdata #dataengineering
5
Comments
2 min read
Explorer l'API de 360Learning : de l'agilité de Power Query à la robustesse de la Modern Data Stack
yann_barrault_e7dc827eced profile

Explorer l'API de 360Learning : de l'agilité de Power Query à la robustesse de la Modern Data Stack

#adventoftech2024 #dataengineering #airbyte #dbt
7
Comments
12 min read
Data Pipeline Filters 101: Choosing Between Static and Dynamic Approaches
muhammad_mahdiramadhan profile

Data Pipeline Filters 101: Choosing Between Static and Dynamic Approaches

#dataengineering #etl #dataanalyst #database
Comments
1 min read
The Apache Icebergâ„¢ Small File Problem
thedanicafine profile

The Apache Icebergâ„¢ Small File Problem

#bigdata #apacheiceberg #datalakehouse #dataengineering
9
Comments
3 min read
Ensuring Data Quality: Best Practices and Automation
buzzgk profile

Ensuring Data Quality: Best Practices and Automation

#data #dataengineering
Comments
6 min read
Data Science Simplified: Tips for Aspiring Data Scientists in 2025
vikas76 profile

Data Science Simplified: Tips for Aspiring Data Scientists in 2025

#datascience #dataengineering #data #roadmap
1
Comments
4 min read
2025 Guide to Architecting an Iceberg Lakehouse
alexmercedcoder profile

2025 Guide to Architecting an Iceberg Lakehouse

#apacheiceberg #database #dataengineering #datascience
5
Comments
14 min read
Dremio, Apache Iceberg and their role in AI-Ready Data
alexmercedcoder profile

Dremio, Apache Iceberg and their role in AI-Ready Data

#database #dataengineering #datascience #dataanalytics
Comments
7 min read
Data Engineer as a Real-Time Algo Trader – Turning Pipelines into Profit (or at Least Trying)!
snehasish_dutta_007 profile

Data Engineer as a Real-Time Algo Trader – Turning Pipelines into Profit (or at Least Trying)!

#sql #python #dataengineering #eventdriven
2
Comments
13 min read
One Off to One Data Platform: Design with Intent [Part 2]
l1990790120 profile

One Off to One Data Platform: Design with Intent [Part 2]

#data #architecture #dataengineering #startup
1
Comments
5 min read
Case Study: Creating an ETL Data Pipeline using AWS Services - Real-World Problem
heighter profile

Case Study: Creating an ETL Data Pipeline using AWS Services - Real-World Problem

#aws #dataengineering #data #cloudcomputing
Comments
2 min read
Choosing the right, real-time, Postgres CDC platform
thisisgoldman profile

Choosing the right, real-time, Postgres CDC platform

#postgres #database #eventdriven #dataengineering
Comments
8 min read
ChatGPT Launches Pro: What's it Mean for Data Professionals?
rapp2043 profile

ChatGPT Launches Pro: What's it Mean for Data Professionals?

#openai #chatgpt #datascience #dataengineering
2
Comments
4 min read
Introduction to Apache Kafka
hiswill_thompson_e33923d1 profile

Introduction to Apache Kafka

#datapipeline #dataengineering #realtimedat
3
Comments 1
3 min read
Mastering Workflow Automation with Apache Airflow for Data Engineering
adityabhuyan profile

Mastering Workflow Automation with Apache Airflow for Data Engineering

#dataengineering #apacheairflow
Comments
6 min read
Mastering Twitter Data Collection: A Comprehensive Guide to Efficient Scraping Solutions
kaito2046 profile

Mastering Twitter Data Collection: A Comprehensive Guide to Efficient Scraping Solutions

#twitter #datascience #dataengineering #development
Comments
3 min read
Seaborn Cheat Sheet
arum_puripratamawati_ef5 profile

Seaborn Cheat Sheet

#seaborn #datascience #cheatsheet #dataengineering
1
Comments
2 min read
Jupyter Notebooks in Docker
hassan_aftab profile

Jupyter Notebooks in Docker

#datascience #docker #dataengineering #programming
9
Comments 1
3 min read
loading...