Forem

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Agent Cost Optimization: A Data Engineer's Guide
hoshang_mehta profile

Agent Cost Optimization: A Data Engineer's Guide

#dataengineering #ai
Comments
13 min read
INTRODUCTION TO DBT(Data Build Tool)
john_analytics profile

INTRODUCTION TO DBT(Data Build Tool)

#dataengineering #data #analytics
1
Comments
2 min read
What's New in dbt 1.10
shammadahmed profile

What's New in dbt 1.10

#dbt #data #datascience #dataengineering
3
Comments
12 min read
The Day Our Pipeline Went From 10 Minutes to 6 Seconds (Part 2 of 3)
Cover image for The Day Our Pipeline Went From 10 Minutes to 6 Seconds (Part 2 of 3)
karthikeyan_rajasekaran_c profile

The Day Our Pipeline Went From 10 Minutes to 6 Seconds (Part 2 of 3)

#dataengineering #dbt #dagster #data
2
Comments
7 min read
How Strategic Image Cropping Transforms Data Ingestion Pipelines
Cover image for How Strategic Image Cropping Transforms Data Ingestion Pipelines
steravy profile

How Strategic Image Cropping Transforms Data Ingestion Pipelines

#dataengineering #machinelearning #performance
1
Comments
4 min read
Taming the Data Beast: Build Pipelines That Bend, Not Break by Arvind Sundararajan
arvind_sundararajan profile

Taming the Data Beast: Build Pipelines That Bend, Not Break by Arvind Sundararajan

#dataengineering #datascience #architecture #data
Comments
2 min read
Snowflake + Postgres: A Small Feature That Signals a Big Shift
Cover image for Snowflake + Postgres: A Small Feature That Signals a Big Shift
shrinivasv73 profile

Snowflake + Postgres: A Small Feature That Signals a Big Shift

#snowflake #postgres #database #dataengineering
Comments
6 min read
Data Quality at Scale: Why Your Pipeline Needs More Than Green Checkmarks
pradeep_kaalluri profile

Data Quality at Scale: Why Your Pipeline Needs More Than Green Checkmarks

#dataengineering #dataquality #bigdata #python
Comments
8 min read
Prompt Engineering Patterns: From Zero-Shot to Chain-of-Thought Reasoning
qvfagundes profile

Prompt Engineering Patterns: From Zero-Shot to Chain-of-Thought Reasoning

#ai #mcp #llm #dataengineering
1
Comments
14 min read
While We're Measuring Developer Productivity, Won't Someone Think of the Data Engineers?
aronchick profile

While We're Measuring Developer Productivity, Won't Someone Think of the Data Engineers?

#dataengineering #devrel #productivity #observability
Comments
9 min read
Behind the Scenes of Data Ingestion: How Small Issues Cause Big Headaches
Cover image for Behind the Scenes of Data Ingestion: How Small Issues Cause Big Headaches
rutikakhaire profile

Behind the Scenes of Data Ingestion: How Small Issues Cause Big Headaches

#dataingestion #medallion #dataengineering #datafactory
2
Comments 2
3 min read
Modern Data Pipelines: Why Five Layers Changed Everything (Part 1 of 3)
Cover image for Modern Data Pipelines: Why Five Layers Changed Everything (Part 1 of 3)
karthikeyan_rajasekaran_c profile

Modern Data Pipelines: Why Five Layers Changed Everything (Part 1 of 3)

#dataengineering #dbt #dagster #python
2
Comments
6 min read
Debugging Windows Race Conditions in Dagster
jongwan93 profile

Debugging Windows Race Conditions in Dagster

#devjournal #dataengineering #python #opensource
Comments
3 min read
Trying Out Dagster for Data Orchestration
Cover image for Trying Out Dagster for Data Orchestration
ybryzy profile

Trying Out Dagster for Data Orchestration

#dataengineering #python #programming
1
Comments
9 min read
🔐 Understanding Governance in Microsoft Fabric
Cover image for 🔐 Understanding Governance in Microsoft Fabric
sajjadrahman56 profile

🔐 Understanding Governance in Microsoft Fabric

#webdev #microsoft #dataengineering #tutorial
1
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.