Dataengineering Page 43

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Cover image for Stop Re-running Everything: A Local Incremental Pipeline in DuckDB

Marko

Jan 10

Stop Re-running Everything: A Local Incremental Pipeline in DuckDB

#python #dataengineering #sql #duckdb

4 min read

Hello Arisyn

Feb 13

Why NL2SQL Breaks in Production (And How Data Correlation Fixes It)

#nl2sql #datacorrelation #largelanguagemodels #dataengineering

2 min read

Cover image for Data Is Not a Department — It’s a Decision Architecture

Fady Desoky Saeed Abdelaziz

Feb 13

Data Is Not a Department — It’s a Decision Architecture

#dataengineering #systemthinking #enterprisearchitecture #processoptimization

2 min read

Vinicius Fagundes

Jan 11

Real-Time is an SLA, Not an Architecture: When You Actually Need Kafka (And When You Don't)

#discuss #architecture #dataengineering #career

10 min read

Beck_Moulton

Jan 14

From Raw DNA to Deep Insights: Building a Personal Genomics RAG with LangChain and PubMed

#rag #bioinformatics #dataengineering #python

4 min read

Aki for AWS Community Builders

Jan 31

S3 Triggers: How to Launch Glue Python Shell via AWS Lambda

#aws #dataengineering #etl #lambda

8 min read

Hello Arisyn

Feb 11

Why NL2SQL Fails Without Relationship Graphs And How Arisyn Makes NL2SQL Actually Work

#ai #dataengineering #database #nlp

3 min read

yuer

Jan 8

When Factor Libraries Meet Real-World Execution Constraints

#architecture #dataengineering #softwareengineering

2 min read

Cover image for Apache Airflow for Production: Essential Concepts Every Developer Should Know

Data Tech Bridge

Jan 8

Apache Airflow for Production: Essential Concepts Every Developer Should Know

#airflow #dataengineering #developer

16 min read

Marwa Ahmed

Feb 10

How I Redesigned a Failing Data Pipeline to Eliminate Cascading Failures

#aws #eventdriven #dataengineering #terraform

9 min read

Hello Arisyn

Feb 10

Why Data Integration Still Feels Manual (And What We’re Missing)

#dataengineering #dataintegration #dataarchitecture #ai

3 min read

Saurav Kumar

Jan 7

Building a Government Tender Intelligence System with Python: Lessons from the Real World

#architecture #dataengineering #datascience #python

4 min read

srujan G

Feb 10

Data Engineering: The Backbone of Structured Data

#bestofdev #dataengineering #learning

3 min read

Cover image for Stop Writing Regex for Data You Should Be Describing in English

Rafael Poyiadzi

Feb 10

Stop Writing Regex for Data You Should Be Describing in English

#showdev #python #ai #dataengineering

4 min read

Rafael Poyiadzi

Feb 10

Stop Writing Regex for Data You Should Be Describing in English

#showdev #python #ai #dataengineering

4 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Forem

# dataengineering

Stop Re-running Everything: A Local Incremental Pipeline in DuckDB

Why NL2SQL Breaks in Production (And How Data Correlation Fixes It)

Data Is Not a Department — It’s a Decision Architecture

Real-Time is an SLA, Not an Architecture: When You Actually Need Kafka (And When You Don't)

From Raw DNA to Deep Insights: Building a Personal Genomics RAG with LangChain and PubMed

S3 Triggers: How to Launch Glue Python Shell via AWS Lambda

Why NL2SQL Fails Without Relationship Graphs And How Arisyn Makes NL2SQL Actually Work

When Factor Libraries Meet Real-World Execution Constraints

Apache Airflow for Production: Essential Concepts Every Developer Should Know

How I Redesigned a Failing Data Pipeline to Eliminate Cascading Failures

Why Data Integration Still Feels Manual (And What We’re Missing)

Building a Government Tender Intelligence System with Python: Lessons from the Real World

Data Engineering: The Backbone of Structured Data

Stop Writing Regex for Data You Should Be Describing in English

Stop Writing Regex for Data You Should Be Describing in English