Forem

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
My First Data Pipeline Project Using Airflow, Docker & Postgres (COVID API Edition)
Cover image for My First Data Pipeline Project Using Airflow, Docker & Postgres (COVID API Edition)
mohhddhassan profile

My First Data Pipeline Project Using Airflow, Docker & Postgres (COVID API Edition)

#dataengineering #postgres #airflow #docker
6
Comments
2 min read
A Practical Guide to MLOps on AWS: Transforming Raw Data into AI-Ready Datasets with AWS Glue (Phase 02)
mohsinsheikhani profile

A Practical Guide to MLOps on AWS: Transforming Raw Data into AI-Ready Datasets with AWS Glue (Phase 02)

#aws #cloud #mlops #dataengineering
1
Comments 2
8 min read
How Excel is Used in Real-World Data Analysis
giddybyt profile

How Excel is Used in Real-World Data Analysis

#dataengineering #datascience #beginners #data
3
Comments
3 min read
A Practical Guide to MLOps on AWS: Streaming Data Ingestion with Kinesis Firehose (Phase 01)
mohsinsheikhani profile

A Practical Guide to MLOps on AWS: Streaming Data Ingestion with Kinesis Firehose (Phase 01)

#aws #serverless #mlops #dataengineering
Comments 2
8 min read
#34 50 Advanced SQL Queries Every Developer Should Know
Cover image for #34 50 Advanced SQL Queries Every Developer Should Know
flnzba profile

#34 50 Advanced SQL Queries Every Developer Should Know

#sql #database #dataengineering
2
Comments
7 min read
Setting Up Presto with Apache Superset using Docker 🐳 : Hands-On Guide
Cover image for Setting Up Presto with Apache Superset using Docker 🐳 : Hands-On Guide
saurabhmahawar profile

Setting Up Presto with Apache Superset using Docker 🐳 : Hands-On Guide

#opensource #datascience #presto #dataengineering
Comments 2
3 min read
Understanding Consistency in PostgreSQL: A Deep Dive into the “C” in ACID
kfir-g profile

Understanding Consistency in PostgreSQL: A Deep Dive into the “C” in ACID

#dataengineering #postgres #consistency #softwareengineering
1
Comments
3 min read
What I Learned Cleaning 1 Million Rows of CSV Data Without Pandas
Cover image for What I Learned Cleaning 1 Million Rows of CSV Data Without Pandas
abrar_ahmed profile

What I Learned Cleaning 1 Million Rows of CSV Data Without Pandas

#csv #node #backend #dataengineering
5
Comments
2 min read
Building My First Real-Time Dashboard with ClickHouse and Streamlit: TrendLite Breakdown
Cover image for Building My First Real-Time Dashboard with ClickHouse and Streamlit: TrendLite Breakdown
mohhddhassan profile

Building My First Real-Time Dashboard with ClickHouse and Streamlit: TrendLite Breakdown

#clickhouse #dataengineering #python #streamlit
4
Comments
2 min read
From Reddit Trolls to Real-Time Analytics: Building an LLM-Powered Flink Deployment System
datasosneh profile

From Reddit Trolls to Real-Time Analytics: Building an LLM-Powered Flink Deployment System

#eventdriven #dataengineering #llm #go
3
Comments 1
7 min read
How to Handle Big Data Transformations Without Pandas (and My Favorite Workarounds)
Cover image for How to Handle Big Data Transformations Without Pandas (and My Favorite Workarounds)
abrar_ahmed profile

How to Handle Big Data Transformations Without Pandas (and My Favorite Workarounds)

#bigdata #dataengineering #node #machinelearning
5
Comments
3 min read
The Ultimate Linux Command Cheat Sheet for Data Engineers and Analysts
grayhat profile

The Ultimate Linux Command Cheat Sheet for Data Engineers and Analysts

#dataengineering #bash #datascience #python
88
Comments 4
4 min read
Interesting links - April 2025
rmoff profile

Interesting links - April 2025

#data #dataengineering #kafka #flink
Comments
6 min read
Building a Stock Data Pipeline with requests, Apache Airflow and PostgreSQL
Cover image for Building a Stock Data Pipeline with requests, Apache Airflow and PostgreSQL
dkkinyua profile

Building a Stock Data Pipeline with requests, Apache Airflow and PostgreSQL

#python #api #dataengineering #postgres
1
Comments
4 min read
The Underrated Soft Skills That Make Great Data Engineers
browsejobs profile

The Underrated Soft Skills That Make Great Data Engineers

#dataengineering #career #careerswitching
2
Comments 2
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.