Forem

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How to treat secure data on lakehouse
kination profile

How to treat secure data on lakehouse

#dataengineering #python #spark
1
Comments
3 min read
Building an Automated Weather Data Pipeline with Apache Kafka and Cassandra
katumo profile

Building an Automated Weather Data Pipeline with Apache Kafka and Cassandra

#dataengineering #data #apachekafka
12
Comments
10 min read
Understanding Data Pipelines: The Backbone of Modern Data Systems
rithesh_raj_dd0391f0ba889 profile

Understanding Data Pipelines: The Backbone of Modern Data Systems

#dataengineering #etl #python #gcp
1
Comments
3 min read
🚀 Building an ETL Pipeline with Python to Scrape Internship Jobs and Load into Excel
Cover image for 🚀 Building an ETL Pipeline with Python to Scrape Internship Jobs and Load into Excel
dkkinyua profile

🚀 Building an ETL Pipeline with Python to Scrape Internship Jobs and Load into Excel

#dataengineering #python #programming
2
Comments 2
4 min read
Stock Data Extraction Using Apache Kafka
Cover image for Stock Data Extraction Using Apache Kafka
milcah03 profile

Stock Data Extraction Using Apache Kafka

#apachekafka #python #cassandra #dataengineering
6
Comments
4 min read
Time of YAML/JSON for data engineer
kination profile

Time of YAML/JSON for data engineer

#dataengineering #programming #config
1
Comments
2 min read
Distributed Model Serving Patterns
iameminmammadov profile

Distributed Model Serving Patterns

#distributedsystems #mlops #machinelearning #dataengineering
1
Comments
4 min read
Building Automated Data Reports from Supabase with GitHub Actions and R Markdown
Cover image for Building Automated Data Reports from Supabase with GitHub Actions and R Markdown
akandee_ profile

Building Automated Data Reports from Supabase with GitHub Actions and R Markdown

#automation #analytics #dataengineering #tutorial
1
Comments
12 min read
"Our GPUs Are Melting": Building a Real-Time Streaming System with Go and Redpanda Ghibli Style
Cover image for "Our GPUs Are Melting": Building a Real-Time Streaming System with Go and Redpanda Ghibli Style
datasosneh profile

"Our GPUs Are Melting": Building a Real-Time Streaming System with Go and Redpanda Ghibli Style

#go #kafka #eventdriven #dataengineering
1
Comments
10 min read
🔬Public docker images Trivy scans as duckdb datas on Kaggle
Cover image for 🔬Public docker images Trivy scans as duckdb datas on Kaggle
adriens profile

🔬Public docker images Trivy scans as duckdb datas on Kaggle

#cybersecurity #dataengineering #jupyter #datascience
Comments 7
1 min read
Thinking about becoming a Data Engineer?
Cover image for Thinking about becoming a Data Engineer?
henryclapton profile

Thinking about becoming a Data Engineer?

#datascience #dataengineering
Comments
2 min read
Apache SeaTunnel 2.3.8 JDBC Connector Development Guide
seatunnel profile

Apache SeaTunnel 2.3.8 JDBC Connector Development Guide

#softwaredevelopment #bigdata #dataengineering
Comments
12 min read
🐼 Pandas Too Slow? Try These Fast Python Libraries for Data Analysis
aleksei_aleinikov profile

🐼 Pandas Too Slow? Try These Fast Python Libraries for Data Analysis

#python #dataengineering #pandas #bigdata
Comments
1 min read
Architecting High-Performance Data Pipelines with Modern ETL | Spiral Mantra
karankumar profile

Architecting High-Performance Data Pipelines with Modern ETL | Spiral Mantra

#dataengineering #cloud #performance #bigdata
Comments
1 min read
How to Optimize SQL Queries for Speed and Efficiency
Cover image for How to Optimize SQL Queries for Speed and Efficiency
bikodes profile

How to Optimize SQL Queries for Speed and Efficiency

#sql #sqlserver #database #dataengineering
3
Comments 2
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.