Forem

# kafka

Discussions around Apache Kafka for building real-time data pipelines and streaming apps.

Posts

๐Ÿ‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
When Kafka Goes Kaiju: Building Monster-Scale Streaming Architectures
Cover image for When Kafka Goes Kaiju: Building Monster-Scale Streaming Architectures

When Kafka Goes Kaiju: Building Monster-Scale Streaming Architectures

Comments
7 min read
Fault-Tolerant Realtime Data Ingestion with QuestDB Write-Ahead Logs

Fault-Tolerant Realtime Data Ingestion with QuestDB Write-Ahead Logs

5
Comments
2 min read
From AWS Kinesis to Apache Kafka: Building a Real-Time Streaming Bridge
Cover image for From AWS Kinesis to Apache Kafka: Building a Real-Time Streaming Bridge

From AWS Kinesis to Apache Kafka: Building a Real-Time Streaming Bridge

1
Comments
7 min read
Kafka Backfill Patterns: A Guide to Accessing Historical Data

Kafka Backfill Patterns: A Guide to Accessing Historical Data

5
Comments
7 min read
Building a Spring Boot Application with Spring Cloud Stream for Kafka Stream Processing
Cover image for Building a Spring Boot Application with Spring Cloud Stream for Kafka Stream Processing

Building a Spring Boot Application with Spring Cloud Stream for Kafka Stream Processing

1
Comments
7 min read
Understanding Kafka Storage Architecture: How It Handles Billions of Messagesโšก
Cover image for Understanding Kafka Storage Architecture: How It Handles Billions of Messagesโšก

Understanding Kafka Storage Architecture: How It Handles Billions of Messagesโšก

1
Comments
7 min read
Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)
Cover image for Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)

Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)

Comments
3 min read
๐ŸŽฏ Apache Kafka Single-Node Practice Guide
Cover image for ๐ŸŽฏ Apache Kafka Single-Node Practice Guide

๐ŸŽฏ Apache Kafka Single-Node Practice Guide

1
Comments
4 min read
Understanding Kafka Complete Architecture Flow - Advanced๐ŸŽฏ
Cover image for Understanding Kafka Complete Architecture Flow - Advanced๐ŸŽฏ

Understanding Kafka Complete Architecture Flow - Advanced๐ŸŽฏ

2
Comments 1
6 min read
Good Things (Compression) Take Time!

Good Things (Compression) Take Time!

1
Comments
6 min read
๐Ÿง  Kafka Broker vs Controller - Complete Guide
Cover image for ๐Ÿง  Kafka Broker vs Controller - Complete Guide

๐Ÿง  Kafka Broker vs Controller - Complete Guide

1
Comments
5 min read
A new tool to automatically detect and fix common Apache Kafka issues (looking for feedback)

A new tool to automatically detect and fix common Apache Kafka issues (looking for feedback)

2
Comments
1 min read
Understanding Kafka Architecture - The Complete Mental Model ๐Ÿง 
Cover image for Understanding Kafka Architecture - The Complete Mental Model ๐Ÿง 

Understanding Kafka Architecture - The Complete Mental Model ๐Ÿง 

3
Comments 1
7 min read
Building a Simple Event-Driven Microservices System with Apache Kafka

Building a Simple Event-Driven Microservices System with Apache Kafka

3
Comments
2 min read
Making Kafka 7,658x slower for theย Lulz
Cover image for Making Kafka 7,658x slower for theย Lulz

Making Kafka 7,658x slower for theย Lulz

Comments
7 min read
๐Ÿšš ๐—Ÿ๐—ผ๐—ด๐—ถ๐˜€๐˜๐—ถ๐—ฐ๐˜€ ๐—ฅ๐—ผ๐˜‚๐˜๐—ฒ ๐—ข๐—ฝ๐˜๐—ถ๐—บ๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ โ€” ๐—ฏ๐˜‚๐—ถ๐—น๐˜ (๐˜€๐—ฎ๐—ป๐—ฒ๐—น๐˜†) ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ

๐Ÿšš ๐—Ÿ๐—ผ๐—ด๐—ถ๐˜€๐˜๐—ถ๐—ฐ๐˜€ ๐—ฅ๐—ผ๐˜‚๐˜๐—ฒ ๐—ข๐—ฝ๐˜๐—ถ๐—บ๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ โ€” ๐—ฏ๐˜‚๐—ถ๐—น๐˜ (๐˜€๐—ฎ๐—ป๐—ฒ๐—น๐˜†) ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ

2
Comments
2 min read
Building a GlobalStream: Replication Challenges and Optimizations
Cover image for Building a GlobalStream: Replication Challenges and Optimizations

Building a GlobalStream: Replication Challenges and Optimizations

Comments
5 min read
๐Ÿšจ๐—™๐—ถ๐—ป๐—ฎ๐—ป๐—ฐ๐—ถ๐—ฎ๐—น ๐—™๐—ฟ๐—ฎ๐˜‚๐—ฑ ๐——๐—ฒ๐˜๐—ฒ๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฃ๐—ถ๐—ฝ๐—ฒ๐—น๐—ถ๐—ป๐—ฒ๐˜€ ๐—ถ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ โ€” ๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐——๐—ฒ๐—ณ๐—ฒ๐—ป๐˜€๐—ฒ ๐—ณ๐—ผ๐—ฟ ๐˜๐—ต๐—ฒ ๐— ๐—ผ๐—ฑ๐—ฒ๐—ฟ๐—ป ๐—™๐—ถ๐—ป๐—ง๐—ฒ๐—ฐ๐—ต ๐—ฆ๐˜๐—ฎ๐—ฐ๐—ธ

๐Ÿšจ๐—™๐—ถ๐—ป๐—ฎ๐—ป๐—ฐ๐—ถ๐—ฎ๐—น ๐—™๐—ฟ๐—ฎ๐˜‚๐—ฑ ๐——๐—ฒ๐˜๐—ฒ๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฃ๐—ถ๐—ฝ๐—ฒ๐—น๐—ถ๐—ป๐—ฒ๐˜€ ๐—ถ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ โ€” ๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐——๐—ฒ๐—ณ๐—ฒ๐—ป๐˜€๐—ฒ ๐—ณ๐—ผ๐—ฟ ๐˜๐—ต๐—ฒ ๐— ๐—ผ๐—ฑ๐—ฒ๐—ฟ๐—ป ๐—™๐—ถ๐—ป๐—ง๐—ฒ๐—ฐ๐—ต ๐—ฆ๐˜๐—ฎ๐—ฐ๐—ธ

2
Comments
2 min read
AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines

AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines

Comments
4 min read
Building a Mini Kafka in Go โ€” My Journey Creating go-pub-sub
Cover image for Building a Mini Kafka in Go โ€” My Journey Creating go-pub-sub

Building a Mini Kafka in Go โ€” My Journey Creating go-pub-sub

3
Comments
4 min read
๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐˜€๐—ฝ๐—ผ๐—ฟ๐˜๐˜€ ๐—ฎ๐—ป๐—ฎ๐—น๐˜†๐˜๐—ถ๐—ฐ๐˜€ ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ + ๐—”๐—ฝ๐—ฎ๐—ฐ๐—ต๐—ฒ ๐—™๐—น๐—ถ๐—ป๐—ธ โ€” ๐˜๐—ต๐—ฒ ๐˜€๐˜๐—ฎ๐—ฐ๐—ธ ๐˜๐—ต๐—ฎ๐˜ ๐˜๐˜‚๐—ฟ๐—ป๐˜€ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ด๐—ฎ๐—บ๐—ฒ๐˜€ ๐—ถ๐—ป๐˜๐—ผ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ฑ๐—ฒ๐—ฐ๐—ถ๐˜€๐—ถ๐—ผ๐—ป๐˜€.

๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐˜€๐—ฝ๐—ผ๐—ฟ๐˜๐˜€ ๐—ฎ๐—ป๐—ฎ๐—น๐˜†๐˜๐—ถ๐—ฐ๐˜€ ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ + ๐—”๐—ฝ๐—ฎ๐—ฐ๐—ต๐—ฒ ๐—™๐—น๐—ถ๐—ป๐—ธ โ€” ๐˜๐—ต๐—ฒ ๐˜€๐˜๐—ฎ๐—ฐ๐—ธ ๐˜๐—ต๐—ฎ๐˜ ๐˜๐˜‚๐—ฟ๐—ป๐˜€ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ด๐—ฎ๐—บ๐—ฒ๐˜€ ๐—ถ๐—ป๐˜๐—ผ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ฑ๐—ฒ๐—ฐ๐—ถ๐˜€๐—ถ๐—ผ๐—ป๐˜€.

1
Comments
2 min read
Demystifying Confluent's Schema Registry Wire Format
Cover image for Demystifying Confluent's Schema Registry Wire Format

Demystifying Confluent's Schema Registry Wire Format

Comments
13 min read
Understanding Kafka Lag: Causes and How to Reduce It
Cover image for Understanding Kafka Lag: Causes and How to Reduce It

Understanding Kafka Lag: Causes and How to Reduce It

Comments
5 min read
Kafka Self-Healing Cluster:

Kafka Self-Healing Cluster:

Comments 1
2 min read
๐Ÿ”ฅ ๐—”๐—ฑ-๐—ง๐—ฒ๐—ฐ๐—ต ๐—”๐˜‚๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ ๐—ฎ๐˜ ๐—ฆ๐—ฐ๐—ฎ๐—น๐—ฒ โ€” ๐—•๐˜‚๐—ถ๐—น๐˜ ๐—ผ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ ๐— ๐—ถ๐—ฐ๐—ฟ๐—ผ๐˜€๐—ฒ๐—ฟ๐˜ƒ๐—ถ๐—ฐ๐—ฒ๐˜€

๐Ÿ”ฅ ๐—”๐—ฑ-๐—ง๐—ฒ๐—ฐ๐—ต ๐—”๐˜‚๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ ๐—ฎ๐˜ ๐—ฆ๐—ฐ๐—ฎ๐—น๐—ฒ โ€” ๐—•๐˜‚๐—ถ๐—น๐˜ ๐—ผ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ ๐— ๐—ถ๐—ฐ๐—ฟ๐—ผ๐˜€๐—ฒ๐—ฟ๐˜ƒ๐—ถ๐—ฐ๐—ฒ๐˜€

2
Comments
2 min read
loading...