Forem

# kafka

Discussions around Apache Kafka for building real-time data pipelines and streaming apps.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
From AWS Kinesis to Apache Kafka: Building a Real-Time Streaming Bridge
Cover image for From AWS Kinesis to Apache Kafka: Building a Real-Time Streaming Bridge

From AWS Kinesis to Apache Kafka: Building a Real-Time Streaming Bridge

Comments
7 min read
Popular tools used in ETL/ELT workflows

Popular tools used in ETL/ELT workflows

Comments
2 min read
Optimizing Kafka Tracing with OpenTelemetry: Boost Visibility & Performance
Cover image for Optimizing Kafka Tracing with OpenTelemetry: Boost Visibility & Performance

Optimizing Kafka Tracing with OpenTelemetry: Boost Visibility & Performance

Comments
6 min read
Kafka MCP Server: Building a Real-Time Message Processing Integration

Kafka MCP Server: Building a Real-Time Message Processing Integration

Comments
12 min read
Building a Spring Boot Application with Spring Cloud Stream for Kafka Stream Processing
Cover image for Building a Spring Boot Application with Spring Cloud Stream for Kafka Stream Processing

Building a Spring Boot Application with Spring Cloud Stream for Kafka Stream Processing

1
Comments
7 min read
Building Event-Driven Microservices with Apache Kafka: A Practical Architecture for High-Scale Platforms

Building Event-Driven Microservices with Apache Kafka: A Practical Architecture for High-Scale Platforms

Comments
3 min read
Orchestrating Complex Processes in Node.js with @jescrich/nestjs-workflow

Orchestrating Complex Processes in Node.js with @jescrich/nestjs-workflow

Comments
3 min read
Understanding Kafka Lag: Causes and Mitigation Strategies
Cover image for Understanding Kafka Lag: Causes and Mitigation Strategies

Understanding Kafka Lag: Causes and Mitigation Strategies

Comments
4 min read
Building a Real-Time Crypto Data Pipeline with Debezium CDC
Cover image for Building a Real-Time Crypto Data Pipeline with Debezium CDC

Building a Real-Time Crypto Data Pipeline with Debezium CDC

Comments
5 min read
Did I just create the fastest BPMN engine in the world?

Did I just create the fastest BPMN engine in the world?

Comments
1 min read
Undestanding Kafka Lag, Why It Happens and How To Fix It.
Cover image for Undestanding Kafka Lag, Why It Happens and How To Fix It.

Undestanding Kafka Lag, Why It Happens and How To Fix It.

2
Comments
4 min read
Demystifying Confluent's Schema Registry Wire Format
Cover image for Demystifying Confluent's Schema Registry Wire Format

Demystifying Confluent's Schema Registry Wire Format

Comments
13 min read
Reducing Consumer Lag in Apache Kafka
Cover image for Reducing Consumer Lag in Apache Kafka

Reducing Consumer Lag in Apache Kafka

5
Comments
3 min read
Wednesday Links - Edition 2025-11-05

Wednesday Links - Edition 2025-11-05

Comments
2 min read
Integration Digest for October 2025
Cover image for Integration Digest for October 2025

Integration Digest for October 2025

Comments
12 min read
Learn Kafka by Doing: Build a 3-Broker Kafka Cluster with Docker Compose
Cover image for Learn Kafka by Doing: Build a 3-Broker Kafka Cluster with Docker Compose

Learn Kafka by Doing: Build a 3-Broker Kafka Cluster with Docker Compose

1
Comments
3 min read
⚡ How Kafka Stores Billions of Messages: The Storage Architecture Nobody Explains
Cover image for ⚡ How Kafka Stores Billions of Messages: The Storage Architecture Nobody Explains

⚡ How Kafka Stores Billions of Messages: The Storage Architecture Nobody Explains

1
Comments
7 min read
How to build real-time user-facing analytics with Kafka + Flink + Doris

How to build real-time user-facing analytics with Kafka + Flink + Doris

4
Comments
9 min read
JayNats: The Future of Message Brokers

JayNats: The Future of Message Brokers

Comments
5 min read
Docker Compose - Simple Kafka
Cover image for Docker Compose - Simple Kafka

Docker Compose - Simple Kafka

Comments
1 min read
Building a Mini Kafka in Go — My Journey Creating go-pub-sub
Cover image for Building a Mini Kafka in Go — My Journey Creating go-pub-sub

Building a Mini Kafka in Go — My Journey Creating go-pub-sub

1
Comments
4 min read
Fault-Tolerant Realtime Data Ingestion with QuestDB Write-Ahead Logs

Fault-Tolerant Realtime Data Ingestion with QuestDB Write-Ahead Logs

5
Comments
2 min read
Kafka Backfill Patterns: A Guide to Accessing Historical Data

Kafka Backfill Patterns: A Guide to Accessing Historical Data

5
Comments
7 min read
Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)
Cover image for Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)

Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)

Comments
3 min read
🎯 Apache Kafka Single-Node Practice Guide
Cover image for 🎯 Apache Kafka Single-Node Practice Guide

🎯 Apache Kafka Single-Node Practice Guide

1
Comments
4 min read
loading...