Exploring the World of Message Brokers: A Deep Dive into Kafka.pdf

Message Brokers are the backbone of applications leveraging microservices architecture.

In this Tech Talk sponsored by Bractlet I explore the fundamentals of message brokers and Kafka.

Some of the topics that are covered:
- Business and Technology Evolve Together
- What is a Message Broker?
- Kafka: The Powerhouse Message Broker and its main components
- When Should You Use Kafka?
- Real-World Use of Kafka

3. How business & tech evolve
How systems communicate?
What is a message broker?
When should you use Kafka?
Kafka 101
Conclusion
Questions
01
02
03
04
05
06
07

4. Where are applications born?
Domain-Driven Design
Domain
Sub-domain
Bounded-Context
Domain model

5. Monoliths
Microservices
Common data layer
Common codebase
Communicate through function calls
Standalone subdomain apps
Decoupled communication
Event is source of truth

7. QUEUING

9. NOT FRANZ,
BUT HAS THE SAME CONCERNS

10. "I AM CONSTANTLY TRYING TO COMMUNICATE
SOMETHING INCOMMUNICABLE,
TO EXPLAIN SOMETHING INEXPLICABLE,
TO TELL ABOUT SOMETHING I ONLY FEEL IN MY
BONES AND WHICH CAN ONLY BE EXPERIENCED
IN THOSE BONES."

11. Apache Kafka is an open-source distributed event
streaming platform used by thousand of companies
for high-performance data pipelines, streaming
analytics, data integration, and mission-critical
applications

12. 01
Organizes how data
moves around
Sits between all systems
Handle huge amounts of
data and throughput
THE ARCHITECT

13. Organizes how data
moves around
Sits between all systems
Handle huge amounts of
data and throughput
THE ARCHITECT
01 02
The supermarket
Contains specialized
aisles
CLUSTER
03 04
Producers supply products
to specific aisles
Consumers
consume/subscribe
products they want
PRODUCERS &
CONSUMERS
Topics are aisles
Each aisle has a specific
type of product
Aisles have many shelves
TOPICS &
PARTITIONS

20. Building Event-Driven Microservices: Leveraging
Organizational Data at Scale. O'Reilly - Adam Bellemare
Kafka The Definitve Guide: Real-Time Data and Stream Processing at Scale
O'Reilly - Gwen Shapira, Todd Palino, Rajini Sivaram & Krit Petty
https://www.reddit.com/r/apachekafka/comments/oxvu2e/new_confluent_developer_the_onestop_shop_for/

25. The medium is the message.
-Marshall McLuhan