Intro
Kafka highly scalable event handling system that allows for managing incoming events in a microservices environment.
Main Concepts
- Generates a record of events on the systems hooked to it.
- Relays information and messages (events) to the services that need to know about them.
How it Works
Producers
These are entities that monitor for certain actions or circumstances (events) and then produce and publish a Kafka-Event that is forwarded to Kafka to notify and inform the relevant services.
Topics
These are different sections that act as queues for all the different services (topics). Each topic has a queue, this prevents different services from waiting in a single queue.
Consumers
These are the microservices that subscribe to the different topics and await Kafka to publish the events for them to handle. When a new event to a topic they’re subscribed to is added, the consumers are notified of it and respond accordingly.