Consuming Messages from a Topic

Overview

Producing messages to a Kafka topic isn't much use unless you can consume them later. This requires a Kafka Consumer to be implemented. They are responsible for handling the messages, but they don't control the format. Instead, they will need to read the data according to whatever schema it was published with. They will take that incoming data and deserialize it to a C# class or struct where it can be further processed. In this video, we'll see how to create and configure a consumer, as well as how to create a simple message processing loop.

Topics:

• Consumers
• Consumer Groups
• Scaling
• Configuration
• Creating Consumers with the Consumer Builder
• A simple Consumer loop
• Closing the Consumer

Resources

• Consumer Documentation
• Sample Consumer
• ConsumerConfig API Docs
• ConsumerBuilder API Docs
• IConsumer API Docs