Listen to Tim Berglund and guests unpack a variety of topics surrounding Apache Kafka®, Confluent, real-time data streaming, and the cloud.
Building a large, stateful Kafka Streams application that tracks the state of each outgoing email is crucial to marketing automation tools like Mailchimp. Joining us today in this episode, Mitch Seymour, staff engineer at Mailchimp, shares how ksqlDB and Kafka Streams handle the company’s largest source of streaming data.
Availability in Kafka Streams is hard, especially in the face of any changes. Apache Kafka Committer and Kafka Streams developer Sophie Blee-Goldman shares about how to solve the stop-the-world rebalance and scaling out problem in Kafka Streams using probing rebalances.
Matthias J. Sax is back to discuss how event streaming has changed the game, making time management more simple yet efficient. He explains what watermarking is, the reasons behind why Kafka Streams doesn’t use them, and an alternative approach to watermarking informally called the “slack time approach.”
Apache Kafka® Committer Matthias J. Sax explains fault tolerance, high-availability stream processing, and Kafka Streams. He explains the differences between changelogging and checkpointing, as well as making changes in Kafka versus hot standbys, explaining what qualifies nodes as a hot standby, why Kafka Streams doesn’t do watermarking, and finally, why Kafka Streams is a library and not infrastructure.
There’s something about YAML and the word “Docker” that doesn’t sit well with Viktor Gamov (Developer Advocate, Confluent), but Kafka Streams on Kubernetes is a phrase that does. Viktor describes what that process looks like and how Jib helps build, test, and deploy Kafka Streams applications on Kubernetes for an improved DevOps experience.
Tim Berglund is a teacher, author, and technology leader with Confluent, where he serves as the senior director of developer advocacy. He can frequently be found at speaking at conferences in the U.S. and all over the world. Tim is the co-presenter of various O'Reilly training videos on topics ranging from Git to distributed systems, and he is the author of "Gradle Beyond the Basics." He lives in Littleton, CO, U.S., with the wife of his youth.
If there's something you want to know about Apache Kafka, Confluent or event streaming, please send us an email with your question and we'll hope to answer it on the next episode of Ask Confluent.Email Us
We will only share developer content and updates, including notifications when new content is added. We will never send you sales emails. 🙂 By subscribing, you understand we will process your personal information in accordance with our Privacy Statement.