May 2, 2019 | Episode 30

Load-Balanced Apache Kafka: Derivco’s Globally Distributed Gaming Business

  • Notes

Normally, an Apache Kafka® application lives close to its cluster, in the same datacenter or availability zone. It expects small latencies, and allows the Kafka client libraries to perform connection pool management and load balancing to the cluster through the regular Kafka partition management mechanisms. 

Life was not so simple for global gaming platform Derivco, who had to maintain central data infrastructure and application clusters in geographically diverse locations due to the heavily regulated nature of their business. In this episode, we talk about the challenges associated with that unusual but ingenious network architecture, along with other lessons they learned as they built their Kafka-centric gaming platform.

Continue Listening

Episode 31May 8, 2019 | 33 min

Ask Confluent #13: Machine Learning with Kai Waehner

Gwen and Kai chat about machine learning architectures, and whether software engineers and data science can learn to get along.

Episode 32May 16, 2019 | 50 min

Chris Riccomini on the History of Apache Kafka and Stream Processing

Chris Riccomini tells us how Apache Kafka® and the stream processing framework Samza came about, and also what he’s doing these days at WePay—building systems that use Kafka as a primary datastore.

Episode 33May 20, 2019 | 42 min

Testing Kafka Streams Applications with Viktor Gamov

Chris Riccomini tells us how Apache Kafka® and the stream processing framework Samza came about, and also what he’s doing these days at WePay—building systems that use Kafka as a primary datastore.

Got questions?

If there's something you want to know about Apache Kafka, Confluent or event streaming, please send us an email with your question and we'll hope to answer it on the next episode of Ask Confluent.

Email Us

Never miss an episode!

Be the first to get updates and new content

We will only share developer content and updates, including notifications when new content is added. We will never send you sales emails. 🙂 By subscribing, you understand we will process your personal information in accordance with our Privacy Statement.