Join our hosts and guests from the community as they discuss the latest Apache Kafka®️ news, use cases, and trends spanning the topics of data streaming, microservices, modern IT architectures, and the cloud.
With experience in data infrastructure and distributed data technologies, author of the book “Designing Event-Driven Systems” Ben Stopford (Lead Technologist, Office of the CTO, Confluent) explains the data mesh paradigm, differences between traditional data warehouses and microservices, as well as how you can get started with data mesh.
The data mesh architectural paradigm shift is all about moving analytical data away from a monolithic data warehouse or data lake into a distributed architecture—allowing data to be shared for analytical purposes in real time, right at the point of origin. The idea of data mesh was introduced by Zhamak Dehghani (Director of Emerging Technologies, Thoughtworks) in 2019. Here, she provides an introduction to data mesh and the fundamental problems that it’s trying to solve.
During his time at Twitter, Sam Ritchie led the development of Summingbird, a project that helped Twitter ingest and process massive amounts of data, relieving some key pain points for developers at Twitter. In this episode, Sam dives teaches us some abstract algebra and explains how it has informed his attempts to make stream processing programs easy to write in a more general way.
James Urquhart (Global Field CTO, VMware) is writing a book about worldly mapping and evaluating user needs in order to make event streaming a more economic choice for users. James argues that reducing the cost of integration does not deter people from buying but instead encourages creativity to find more uses for integration.
Kent Beck chats about various topics of broad interest to developers, including some of his books. He shares about what it’s like to experiment and implement new ideas, especially when others doubt what you're trying to achieve, as well as the difference between refactoring and tidying, his involvement with agile software and test-driven development, and what exactly test-commit-revert is. And yes, Kent talks a little bit about event streaming too!
If there's something you want to know about Apache Kafka, Confluent or event streaming, please send us an email with your question and we'll hope to answer it on the next episode of Ask Confluent.
Email Us