Today Kafka Summit Bangalore takes place! Engineers, architects, and data professionals of many different disciplines have poured their energy into crafting useful and entertaining talks for delivery. “Break a leg” to all those speaking today!

If you’ve got FOMO… Kafka Summit London happened earlier this year, and we’re happy to announce that the session recordings are now available online. We’ve highlighted a few of our favorites in this newsletter. The topics range from the fundamentals to the tricky bits, and we’re sure that if you give any one of them a listen it’ll result in a lightbulb moment for you.

In other news, Confluent is now on Medium! Read blog posts by engineers and other data professionals who leverage their experience at Confluent to help you understand streaming better. We’ve also got two brand new Apache Flink® SQL demos to help you deepen your Flink SQL fundamentals—check them out in the Flink resources section below.

Without further ado…

Apache Kafka® Resources:

• KSL24: Apache Kafka®’s Common Pitfalls and Intricacies – Engineers with experience using Kafka in production share some gnarly stories to help you avoid the traps they’ve seen their customers fall into
• KSL24: Brick by Brick: Exploring the Elements of Apache Kafka – Danica Fine explains the fundamentals of Apache Kafka using a familiar (and fun!) analogy
• KSL24: Error Handling with Kafka – Cedric Schaller outlines how to apply design patterns to real-life scenarios that require error handling with Kafka
• KSL24: Mastering Kafka Consumer Distribution – Olena Kutsenko informs us of best practices with respect to consumer scaling and rebalancing and gives us the tools to accomplish them
• KSL24: Fish Plays Pokemon – Shritesh Jamilkar shows us how to integrate Kafka with an IoT device attached to… a fish!
• Chris Riccomoni takes us on a quick spin through Kafka Topic Naming Conventions and gives his recommendations

Apache Flink® Resources:

• Two new Flink SQL demos for you to play with! Launch a Kafka connector in Confluent Cloud to scrape live air traffic data, and then use Flink SQL to create a clean, governed, shareable data stream in Kafka with this demo. Then, in this demo, learn how to use Kafka & FlinkSQL in tandem with Confluent Cloud to store and process data before surfacing to Streamlit for data visualization.
• KSL24: Lace Up: Take Your First Steps with Flink SQL – Shindy Lall and Jan Svobody equip us with FlinkSQL fundamental know-how!
• KSL24: Timing is Everything – get the low-down on event time processing in FlinkSQL from Sharon Xie
• KSL24: Windowing in KStreams and Flink SQL – Bill Bejeck reviews the fundamentals of of windowing streaming data and compares and contrasts the types of windowing in the two different streaming methods
• KSL24: Code-first Approach: Crafting Efficient Flink Apps – DeVaris Brown shows us the benefits of using a code-first approach to using Flink
• Making Sense of Flink: A Fearless Introduction – David Anderson walks us through the basics of Flink and leaves us with the confidence to try it ourselves
• Confluent’s Medium organization has launched! Read the first post, Flink SQL In Practice by Timo Walther

A Droplet from Stack Overflow:

Want to dive deep into what happens to Kafka topics after compaction? Read this StackOverflow question – the answer comes complete with a helpful diagram!

Got your own favorite Stack Overflow answer related to Flink or Kafka? Send it in to devx_newsletter@confluent.io!

Terminal Tip of the Week:

To go through pricing for confluent cloud for your cloud region without leaving your terminal, run:

confluent price list --cloud gcp --region us-east1

And the result will resemble:

           Metric          | Cluster Type | Availability | Network Type |           Price             
---------------------------+--------------+--------------+--------------+-----------
  CKU price                | Dedicated    | Multi zone   | Internet     | PRICE USD/CKU-hour        
   Cluster linking per-link | Dedicated    | Single zone  | Peered VPC   | PRICE USD/Link-hour         
  Kafka REST produce       | Basic        | Multi zone   | Internet     | PRICE USD/GB                
  Kafka read               | Dedicated    | Single zone  | Internet     | PRICE USD/GB                
  Kafka write              | Basic        | Multi zone   | Internet     | PRICE USD/GB                

Links From Around the Web:

• Computer History’s source code releases of MacPaint, QuickDraw, and more
• An interactive guide to cameras and lenses from Bartov Ciechanowski
• The Cloud Under the Sea: a story about the current state of internet infrastructure maintenance from The Verge

Upcoming Events:

Hybrid

• Current 2024 (Sep 17-18): The agenda for Current 2024 has been released. Check it out! Register here to attend.

In-person

• Kafka 3.7 arrive, Kafka 4.0 en vue (May 14): Talk by Frédérik Rouleau of Confluent in Lyon, FR.
• Apache Kafka and Apache Pinot (May 15): Danica Fine and Victor Gamov join forces to teach you about data streaming in Munich, DE.
• Kafka beyond the obvious (May 15): Mathias Frey offers an architect’s look at how we stream about our future
• Reactive Kafka/Windowing in Kafka Streams and Flink SQL/Book signing! (May 15): Bill Bejeck will cover topics for windowing in Kafka Streams and Flink SQL, plus first 40 registered attendees will receive a signed copy of his latest book, Kafka Streams in Action Second Edition!
• Kafka Streams Explained (May 21): Jonas Geiregat gives a hands-on explanation of Kafka Streams
• Navigating consumer lag in Kafka (May 23): Alberto Cruz shows us how to reduce lag from the administrator and consumer viewpoints in Barcelona, ES.
• Events to Insights: Building Real-Time Analytics Systems (May 25): Jayesh Asrani teaches us about realtime data analytics in Mumbai
• Data enrichment patterns with Apache Flink (June 5): Subham Rakshit from AWS will speak on enriching streaming data on June 5 at Community Over Code in Bratislava, Slovakia.

By the way…

We hope you enjoyed our curated assortment of resources! If you’d like to provide feedback, suggest ideas for content you’d like to see, or you want to submit your own resource for consideration, email us at devx_newsletter@confluent.io! To view the content without subscribing, visit the Confluent Developer website.