Hybrid and Multicloud Architecture with Apache Kafka

About This Course

Most organizations today are a mix of cloud and on-premise systems. Many have come about piecemeal as cloud providers have been added as different departments move to the cloud, retain their on-premise legacy systems, or as new companies are acquired and their infrastructure is integrated. Streaming data provides a mechanism to join systems asynchronously so they can handle long distances, high latency, or unpredictable connections with relative ease. These two transitions, while relatively new, have the potential to be some of the most impactful and important shifts in the industry in a long time.

Customers expect our systems to work unilaterally - wherever the servers are located. Data should be accessible to everyone that needs it no matter where they or the systems are located. In this course, we’ll cover the things you need to be successful in building real-time multicloud and hybrid-cloud systems. Systems that span continents and clouds. There are three tools that can achieve this: the open-source MirrorMaker 2, Confluent Replicator, and Cluster Linking.

We'll talk about the benefits and considerations that need to be made with each one and then configure a local instance of MirrorMaker 2 and a cloud cluster using Cluster Linking.

Intended Audience

• You are familiar with the basic concepts of a publish/subscribe system such as:
  • Topics
  • Producers
  • Consumers
• You may have never used Kafka
• Have a need or desire to replicate your data

Course Outline

1. Introduction to Hybrid and Multicloud Architecture
2. Setup Confluent Cloud - Exercise
3. Understanding Hybrid and Multicloud Architectures
4. Cluster Linking
5. MirrorMaker 2
6. Confluent Replicator
7. Use Cases for Hybrid and Multicloud Architectures
8. High Availability and Disaster Recovery with Cluster Linking
9. Configuring Cluster Linking - Exercise
10. Configuring MirrorMaker 2 - Exercise
11. Configuring a Global Hybrid Architecture - Challenge
12. Additional Resources

Prerequisites

• Required Setup
  • A machine that can run a Docker container for the MirrorMaker 2 hands-on

Length

• Approximately 2 hours

Staff

Dan Weston (Course Author)

Dan Weston is a senior curriculum developer at Confluent and has been building technical training for over 15 years. He previously worked as a senior manager of production at LinkedIn Learning, focusing on their technology library. He enjoys spending time with his family, especially when it involves cooking delicious food.

Connect on LinkedIn