Discovering Streams

Overview

As our applications scale, one of the biggest challenges we face is finding the data streams we need. The experts on any given stream will be distributed across the business, and potentially across the globe. Even if we manage to locate the stream we need, knowing who is responsible for it might be almost impossible. However, it is critical that we are able to locate the streams containing specific data, especially if regulations are involved. There are no excuses for not being able to explain where we have used Personally Identifiable Information (PII). In this video, we will dive into the problem of stream discovery. We'll introduce the Confluent Stream Catalog which provides self-discovery tools that enable us to find the streams we need and locate the people responsible for them.

Topics:

• Stream Expertise
• Regulations
• Personally Identifiable Information (PII)
• Stream Metadata
• Confluent Stream Catalog

Resources

• Stream Catalog User Guide