Get Started Free
course: Confluent Cloud Networking

Hands On: Configuring a Cluster with Public Endpoints

11 min
dennis-wittekind

Dennis Wittekind

Customer Success Technical Architect (Presenter)

Configuring a Cluster with Public Endpoints

  1. Sign up for Confluent Cloud if you have not already done so and respond to the verification email to confirm your account.

  2. Log into Confluent Cloud.

confluent-cloud-sign-in

  1. Create an Environment called “Cloud-Networking.”

confuent-cloud-environment new-confluent-cloud-networking-environment cloud-networking-environment

  1. Click Create a cluster on my own, select a Basic cluster, and Begin configuration.

confluent-cloud-networking-create-cluster

  1. Select AWS as the cloud provider, then select a region and leave availability as Single zone, and click Continue.

confluent-cloud-networking-create-cluster

  1. Give the cluster the name “Public Endpoint Cluster” and click Launch cluster.

confluent-cloud-networking-create-launch-cluster

confluent-cloud-networking-you-are-all-done-creating-your-cluster

  1. Review the cluster networking. Click let me explore. Click Cluster overview, Networking.

confluent-cloud-networking-cluster-networking

Test connecting a client to a public cluster.

  1. First, get some data into a topic. We can use the Datagen source connector for this purpose. Click on Data integration, and Connectors.

confluent-cloud-networking-connectors

  1. Next, search for the Datagen Connector and select it.

confluent-cloud-networking-datagen-source-connector confluent-cloud-networking-add-datagen-source-connector

  1. Now create a topic by clicking Add a new topic, name the topic clickstream, and then click Create with defaults.

confluent-cloud-networking-add-new-topic

  1. Select the newly created topic and click Continue.

confluent-cloud-networking-add-datagen-source-connector

  1. For purposes of this demo, you will enable global access for our connector. In production, it is recommended to use service accounts and specify granular access. Be sure to save the API key and secret pair to a safe place as you will need it later. Click Generate API key and Download.

confluent-cloud-networking-add-datagen-source-connector-global-access

  1. Once you have the credential saved, click continue. Choose the Clickstream template and the output format of JSON and click Continue.

confluent-cloud-networking-clickstream-json

  1. Choose one task for the connector and click Continue.

confluent-cloud-networking-datagen-source-connector-topic-summary

  1. Leave the name as the default and click Launch.

confluent-cloud-networking-connectors-page

Set up a cloud environment to test connectivity.

  1. Log in to AWS console and Create a VPC.

confluent-cloud-networking-aws-console

confluent-cloud-networking-aws-vpc

confluent-cloud-networking-create-vpc

  1. Launch an instance in the VPC, for simulating client traffic.

confluent-cloud-networking-vpc-instance

confluent-cloud-networking-choose-an-ami

confluent-cloud-networking-choose-an-instance-type

confluent-cloud-networking-configure-instance-details

confluent-cloud-networking-add-storage

confluent-cloud-networking-configure-security-group

confluent-cloud-networking-review-instance-launch

  1. Select Key pair, and launch.

confluent-cloud-networking-launch-status

Download the confluent CLI to consume the records.

  1. Click CLI and Tools, then follow the instructions to install the CLI on your EC2 instance.

confluent-cloud-networking-cli-and-tools

  1. Set the environment and cluster, and store the API key for use in consumption.

confluent-cloud-networking-cli-promot-1

  1. Consume the clickstream data from your public endpoint cluster.

confluent-cloud-networking-cli-promot-2

Clean up.

  1. Delete the Datagen Connector by going to Data Integration -> Connectors, selecting the connector, and clicking delete. Confirm the deletion by entering the name of the connector.

confluent-cloud-networking-add-connectors-page

confluent-cloud-networking-data-source-connector-0

confluent-cloud-networking-connector-deletion

  1. Delete the API keys by clicking Data Integration -> API Keys. Select the API Key you created, click delete API key, and confirm the deletion.

confluent-cloud-networking-api-keys

confluent-cloud-networking-api-key-window

confluent-cloud-networking-confirm-api-key-deletion

  1. Delete the cluster. Click Cluster Overview -> Cluster Settings, then delete cluster. Enter the cluster name to confirm the deletion.

confluent-cloud-networking-cluster--settings

confluent-cloud-networking-confirm-deletion-page

Use the promo code NETWORKING101 to get $25 of free Confluent Cloud usage

Be the first to get updates and new content

We will only share developer content and updates, including notifications when new content is added. We will never send you sales emails. 🙂 By subscribing, you understand we will process your personal information in accordance with our Privacy Statement.