Create Confluent Kafka connection

To create a connection to your system, follow these steps:

1. Navigate to Settings  > Data Ingestion > Connections.
2. In the top-right corner, click New connection, find your system, and click Connect.

General configuration

In the general connection configuration step:

1. Nameyour connection for easier identification in Dawiso.
   • Use a unique and descriptive name like the combination of the server name and your local environment naming (e.g., server1_prod).
2. Provide a description (purpose of the connection).
3. Select a Connection type.
   • Shared: Source is accessible from the public internet and you can share your credentials with Dawiso.
   • Private: Source is not accessible from the public internet and you cannot share your credentials with Dawiso. For more information, see the Create a private connection article.
4. Click Next.

Cluster and schema configuration

To configure your cluster, provide the following information:

1. Endpoint: The REST endpoint URL of your cluster.
2. Cluster Name: Name of your cluster.
3. Authentication credentials:
   1. API Key: API key of your Confluent Kafka Cloud or Service account. For more information, see Prepare for Confluent Kafka integration.
   2. API Secret: Secret to your API key.

To configure your schema, provide the following information:

1. Endpoint: URL of your environment.
2. Authentication credentials:
   1. API Key: API key of your schema registry. For more information, see Prepare for Confluent Kafka integration.
   2. API Secret: Secret to your schema registry API key.

Optional and additional settings

[Optional steps] Configure Optional and Additional Settings for your connection:

• Optional settings: Specify options supported by the provider in JSON format.
• Additional Settings: Recommended to leave empty unless our Dawiso support team suggests otherwise. Here, you can add a JSON formatted list of additional settings for troubleshooting or advanced connection configuration.

When adding optional settings, make sure the value is in a valid JSON.

Test and save connection

If your connection is shared, click on Test connection and wait for a few seconds.

• If successful, there will be a green checkmark next to the button.
• In case of failure, there will be a red error icon. Hover over it for a detailed error message. For more information, see the troubleshooting section. You will still be able to save your connection.

Finally, Save the connection and proceed to the next step: using the connection to create a data source. During this process, you will specify what metadata to ingest.