Create Databricks connection

To create a connection to your system, follow these steps:

1. Navigate to Settings  > Data Ingestion > Connections.
2. In the top-right corner, click New connection, find your system, and click Connect.

General configuration

In the general connection configuration step:

1. Nameyour connection for easier identification in Dawiso.
   • Use a unique and descriptive name like the combination of the server name and your local environment naming (e.g., server1_prod).
2. Provide a description (purpose of the connection).
3. Select a Connection type.
   • Shared: Source is accessible from the public internet and you can share your credentials with Dawiso.
   • Private: Source is not accessible from the public internet and you cannot share your credentials with Dawiso. For more information, see the Create a private connection article.
4. Click Next.

Cluster configuration

In the cluster configuration step, provide the following information:

1. URL: URL of your Databricks cluster, e.g., cust-success.cloud.databricks.com.
2. Authentication credentials:
   1. Client ID: ID of your client. You can find the ID in the cluster URL after o= e.g., 123456789 from https:///?o=123456789.
   2. Client Secret: Secret to your client generated in Prepare for Databricks integration.

Optional and additional settings

[Optional steps] Configure Optional and Additional Settings for your connection:

• Optional settings: Specify options supported by the provider in JSON format.
• Additional Settings: Recommended to leave empty unless our Dawiso support team suggests otherwise. Here, you can add a JSON formatted list of additional settings for troubleshooting or advanced connection configuration.

When adding optional settings, make sure the value is in a valid JSON.

Test and save connection

If your connection is shared, click on Test connection and wait for a few seconds.

• If successful, there will be a green checkmark next to the button.
• In case of failure, there will be a red error icon. Hover over it for a detailed error message. For more information, see the troubleshooting section. You will still be able to save your connection.

Finally, Save the connection and proceed to the next step: using the connection to create a data source. During this process, you will specify what metadata to ingest.