Databricks integration

Databricks is a unified data and analytics platform for managing, transforming, and querying data at scale.

With this integration, you can connect to your Databricks workspace and perform SQL operations — such as importing, inserting, updating, upserting, or looking up rows — all directly from your Clay table.

Setting up the Databricks integration

1. While in a Clay table, click Add enrichment and search for Databricks.
2. Under Integrations, select one of the Databricks options.
3. In the modal, you will be asked to Select Databricks account.
   • If you haven't already connected your Databricks account, click + Add account and go through authentication.

Using the Databricks integration

Source Import from Databricks

Use this action to pull data from a Databricks table into Clay.

Inputs

• Databricks SQL warehouse
• SQL query

Action Lookup row

Use this action to check if a row exists in a Databricks table.

Inputs

• Databricks SQL warehouse
• SQL query

Action Insert row

Use this action to insert a new row into a Databricks table.

Inputs

• Databricks SQL warehouse
• Databricks catalog
• Databricks schema
• Databricks table
• Column values to insert

Action Update row

Use this action to update existing rows in a Databricks table.

Inputs

• Databricks SQL warehouse
• Databricks catalog
• Databricks schema
• Databricks table
• WHERE clause
• Column values to update

Action Upsert row

Use this action to insert or update a row in a Databricks table using a unique identifier.

Inputs

• Databricks SQL warehouse
• Databricks catalog
• Databricks schema
• Databricks table
• Unique key column
• Column values to insert or update

Run settings

• Auto-update
• Only run if: The enrichment will only run if conditions are met. (Learn more about conditional formulas here!)