Bulk onboard Databricks serving endpoints
Deeploy allows you to easily integrate your existing Databricks serving endpoints with minimal configuration. This bulk onboarding process creates external Deployments in Deeploy that connect to your Databricks models, enabling you to leverage Deeploy's governance, monitoring, and AI management capabilities while your models remain hosted on Databricks.
Prerequisites
Before starting the bulk onboarding process, ensure you have:
- A Databricks workspace with deployed serving endpoints
- Databricks access credentials (client ID and client secret)
Onboarding Process
1. Connect to Databricks
Navigate to Workspace → Integrations, and click Bulk onboard in the Databricks serving endpoints integration. Provide the following required information:
- Instance URL: Your Databricks workspace URL (e.g.,
https://adb-123456789012345.1.azuredatabricks.net
) - Client ID: The client ID for your Databricks workspace access
- Client Secret: The client secret for your Databricks workspace access
These credentials are only used to retrieve the list of available serving endpoints from Databricks.
2. Select Serving Endpoints
Once connected:
- Deeploy will display a list of all available serving endpoints from your Databricks workspace
- Select the serving endpoints you wish to onboard
- Click Onboard to create external Deployments for your serving endpoints
3. Configure Authentication
After onboarding, you'll need to configure authentication individually for each newly created external Deployment:
- Navigate to each created Deployment
- Go to the Details tab
- Under the Connection section, provide:
- Client ID: A client ID with access to the specific serving endpoint
- Client Secret: The corresponding client secret
For security best practices, use different client credentials for each Deployment than those used during the onboarding process. This allows for fine-grained access control to your Databricks endpoints.
Authentication Details
All Databricks serving endpoints are onboarded as external Deployments with the OAuth authentication method. For more information about external Deployment authentication methods, see the External Deployment Authentication documentation.