September 2018

These features and Databricks platform improvements were released in September 2018.

Note

Releases are staged. Your Databricks account may not be updated until a week after the initial release date.

SCIM provisioning using Okta and Microsoft Entra ID (Preview)

September 26, 2018

You can now use Okta and Microsoft Entra ID to provision users and groups with Databricks and deprovision them when they leave your organization or no longer need access to Databricks.

This feature is in Preview. See Sync users and groups from your identity provider.

EBS leaked volumes deletion

September 25 - October 2, 2018: Version 2.81

Whenever a Databricks cluster instance terminates, AWS should automatically delete all EBS volumes associated with the cluster. Unfortunately, if an instance dies during start-up, the EBS volumes never get attached to the instance, and AWS never cleans up the volumes. The AWS support team has confirmed that they are working on a fix for this bug, but they have not provided an ETA. With this release, Databricks now automatically deletes all leaked EBS volumes, including volumes leaked before this release.

Support for r5 instances

September 25 - October 2, 2018: Version 2.81

Databricks now supports the r5 family of AWS instance types.

SCIM API for provisioning users and groups (Preview)

September 11-18, 2018: Version 2.80

Databricks now supports SCIM, or System for Cross-domain Identity Management, an open standard that allows you to automate user provisioning using a REST API and JSON. SCIM lets you use an identity provider to create users in Databricks and give them the proper level of access, as well as remove access for users (deprovision them) when they leave your organization or no longer need access to Databricks.

This feature is in Preview. See Groups API.