SQL Analytics release notes

Preview

This feature is in Public Preview. Contact your Databricks representative to request access.

SQL Analytics (Public Preview)

February 26, 2021

The new Power BI connector for Azure Databricks, released in public preview in September 2020, is now GA. It provides:

  • Simple connection configuration: the new Power BI Databricks connector is integrated into Power BI, and you configure it using a simple dialog with a couple of clicks.
  • Faster imports and optimized metadata calls, thanks to the new Databricks ODBC driver, which comes with significant performance improvements.
  • Access to Databricks data through Power BI respects Databricks table access control.

For more information, see Power BI.

February 25, 2021

  • Setting permissions on a SQL endpoint is now faster. It’s a step right after you create a new SQL endpoint and easily accessible when you edit an existing endpoint. See Create a SQL endpoint and Edit endpoint permissions.
  • To reuse visualization settings you can now duplicate a visualization. See Duplicate a visualization.
  • Query results are now stored in your account instead of the Databricks account.
  • To prevent leaking information by listing all defined permissions on an object, to run SHOW GRANTS [<user>] <object> you must be either:
    • A SQL Analytics administrator or the owner of <object>.
    • The user specified in [<user>].

January 07, 2021

  • To reduce spending on idle endpoints, new SQL endpoints now have Auto Stop enabled with a default timeout of two hours. After the timeout is reached, the endpoint is stopped. You can edit the timeout period or disable Auto Stop at any time.
  • Except for TEXT type query parameters, quotation marks are no longer added to query parameters. If you have used Dropdown List, Query Based Dropdown List, or any Date type query parameters, you must add quotation marks in order for the query to work. For example, if your query is SELECT {{ d }}, now this query must be SELECT '{{ d }}'.

November 18, 2020

Databricks is pleased to introduce the Public Preview of SQL Analytics, an intuitive environment for running ad-hoc queries and creating dashboards on data stored in your data lake. SQL Analytics empowers your organization to operate a multi-cloud lakehouse architecture that provides data warehousing performance with data lake economics while providing a delightful SQL analytics user experience. SQL Analytics:

  • Integrates with the BI tools you use today, like Tableau and Microsoft Power BI, to query the most complete and recent data in your data lake.
  • Complements existing BI tools with a SQL-native interface that allows data analysts and data scientists to query data lake data directly within Databricks.
  • Enables you to share query insights through rich visualizations and drag-and-drop dashboards with automatic alerting for important data changes.
  • Uses SQL endpoints to bring reliability, quality, scale, security, and performance to your data lake, so you can run traditional analytics workloads using your most recent and complete data.

See the Databricks SQL Analytics guide for details. Contact your Databricks representative to request access.

USAGE privilege

November 18, 2020

SQL Analytics introduces the USAGE privilege to simplify data access administration. In order to use an object in a database, you must be granted the USAGE privilege on that database in addition to any privileges you need to perform the action.

The USAGE privilege can be granted to databases or to the catalog.

For workspaces that already use table access control, the USAGE privilege is granted automatically to the users group on the root CATALOG.

See Data access control for details.

Known issues

December 1, 2020

  • Timestamp-like expressions such as now(), current_date(), and current_timestamp() may result in out-of-date cached results being returned.
  • Tableau Online users cannot connect to SQL endpoints.

November 18, 2020

  • Reads from data sources other than Delta Lake in multi-cluster load balanced SQL endpoints can be inconsistent.
  • Photon is disabled for writes (for example, CREATE TABLE AS SELECT).
  • When a user has Can Run permission on a query and runs it, if the query was created by another user, the query history displays the creator of the query—not the runner of the query—as the user.
  • Delta tables accessed in SQL Analytics upload their schema and table properties to the configured metastore. If you are using an external metastore, you will be able to see Delta Lake information in the metastore. Delta Lake tries to keep this information as up-to-date as possible on a best-effort basis. You can also use the DESCRIBE <table> command to ensure that the information is updated in your metastore.