SQL Analytics Release notes


This feature is in Public Preview. Contact your Databricks representative to request access.

SQL Analytics (Public Preview)

January 07, 2021

  • The Auto Stop setting on SQL endpoints is now On with a default value of 120 minutes.
  • Except for TEXT type query parameters, quotation marks are no longer added to query parameters. If you have used Dropdown List, Query Based Dropdown List, or any Date type query parameters, you must add quotation marks in order for the query to work. For example, if your query is SELECT {{ d }}, now this query must be SELECT '{{ d }}'.

November 18, 2020

Databricks is pleased to introduce the Public Preview of SQL Analytics, an intuitive environment for running ad-hoc queries and creating dashboards on data stored in your data lake. SQL Analytics empowers your organization to operate a multi-cloud lakehouse architecture that provides data warehousing performance with data lake economics while providing a delightful SQL analytics user experience. SQL Analytics:

  • Integrates with the BI tools you use today, like Tableau and Microsoft Power BI, to query the most complete and recent data in your data lake.
  • Complements existing BI tools with a SQL-native interface that allows data analysts and data scientists to query data lake data directly within Databricks.
  • Enables you to share query insights through rich visualizations and drag-and-drop dashboards with automatic alerting for important data changes.
  • Uses SQL endpoints to bring reliability, quality, scale, security, and performance to your data lake, so you can run traditional analytics workloads using your most recent and complete data.

See the Databricks SQL Analytics guide for details. Contact your Databricks representative to request access.

USAGE privilege

November 18, 2020

SQL Analytics introduces the USAGE privilege to simplify data access administration. In order to use an object in a database, you must be granted the USAGE privilege on that database in addition to any privileges you need to perform the action.

The USAGE privilege can be granted to databases or to the catalog.

For workspaces that already use table access control, the USAGE privilege is granted automatically to the users group on the root CATALOG.

See Data access control for details.

Known issues

December 1, 2020

  • Timestamp-like expressions such as now(), current_date(), and current_timestamp() may result in out-of-date cached results being returned.
  • Tableau Online users cannot connect to SQL endpoints.

November 18, 2020

  • Reads from data sources other than Delta Lake in multi-cluster load balanced SQL endpoints can be inconsistent.
  • Photon is disabled for writes (for example, CREATE TABLE AS SELECT).
  • When a user has Can Run permission on a query and runs it, if the query was created by another user, the query history displays the creator of the query—not the runner of the query—as the user.
  • Delta tables accessed in SQL Analytics upload their schema and table properties to the configured metastore. If you are using an external metastore, you will be able to see Delta Lake information in the metastore. Delta Lake tries to keep this information as up-to-date as possible on a best-effort basis. You can also use the DESCRIBE <table> command to ensure that the information is updated in your metastore.