Skip to main content

Build AI/BI dashboards on Lakehouse Real-Time

Beta

Lakehouse Real-Time (Lakehouse//RT) is in Beta and under active development. Performance characteristics and the supported feature set can change. To enable it in your account, contact your Databricks account team.

You can use a Lakehouse//RT warehouse to power AI/BI dashboards that require sub-second responses. Use Lakehouse//RT to build new dashboards that fit within the limitations. Migrating an existing dashboard isn't recommended, because existing dashboards often depend on functionality that Lakehouse//RT doesn't support, such as Genie, external tables, or metric view materialization.

When to use Lakehouse//RT for dashboards​

Lakehouse//RT delivers sub-second latency for selective queries that read a small amount of data. It doesn't accelerate expensive queries, such as those that scan large amounts of data or join many large tables.

The Lakehouse//RT guardrails enforce hard limits rather than degrading gracefully, so prepare your workloads before you move them to a Lakehouse//RT warehouse:

  • Optimize expensive queries by filtering early so they scan less data.
  • Pre-aggregate results with materialized views when a dashboard reads far less data than it scans.

Set up a dashboard on a Lakehouse//RT warehouse​

To publish an AI/BI dashboard that runs on Lakehouse//RT, create the warehouse and select it as the dashboard's warehouse:

  1. Create a Lakehouse//RT warehouse, the same as any other SQL warehouse. See Lakehouse Real-Time.
  2. Grant users Can use or higher on the warehouse. The warehouse then appears in the dashboard authoring compute picker for those users.
  3. In your dashboard, select the Lakehouse//RT warehouse as the dashboard's warehouse.
  4. Publish the dashboard as usual.

Guardrails​

Lakehouse//RT enforces per-query resource limits. A dashboard query that exceeds a guardrail returns an error instead of running slowly, so design widget queries to stay well within the limits. For the limits and their values, see Guardrails.

Limitations​

Dashboards on a Lakehouse//RT warehouse inherit all Lakehouse//RT limitations, including support for Unity Catalog managed tables only and ANSI-compliant SELECT queries only. Convert other table types, such as external tables, to managed tables before you query them.

The following limitations are specific to dashboards published with a Lakehouse//RT warehouse:

  • Genie, including Genie Agents, is not supported.
  • Materialization of local metric views is not supported.

Get help​

If you continue to experience issues with a dashboard on Lakehouse//RT, see Troubleshooting. When you contact Databricks support, include a link to your dashboard.