Review Delta Lake table details with describe detail

You can retrieve detailed information about a Delta table (for example, number of files, data size) using DESCRIBE DETAIL.

DESCRIBE DETAIL '/data/events/'

DESCRIBE DETAIL eventsTable

For Spark SQL syntax details, see DESCRIBE DETAIL.

See the Delta Lake API documentation for Scala/Java/Python syntax details.

Detail schema

The output of this operation has only one row with the following schema.

Note

The columns you see depend on the Databricks Runtime version that you are using and the table features that you’ve enabled.

Column

Type

Description

format

string

Format of the table, that is, delta.

id

string

Unique ID of the table.

name

string

Name of the table as defined in the metastore.

description

string

Description of the table.

location

string

Location of the table.

createdAt

timestamp

When the table was created.

lastModified

timestamp

When the table was last modified.

partitionColumns

array of strings

Names of the partition columns if the table is partitioned.

numFiles

long

Number of the files in the latest version of the table.

sizeInBytes

int

The size of the latest snapshot of the table in bytes.

properties

string-string map

All the properties set for this table.

minReaderVersion

int

Minimum version of readers (according to the log protocol) that can read the table.

minWriterVersion

int

Minimum version of writers (according to the log protocol) that can write to the table.

statistics

map with string keys

Additional table-level statistics.

tableFeatures

array of strings

A list of the table features supported by the table. See How does Databricks manage Delta Lake feature compatibility?.

clusteringColumns

array of strings

The columns being used for liquid clustering. See Use liquid clustering for Delta tables

Below is an example of what the output looks like:

+------+--------------------+------------------+-----------+--------------------+--------------------+-------------------+----------------+--------+-----------+----------+----------------+----------------+
|format|                  id|              name|description|            location|           createdAt|       lastModified|partitionColumns|numFiles|sizeInBytes|properties|minReaderVersion|minWriterVersion|
+------+--------------------+------------------+-----------+--------------------+--------------------+-------------------+----------------+--------+-----------+----------+----------------+----------------+
| delta|d31f82d2-a69f-42e...|default.deltatable|       null|file:/Users/tuor/...|2020-06-05 12:20:...|2020-06-05 12:20:20|              []|      10|      12345|        []|               1|               2|
+------+--------------------+------------------+-----------+--------------------+--------------------+-------------------+----------------+--------+-----------+----------+----------------+----------------+