Delta table properties reference
Delta Lake reserves Delta table properties starting with delta.
. These properties may have specific meanings, and affect behaviors when these
properties are set. Available Delta table properties include:
Property |
---|
See Table properties. Data type: Default: |
See Enable Auto Optimize. Data type: Default: (none) |
See Enable Auto Optimize. Data type: Default: (none) |
See Trade-offs with statistics in checkpoints. Data type: Default: |
See Trade-offs with statistics in checkpoints. Data type: Default: (none) |
Whether column mapping is enabled for Delta table columns and the corresponding Parquet columns that use different names. See Delta column mapping. Data type: Default: |
Data type: Default: |
The number of columns for Delta Lake to collect statistics
about for data skipping. A value of See Data skipping. Data type: Default: |
The shortest duration for Delta Lake to keep logically deleted data files before deleting them physically. This is to prevent failures in stale readers after compactions or partition overwrites. This value should be large enough to ensure that:
See Data retention. Data type: Default: |
Data type: Default: |
The degree to which a transaction must be isolated from modifications made by concurrent transactions. Valid values are See Isolation levels. Data type: Default: |
How long the history for a Delta table is kept. Each time a checkpoint is written, Delta Lake automatically cleans up log entries older than the retention interval. If you set this property to a large enough value, many log entries are retained. This should not impact performance as operations against the log are constant time. Operations on history are parallel but will become more expensive as the log size increases. See Data retention. Data type: Default: |
The minimum required protocol reader version for a reader that allows to read from this Delta table. See Table protocol versioning. Data type: Default: |
The minimum required protocol writer version for a writer that allows to write to this Delta table. See Table protocol versioning. Data type: Default: |
For example, this may improve Amazon S3 performance when Delta Lake needs to send very high volumes of Amazon S3 calls to better partition across S3 servers. See Table properties. Data type: Default: |
When See Table properties. Data type: Default: |
The shortest duration within which new snapshots will retain transaction identifiers
(for example, Data type: Default: (none) |
The target file size in bytes or higher units for file tuning. For example,
See Optimize performance with file management. Data type: Default: (none) |
See Optimize performance with file management. Data type: Default: (none) |