commit
Commits this writing job with a list of commit messages.
This method is invoked on the driver when all tasks run successfully. The commit messages are collected from the write() method call from each task and passed to this method. The implementation should use the commit messages to commit the writing job to the data source.
Added in Databricks Runtime 14.3 LTS
Syntax
commit(messages: List[Optional[WriterCommitMessage]])
Parameters
Parameter | Type | Description |
|---|---|---|
| list of WriterCommitMessage | A list of commit messages. If a write task fails, the commit message will be |