User Guide
Welcome to the Databricks User Guide. Here you will find the key topics that you need to be successful with Databricks.
- Supported Browsers
- Clusters
- Display Clusters
- Create a Cluster
- Clone a Cluster
- Edit a Cluster
- Start a Cluster
- Terminate a Cluster
- Pin a Cluster
- Delete a Cluster
- Cluster Event Log
- Cluster Configurations
- GPU-enabled Clusters
- Overview of Databricks Runtime for Machine Learning
- Python Clusters
- Cluster Access Control
- Metrics
- Cluster Driver Logs
- Cluster Information in the Spark UI
- Clusters and Libraries
- Clusters and Notebooks
- Tips and Troubleshooting
- Workspace
- Notebooks
- Visualizations
- Accessing Data
- Databases and Tables
- Libraries
- Jobs
- Secrets
- Developer Tools
- Databricks File System - DBFS
- Databricks IO Cache
- Business Intelligence Tools
- Advanced Features
- Security
- FAQ and Best Practices Guides
- Install and Compile Cython
- Databricks Datasets
- Running C++ Code
- Sending Email From Databricks Notebooks
- Spark 1.x Cluster Connectivity
- Problem: SSO Server Redirects to Original URL, Not to Vanity Databricks URL
- Incompatible Schema in Some Files
- How to Set up Kafka on Databricks
- How to Create a Cluster with Anaconda
- How to Dump Tables in CSV, JSON, XML, Text, or HTML Format
- Distinguish Active and Dead Jobs
- Drop Tables with Corrupted Metadata from the Metastore
- How to Get the Full Path to the Current Notebook
- Hive UDFs
- How to Run SQL Queries from Python Scripts
- Multi-Part Upload Failure
- Listing Table Names
- EBS Leaked Volumes
- How to Update Nested Columns
- CosmosDB-Spark Connector Library Conflict
- Common Issues in Library Installation and Uninstallation
- Reading Large DBFS-Mounted Files Using Python APIs
- VACUUM Command on a Databricks Delta Table Stored in S3
- How to Improve Performance of Databricks Delta MERGE INTO Queries Using Partition Pruning
- Handling Partition Column Values While Using an SQS Queue as a Streaming Source
- Cannot Run Notebook Commands After Canceling Streaming Cell
- How to get Workspace, Cluster, Notebook, and Job Details
- Problem: Library Unavailability Causing Job Failures