Data guide

This guide shows how to work with data in Databricks.

• Create tables directly from imported data. Table schema is stored in the default Databricks internal metastore and you can also configure and use external metastores.

  • Import, read, and modify data
  • Databases and tables
  • Metastores

• Ingest data into Databricks.

  • Databricks integrations
  • COPY INTO tutorial

• Access data in Apache Spark formats and from external data sources.

  • Data sources

  • Delta Lake guide

• Access file metadata in Apache Spark file-based data sources.

  • File metadata column

• Use Apache Spark APIs to work with data.

  • DataFrames and Datasets
  • Structured Streaming
  • Graph analysis

• Use legacy Apache Spark APIs.

  • Spark Streaming (Legacy)