Data guide

This guide shows how to work with data in Databricks:

• Create tables directly from imported data. Table schema is stored in the default Databricks internal metastore and you can also configure and use external metastores.

  • Introduction to importing, reading, and modifying data
  • Databases and tables
  • Metastores

• Ingest data into Databricks

  • Partner data integrations

• Access data in Apache Spark formats and from external data sources:

  • Data sources
  • Delta Lake and Delta Engine guide

• Use Apache Spark APIs to work with data.

  • DataFrames and Datasets
  • Structured Streaming
  • Graph analysis

• Use legacy Apache Spark APIs.

  • Spark Streaming (Legacy)