Azure Data Lake Storage Gen2

Azure Data Lake Storage Gen2 (also known as ADLS Gen2) is a next-generation data lake solution for big data analytics. Azure Data Lake Storage Gen2 builds Azure Data Lake Storage Gen1 capabilities—file system semantics, file-level security, and scale—into Azure Blob storage, with its low-cost tiered storage, high availability, and disaster recovery features. The Azure Blob File System (ABFS) driver provides the interface to ADLS Gen2 storage. The ABFS driver, included in the Databricks Runtime, supports standard file system semantics on Azure Blob storage.

The articles in this section describe methods for accessing ADLS Gen2 storage and frequently encountered problems:

• To learn how to use storage account access keys to quickly access ADLS Gen2 storage from Databricks for testing, development, or experimentation, see Get started with Azure Data Lake Storage Gen2.

• For most production and multi-user scenarios, use OAuth 2.0 with service principals to access ADLS Gen2 storage. See Access Azure Data Lake Storage Gen2 using OAuth 2.0 with an Azure service principal.

• For frequently asked questions and known issues, see Azure Data Lake Storage Gen2 frequently asked questions and known issues.