Databricks released this image in February 2020.
Databricks Runtime for Genomics (Databricks Runtime Genomics) is a variant of Databricks Runtime 6.4 optimized for working with genomic and biomedical data. It is a component of the Databricks Unified Analytics Platform for Genomics.
For more information, including instructions for creating a Databricks Runtime for Genomics cluster, see Databricks Runtime for Genomics. For more information on developing genomics applications, see Genomics.
Databricks Runtime 6.4 for Genomics is built on top of Databricks Runtime 6.4. For information on what’s new in Databricks Runtime 6.4, see the Databricks Runtime 6.4 release notes.
DNASeq in Databricks Runtime 6.4 for Genomics can now be customized. Pipeline users can now selectively disable any legitimate combination of the read alignment, variant calling, and variant annotation stages. Users can also perform single-end read alignment.
The version of Glow included in Databricks Runtime 6.4 for Genomics includes Python and Scala APIs for functions previously exposed only via SQL expressions. These functions are available for DataFrame operations, providing improved compile-time safety.
The variant normalizer in Glow and Databricks Runtime 6.4 for Genomics is about 2.5x faster than the version in Databricks Runtime 6.3 for Genomics. The new normalizer can be invoked as a transformer as well as a SQL function, preserves the original schema, and provides improved fault-tolerance.