Databricks GPU clusters clusters support low-level CUDA development using Java libraries such as JCuda.

Install JCuda using an init script

Databricks recommends using Cluster Node Initialization Scripts to install JCuda to make it available on all cluster nodes.

Launch a GPU-enabled cluster with the preloaded Nvidia Libraries and use the notebook below to install an init script that attaches pre-built JCuda libraries to the GPU-enabled cluster.

Check out https://www.jcuda.org for details.

JCuda init script notebook

Use JCuda on a single node

This tutorial is inspired by the classic Pi Estimation example at https://spark.apache.org/examples.html.