With htmlwidgets for R you can generate interactive plots using R’s flexible syntax and environment. Databricks notebooks support htmlwidgets.
The setup has two steps:
Install pandoc, a Linux package used by htmlwidgets to generate HTML.
Change one function in the htmlwidgets package to make it work in Databricks.
You can automate the first step using an init script so that the cluster installs pandoc when it launches. You should do the second step, changing an htmlwidgets function, in every notebook that uses the htmlwidgets package.
With each library invocation, an HTML file containing the rendered plot is downloaded. The plot does not display inline.