Pular para o conteúdo principal

Environment version 6

This page outlines the system environment information for environment version 6. It includes the following base environments:

  • Standard base environment: a base environment with the Databricks-provided client libraries.
  • ML base environment: a base environment with the Python and system packages from Databricks Runtime for Machine Learning pre-installed.

To ensure application compatibility, workloads use a versioned API, known as the environment version, that remains compatible with newer versions.

To select a base environment, use the Base environment selector in the Environment side panel. See Select a base environment for serverless compute, or Manage dependencies using environments for classic compute with Environments dependency mode (Beta).

Behavioral changes

The following behavioral changes are introduced in environment version 6.

Py4J gateway disabled for dbutils

The Py4J gateway is turned off in environment version 6. As a result, dbutils.entry_point and dbutils.notebook.entry_point are replaced, and the set of supported APIs is narrowed to the following, which use the gRPC or Jupyter header transport mechanism. This change also applies to environment version 5:

  • getDbutils().notebook().getContext()
  • getDbutils().jobs().taskValues().getContext()
  • getUserLocalTempDir
  • getCurrentBindings (the return value is now a Python dictionary)
  • getUserNFSTempDir

The following notable APIs are no longer supported. This is not an exhaustive list:

  • getDbutils().notebook().setExitVal()
  • getDbutils().notebook().setContext()
  • getDbutils().jobs().taskValues().setContext()
  • getDbutils().jobs()
  • getDbutils().jobs().taskValues()
  • dbutils.jobs.taskValues._taskValues.taskKeyNotFound()
  • dbutils.jobs.taskValues._taskValues.assertNotOnSparkWorker()
  • dbutils.jobs.taskValues._taskValues.inJobContext()
  • getDbutils().notebook()
  • getDbutils().notebook().verifyNotOnWorker()
  • getDbutils().notebook().checkEnabled()
  • getDbutils().notebook().resolveRelativePath()
  • getDbutils().notebook().resolveRelativeGitPath()
  • getDbutils().notebook().getGitSourceJsonFromContext()
  • getDbutils().notebook().filterOutCredentials()
  • getDbutils().notebook()._run()
  • getLogger

API updates

Environment version 6 includes the following API updates:

  • SPARK-54555 Enable Arrow-optimized Python UDFs by default
  • SPARK-55689 Add withSchemaEvolution() in the DataFrame writer API
  • SPARK-52857 Add the is_valid_variant expression to the PySpark DataFrame API
  • SPARK-54199 Add PySpark DataFrame API support for KLL quantile sketch functions
  • SPARK-54179 Add PySpark DataFrame API support for Tuple Sketch functions
  • SPARK-40336 Implement DataFrameGroupBy.cov in the pandas API on Spark
  • SPARK-40337 Implement SeriesGroupBy.describe in the pandas API on Spark
  • SPARK-46776 Support pa.ChunkedArray columns in createDataFrame from pandas

System environment

  • Operating System: Ubuntu 24.04.4 LTS
  • Python: 3.12.3
  • Databricks Connect: 19 (Databricks Connect is continuously updated in the latest environment version. Run pip list to confirm the exact version in your current environment.)
  • Scala: 2.13.18
  • JDK: 17

Installed Python libraries

Standard base environment

To reproduce environment version 6 in your local Python virtual environment, download the requirements-env-6.txt file and run pip install -r requirements-env-6.txt. This command installs all of the libraries from environment version 6.

Library

Version

Library

Version

Library

Version

annotated-doc

0.0.4

annotated-types

0.7.0

anyio

4.10.0

argon2-cffi

21.3.0

argon2-cffi-bindings

25.1.0

arro3-core

0.8.0

arrow

1.4.0

asttokens

3.0.0

astunparse

1.6.3

async-lru

2.0.5

attrs

25.4.0

azure-core

1.41.0

azure-identity

1.25.3

azure-mgmt-core

1.6.0

azure-mgmt-web

10.1.0

azure-storage-blob

12.29.0

azure-storage-file-datalake

12.24.0

babel

2.16.0

beautifulsoup4

4.13.5

black

25.9.0

bleach

6.2.0

boto3

1.40.46

botocore

1.40.46

cachetools

5.5.1

certifi

2025.11.12

cffi

2.0.0

charset-normalizer

3.4.4

click

8.2.1

cloudpickle

3.1.1

comm

0.2.3

contourpy

1.3.3

cryptography

46.0.3

cycler

0.11.0

databricks-agents

1.11.0

databricks-connect

19.1

databricks-sdk

0.122.0

dataclasses-json

0.6.7

debugpy

1.8.16

decorator

5.2.1

defusedxml

0.7.1

deltalake

1.5.1

Deprecated

1.3.1

distlib

0.4.0

executing

2.2.1

fastapi

0.136.3

fastjsonschema

2.21.2

filelock

3.29.0

fonttools

4.60.1

fqdn

1.5.1

fsspec

2023.5.0

gitdb

4.0.11

GitPython

3.1.45

google-api-core

2.30.3

google-auth

2.53.0

google-cloud-core

2.6.0

google-cloud-storage

3.10.1

google-crc32c

1.8.0

google-resumable-media

2.9.0

googleapis-common-protos

1.71.0

grpcio

1.76.0

grpcio-status

1.76.0

h11

0.16.0

httpcore

1.0.9

httpx

0.28.1

idna

3.11

importlib_metadata

8.7.0

iniconfig

2.1.0

ipyflow-core

0.0.227

ipykernel

6.31.0

ipython

9.7.0

ipython-genutils

0.2.0

ipython_pygments_lexers

1.1.1

ipywidgets

7.8.1

isodate

0.7.2

isoduration

20.11.0

jedi

0.19.2

Jinja2

3.1.6

jmespath

1.0.1

joblib

1.5.2

json5

0.12.1

jsonpointer

3.1.1

jsonschema

4.25.0

jsonschema-specifications

2025.9.1

jupyter-events

0.12.0

jupyter-lsp

2.2.5

jupyter_client

8.6.3

jupyter_core

5.8.1

jupyter_server

2.16.0

jupyter_server_terminals

0.5.3

jupyterlab

4.4.7

jupyterlab_pygments

0.3.0

jupyterlab_server

2.28.0

jupyterlab_widgets

1.1.11

kiwisolver

1.4.8

lark

1.3.1

markdown-it-py

2.2.0

MarkupSafe

3.0.2

marshmallow

3.26.2

matplotlib

3.10.6

matplotlib-inline

0.2.1

mccabe

0.7.0

mdurl

0.1.2

mistune

3.1.2

mlflow-skinny

3.12.0

mmh3

5.2.1

msal

1.36.0

msal-extensions

1.3.1

msrest

0.7.1

mypy-extensions

1.0.0

nbclient

0.10.2

nbconvert

7.16.6

nbformat

5.10.4

nest-asyncio

1.6.0

nodeenv

1.10.0

notebook

7.4.5

notebook_shim

0.2.4

numpy

2.3.4

oauthlib

3.2.2

opentelemetry-api

1.42.1

opentelemetry-proto

1.42.1

opentelemetry-sdk

1.42.1

opentelemetry-semantic-conventions

0.63b1

overrides

7.7.0

packaging

25.0

pandas

2.3.3

pandocfilters

1.5.1

parso

0.8.5

pathspec

0.12.1

pexpect

4.9.0

pillow

12.0.0

pip

25.3

platformdirs

4.5.0

pluggy

1.5.0

prometheus_client

0.21.1

prompt_toolkit

3.0.52

proto-plus

1.28.0

protobuf

6.33.5

psutil

7.0.0

ptyprocess

0.7.0

pure_eval

0.2.3

py4j

0.10.9.9

pyarrow

21.0.0

pyasn1

0.6.1

pyasn1_modules

0.4.2

pyccolo

0.0.83

pycparser

2.23

pydantic

2.13.3

pydantic_core

2.46.3

pyflakes

3.2.0

Pygments

2.19.2

pyiceberg

0.11.1

PyJWT

2.10.1

pyparsing

3.2.5

pyright

1.1.409

pyroaring

1.1.0

pytest

8.4.2

python-dateutil

2.9.0.post0

python-dotenv

1.2.2

python-json-logger

3.2.1

pytokens

0.2.0

pytz

2025.2

PyYAML

6.0.3

pyzmq

27.1.0

referencing

0.37.0

regex

2025.9.1

requests

2.32.5

requests-oauthlib

2.0.0

rfc3339-validator

0.1.4

rfc3986-validator

0.1.1

rfc3987-syntax

1.1.0

rich

14.2.0

rpds-py

0.28.0

s3transfer

0.14.0

scikit-learn

1.7.2

scipy

1.16.3

Send2Trash

1.8.2

setuptools

80.9.0

six

1.17.0

smmap

5.0.0

sniffio

1.3.0

soupsieve

2.5

sqlparse

0.5.5

stack-data

0.6.3

starlette

0.52.1

strictyaml

1.7.3

tenacity

9.1.2

terminado

0.18.1

threadpoolctl

3.5.0

tiktoken

0.13.0

tinycss2

1.4.0

tokenize_rt

6.2.0

tornado

6.5.1

tqdm

4.67.1

traitlets

5.14.3

typing-inspect

0.9.0

typing-inspection

0.4.2

typing_extensions

4.15.0

tzdata

2026.2

uri-template

1.3.0

urllib3

2.5.0

uvicorn

0.48.0

virtualenv

20.35.4

wcwidth

0.2.13

webcolors

25.10.0

webencodings

0.5.1

websocket-client

1.8.0

wheel

0.45.1

whenever

0.7.3

widgetsnbextension

3.6.6

wrapt

1.17.0

zipp

3.23.0

zstandard

0.25.0

Library

Version

Library

Version

Library

Version

annotated-doc

0.0.4

annotated-types

0.7.0

anyio

4.10.0

argon2-cffi

21.3.0

argon2-cffi-bindings

25.1.0

arro3-core

0.8.0

arrow

1.4.0

asttokens

3.0.0

astunparse

1.6.3

async-lru

2.0.5

attrs

25.4.0

azure-core

1.41.0

azure-identity

1.25.3

azure-mgmt-core

1.6.0

azure-mgmt-web

10.1.0

azure-storage-blob

12.29.0

azure-storage-file-datalake

12.24.0

babel

2.16.0

beautifulsoup4

4.13.5

black

25.9.0

bleach

6.2.0

boto3

1.40.46

botocore

1.40.46

cachetools

5.5.1

certifi

2025.11.12

cffi

2.0.0

charset-normalizer

3.4.4

click

8.2.1

cloudpickle

3.1.1

comm

0.2.3

contourpy

1.3.3

cryptography

46.0.3

cycler

0.11.0

databricks-agents

1.11.0

databricks-connect

19.1

databricks-sdk

0.122.0

dataclasses-json

0.6.7

debugpy

1.8.16

decorator

5.2.1

defusedxml

0.7.1

deltalake

1.5.1

Deprecated

1.3.1

distlib

0.4.0

executing

2.2.1

fastapi

0.136.3

fastjsonschema

2.21.2

filelock

3.29.0

fonttools

4.60.1

fqdn

1.5.1

fsspec

2023.5.0

gitdb

4.0.11

GitPython

3.1.45

google-api-core

2.30.3

google-auth

2.53.0

google-cloud-core

2.6.0

google-cloud-storage

3.10.1

google-crc32c

1.8.0

google-resumable-media

2.9.0

googleapis-common-protos

1.71.0

grpcio

1.76.0

grpcio-status

1.76.0

h11

0.16.0

httpcore

1.0.9

httpx

0.28.1

idna

3.11

importlib_metadata

8.7.0

iniconfig

2.1.0

ipyflow-core

0.0.227

ipykernel

6.31.0

ipython

9.7.0

ipython-genutils

0.2.0

ipython_pygments_lexers

1.1.1

ipywidgets

7.8.1

isodate

0.7.2

isoduration

20.11.0

jedi

0.19.2

Jinja2

3.1.6

jmespath

1.0.1

joblib

1.5.2

json5

0.12.1

jsonpointer

3.1.1

jsonschema

4.25.0

jsonschema-specifications

2025.9.1

jupyter-events

0.12.0

jupyter-lsp

2.2.5

jupyter_client

8.6.3

jupyter_core

5.8.1

jupyter_server

2.16.0

jupyter_server_terminals

0.5.3

jupyterlab

4.4.7

jupyterlab_pygments

0.3.0

jupyterlab_server

2.28.0

jupyterlab_widgets

1.1.11

kiwisolver

1.4.8

lark

1.3.1

markdown-it-py

2.2.0

MarkupSafe

3.0.2

marshmallow

3.26.2

matplotlib

3.10.6

matplotlib-inline

0.2.1

mccabe

0.7.0

mdurl

0.1.2

mistune

3.1.2

mlflow-skinny

3.12.0

mmh3

5.2.1

msal

1.36.0

msal-extensions

1.3.1

msrest

0.7.1

mypy-extensions

1.0.0

nbclient

0.10.2

nbconvert

7.16.6

nbformat

5.10.4

nest-asyncio

1.6.0

nodeenv

1.10.0

notebook

7.4.5

notebook_shim

0.2.4

numpy

2.3.4

oauthlib

3.2.2

opentelemetry-api

1.42.1

opentelemetry-proto

1.42.1

opentelemetry-sdk

1.42.1

opentelemetry-semantic-conventions

0.63b1

overrides

7.7.0

packaging

25.0

pandas

2.3.3

pandocfilters

1.5.1

parso

0.8.5

pathspec

0.12.1

pexpect

4.9.0

pillow

12.0.0

pip

25.3

platformdirs

4.5.0

pluggy

1.5.0

prometheus_client

0.21.1

prompt_toolkit

3.0.52

proto-plus

1.28.0

protobuf

6.33.5

psutil

7.0.0

ptyprocess

0.7.0

pure_eval

0.2.3

py4j

0.10.9.9

pyarrow

21.0.0

pyasn1

0.6.1

pyasn1_modules

0.4.2

pyccolo

0.0.83

pycparser

2.23

pydantic

2.13.3

pydantic_core

2.46.3

pyflakes

3.2.0

Pygments

2.19.2

pyiceberg

0.11.1

PyJWT

2.10.1

pyparsing

3.2.5

pyright

1.1.409

pyroaring

1.1.0

pytest

8.4.2

python-dateutil

2.9.0.post0

python-dotenv

1.2.2

python-json-logger

3.2.1

pytokens

0.2.0

pytz

2025.2

PyYAML

6.0.3

pyzmq

27.1.0

referencing

0.37.0

regex

2025.9.1

requests

2.32.5

requests-oauthlib

2.0.0

rfc3339-validator

0.1.4

rfc3986-validator

0.1.1

rfc3987-syntax

1.1.0

rich

14.2.0

rpds-py

0.28.0

s3transfer

0.14.0

scikit-learn

1.7.2

scipy

1.16.3

Send2Trash

1.8.2

setuptools

80.9.0

six

1.17.0

smmap

5.0.0

sniffio

1.3.0

soupsieve

2.5

sqlparse

0.5.5

stack-data

0.6.3

starlette

0.52.1

strictyaml

1.7.3

tenacity

9.1.2

terminado

0.18.1

threadpoolctl

3.5.0

tiktoken

0.13.0

tinycss2

1.4.0

tokenize_rt

6.2.0

tornado

6.5.1

tqdm

4.67.1

traitlets

5.14.3

typing-inspect

0.9.0

typing-inspection

0.4.2

typing_extensions

4.15.0

tzdata

2026.2

uri-template

1.3.0

urllib3

2.5.0

uvicorn

0.48.0

virtualenv

20.35.4

wcwidth

0.2.13

webcolors

25.10.0

webencodings

0.5.1

websocket-client

1.8.0

wheel

0.45.1

whenever

0.7.3

widgetsnbextension

3.6.6

wrapt

1.17.0

zipp

3.23.0

zstandard

0.25.0

ML base environment

To reproduce the ML environment in your local Python virtual environment, download the requirements-ml-6.txt file and run pip install -r requirements-ml-6.txt. This command installs all the libraries from the ML environment.

Library

Version

Library

Version

Library

Version

absl-py

2.3.1

accelerate

1.13.0

aiohappyeyeballs

2.6.1

aiohttp

3.13.2

aiohttp-cors

0.8.1

aiosignal

1.4.0

alembic

1.18.4

annotated-doc

0.0.4

annotated-types

0.7.0

anyio

4.10.0

argon2-cffi

21.3.0

argon2-cffi-bindings

25.1.0

arro3-core

0.8.0

arrow

1.4.0

asttokens

3.0.0

astunparse

1.6.3

async-lru

2.0.5

attrs

25.4.0

audioread

3.1.0

azure-core

1.41.0

azure-cosmos

4.3.1

azure-identity

1.25.3

azure-mgmt-core

1.6.0

azure-mgmt-web

10.1.0

azure-storage-blob

12.29.0

azure-storage-file-datalake

12.24.0

babel

2.16.0

beautifulsoup4

4.13.5

black

25.9.0

bleach

6.2.0

blis

1.3.3

boto3

1.40.46

botocore

1.40.46

cachetools

5.5.1

catalogue

2.0.10

certifi

2025.11.12

cffi

2.0.0

charset-normalizer

3.4.4

click

8.2.1

cloudpathlib

0.24.0

cloudpickle

3.1.1

cmdstanpy

1.3.0

colorful

0.5.8

colorlog

6.10.1

comm

0.2.3

confection

1.3.3

contourpy

1.3.3

cryptography

46.0.3

cycler

0.11.0

cymem

2.0.13

databricks-agents

1.10.2

databricks-connect

19.1

databricks-feature-engineering

0.13.0.1

databricks-sdk

0.108.0

dataclasses-json

0.6.7

datasets

4.8.5

dbl-tempo

0.1.26

debugpy

1.8.16

decorator

5.2.1

deepspeed

0.19.0

defusedxml

0.7.1

deltalake

1.5.1

Deprecated

1.3.1

dill

0.4.0

distlib

0.4.0

dm-tree

0.1.10

einops

0.8.2

evaluate

0.4.6

executing

2.2.1

Farama-Notifications

0.0.6

fastapi

0.136.1

fastjsonschema

2.21.2

filelock

3.20.0

Flask

2.2.5

fonttools

4.60.1

fqdn

1.5.1

frozenlist

1.8.0

fsspec

2023.5.0

gitdb

4.0.11

GitPython

3.1.45

google-api-core

2.30.3

google-auth

2.53.0

google-cloud-core

2.6.0

google-cloud-storage

3.10.1

google-crc32c

1.8.0

google-resumable-media

2.9.0

googleapis-common-protos

1.71.0

graphql-core

3.2.4

greenlet

3.2.4

grpcio

1.76.0

grpcio-status

1.76.0

gymnasium

0.28.1

h11

0.16.0

hf-xet

1.5.0

hjson

3.1.0

holidays

0.54

httpcore

1.0.9

httpx

0.28.1

huggingface_hub

0.36.2

idna

3.11

ImageIO

2.37.2

imbalanced-learn

0.14.0

importlib_metadata

8.7.0

importlib_resources

7.1.0

iniconfig

2.1.0

ipyflow-core

0.0.227

ipykernel

6.31.0

ipython

9.7.0

ipython-genutils

0.2.0

ipython_pygments_lexers

1.1.1

ipywidgets

7.8.1

isodate

0.7.2

isoduration

20.11.0

itsdangerous

2.2.0

jax-jumpy

1.0.0

jedi

0.19.2

Jinja2

3.1.6

jiter

0.15.0

jmespath

1.0.1

joblib

1.5.2

joblibspark

0.6.0

json5

0.12.1

jsonpatch

1.33

jsonpointer

3.1.1

jsonschema

4.25.0

jsonschema-specifications

2025.9.1

jupyter-events

0.12.0

jupyter-lsp

2.2.5

jupyter_client

8.6.3

jupyter_core

5.8.1

jupyter_server

2.16.0

jupyter_server_terminals

0.5.3

jupyterlab

4.4.7

jupyterlab_pygments

0.3.0

jupyterlab_server

2.28.0

jupyterlab_widgets

1.1.11

kiwisolver

1.4.8

langchain

1.3.1

langchain-core

1.4.0

langchain-protocol

0.0.15

langgraph

1.2.1

langgraph-checkpoint

4.1.1

langgraph-prebuilt

1.1.0

langgraph-sdk

0.3.15

langsmith

0.4.41

lark

1.3.1

lazy_loader

0.4

librosa

0.11.0

lightgbm

4.6.0

linkify-it-py

2.0.3

llvmlite

0.45.1

lz4

4.4.5

Mako

1.3.12

marisa-trie

1.2.0

Markdown

3.8

markdown-it-py

2.2.0

MarkupSafe

3.0.2

marshmallow

3.26.2

matplotlib

3.10.6

matplotlib-inline

0.2.1

mccabe

0.7.0

mdit-py-plugins

0.5.0

mdurl

0.1.2

memray

1.19.3

mistune

3.1.2

mlflow-skinny

3.12.0

mmh3

5.2.1

mpmath

1.3.0

msal

1.36.0

msal-extensions

1.3.1

msgpack

1.1.2

msrest

0.7.1

multidict

6.7.0

multiprocess

0.70.18

murmurhash

1.0.15

mypy-extensions

1.0.0

nbclient

0.10.2

nbconvert

7.16.6

nbformat

5.10.4

nest-asyncio

1.6.0

networkx

3.5

ninja

1.13.0

nltk

3.9.2

nodeenv

1.10.0

notebook

7.4.5

notebook_shim

0.2.4

numba

0.62.1

numpy

2.3.4

nvidia-nccl-cu12

2.30.4

oauthlib

3.2.0

openai

2.37.0

opencensus

0.11.4

opencensus-context

0.1.3

opentelemetry-api

1.42.1

opentelemetry-proto

1.42.1

opentelemetry-sdk

1.42.1

opentelemetry-semantic-conventions

0.63b1

optuna

3.6.1

optuna-integration

3.6.0

orjson

3.11.9

ormsgpack

1.12.2

overrides

7.7.0

packaging

25.0

pandas

2.3.3

pandocfilters

1.5.1

parso

0.8.5

pathspec

0.12.1

patsy

1.0.1

pexpect

4.9.0

pillow

12.0.0

pip

25.3

platformdirs

4.5.0

pluggy

1.5.0

pooch

1.9.0

preshed

3.0.13

prometheus_client

0.21.1

prompt_toolkit

3.0.52

propcache

0.3.1

prophet

1.2.1

proto-plus

1.28.0

protobuf

6.33.5

psutil

7.0.0

ptyprocess

0.7.0

pure_eval

0.2.3

py-cpuinfo

9.0.0

py-spy

0.4.2

py4j

0.10.9.9

pyarrow

21.0.0

pyasn1

0.6.1

pyasn1_modules

0.4.2

pyccolo

0.0.83

pycparser

2.23

pydantic

2.13.3

pydantic_core

2.46.3

pyflakes

3.2.0

Pygments

2.19.2

pyiceberg

0.11.1

PyJWT

2.10.1

pyparsing

3.2.5

pyright

1.1.409

pyroaring

1.1.0

pytesseract

0.3.13

pytest

8.4.2

python-dateutil

2.9.0.post0

python-dotenv

1.2.2

python-editor

1.0.4

python-json-logger

3.2.1

pytokens

0.2.0

pytz

2025.2

PyYAML

6.0.3

pyzmq

27.1.0

ray

2.37.0

referencing

0.37.0

regex

2025.9.1

requests

2.32.5

requests-oauthlib

2.0.0

requests-toolbelt

1.0.0

rfc3339-validator

0.1.4

rfc3986-validator

0.1.1

rfc3987-syntax

1.1.0

rich

14.2.0

rpds-py

0.28.0

s3transfer

0.14.0

safetensors

0.7.0

scikit-image

0.25.2

scikit-learn

1.7.2

scipy

1.16.3

Send2Trash

1.8.2

sentence-transformers

5.5.1

sentencepiece

0.2.1

setuptools

80.9.0

shap

0.51.0

shellingham

1.5.4

six

1.17.0

slicer

0.0.8

smart_open

7.6.1

smmap

5.0.0

sniffio

1.3.0

soundfile

0.13.1

soupsieve

2.5

soxr

1.1.0

spacy

3.8.14

spacy-legacy

3.0.12

spacy-loggers

1.0.5

SQLAlchemy

2.0.43

sqlparse

0.5.5

srsly

2.5.3

stack-data

0.6.3

stanio

0.5.1

starlette

0.52.1

statsmodels

0.14.5

strictyaml

1.7.3

sympy

1.14.0

tenacity

9.1.2

tensorboard

2.20.0

tensorboard-data-server

0.7.2

tensorboardX

2.6.5

terminado

0.18.1

textual

8.2.7

thinc

8.3.13

threadpoolctl

3.5.0

tifffile

2025.10.4

tiktoken

0.13.0

tinycss2

1.4.0

tokenize_rt

6.2.0

tokenizers

0.22.1

torch

2.12.0+cpu

torcheval

0.0.7

torchvision

0.27.0+cpu

tornado

6.5.1

tqdm

4.67.1

traitlets

5.14.3

transformers

4.57.6

typer

0.25.1

typing-inspect

0.9.0

typing-inspection

0.4.2

typing_extensions

4.15.0

tzdata

2026.2

uc-micro-py

1.0.3

uri-template

1.3.0

urllib3

2.5.0

uuid_utils

0.16.0

uvicorn

0.47.0

virtualenv

20.35.4

wasabi

1.1.3

wcwidth

0.2.13

weasel

1.0.0

webcolors

25.10.0

webencodings

0.5.1

websocket-client

1.8.0

Werkzeug

3.1.3

wheel

0.45.1

whenever

0.7.3

widgetsnbextension

3.6.6

wrapt

1.17.0

xgboost

3.2.0

xgboost-ray

0.1.19

xxhash

3.5.0

yarl

1.22.0

zipp

3.23.0

zstandard

0.25.0

Library

Version

Library

Version

Library

Version

absl-py

2.3.1

accelerate

1.13.0

aiohappyeyeballs

2.6.1

aiohttp

3.13.2

aiohttp-cors

0.8.1

aiosignal

1.4.0

alembic

1.18.4

annotated-doc

0.0.4

annotated-types

0.7.0

anyio

4.10.0

argon2-cffi

21.3.0

argon2-cffi-bindings

25.1.0

arro3-core

0.8.0

arrow

1.4.0

asttokens

3.0.0

astunparse

1.6.3

async-lru

2.0.5

attrs

25.4.0

audioread

3.1.0

azure-core

1.41.0

azure-cosmos

4.3.1

azure-identity

1.25.3

azure-mgmt-core

1.6.0

azure-mgmt-web

10.1.0

azure-storage-blob

12.29.0

azure-storage-file-datalake

12.24.0

babel

2.16.0

beautifulsoup4

4.13.5

black

25.9.0

bleach

6.2.0

blis

1.3.3

boto3

1.40.46

botocore

1.40.46

cachetools

5.5.1

catalogue

2.0.10

certifi

2025.11.12

cffi

2.0.0

charset-normalizer

3.4.4

click

8.2.1

cloudpathlib

0.24.0

cloudpickle

3.1.1

cmdstanpy

1.3.0

colorful

0.5.8

colorlog

6.10.1

comm

0.2.3

confection

1.3.3

contourpy

1.3.3

cryptography

46.0.3

cycler

0.11.0

cymem

2.0.13

databricks-agents

1.10.2

databricks-connect

19.1

databricks-feature-engineering

0.13.0.1

databricks-sdk

0.108.0

dataclasses-json

0.6.7

datasets

4.8.5

dbl-tempo

0.1.26

debugpy

1.8.16

decorator

5.2.1

deepspeed

0.19.0

defusedxml

0.7.1

deltalake

1.5.1

Deprecated

1.3.1

dill

0.4.0

distlib

0.4.0

dm-tree

0.1.10

einops

0.8.2

evaluate

0.4.6

executing

2.2.1

Farama-Notifications

0.0.6

fastapi

0.136.1

fastjsonschema

2.21.2

filelock

3.20.0

Flask

2.2.5

fonttools

4.60.1

fqdn

1.5.1

frozenlist

1.8.0

fsspec

2023.5.0

gitdb

4.0.11

GitPython

3.1.45

google-api-core

2.30.3

google-auth

2.53.0

google-cloud-core

2.6.0

google-cloud-storage

3.10.1

google-crc32c

1.8.0

google-resumable-media

2.9.0

googleapis-common-protos

1.71.0

graphql-core

3.2.4

greenlet

3.2.4

grpcio

1.76.0

grpcio-status

1.76.0

gymnasium

0.28.1

h11

0.16.0

hf-xet

1.5.0

hjson

3.1.0

holidays

0.54

httpcore

1.0.9

httpx

0.28.1

huggingface_hub

0.36.2

idna

3.11

ImageIO

2.37.2

imbalanced-learn

0.14.0

importlib_metadata

8.7.0

importlib_resources

7.1.0

iniconfig

2.1.0

ipyflow-core

0.0.227

ipykernel

6.31.0

ipython

9.7.0

ipython-genutils

0.2.0

ipython_pygments_lexers

1.1.1

ipywidgets

7.8.1

isodate

0.7.2

isoduration

20.11.0

itsdangerous

2.2.0

jax-jumpy

1.0.0

jedi

0.19.2

Jinja2

3.1.6

jiter

0.15.0

jmespath

1.0.1

joblib

1.5.2

joblibspark

0.6.0

json5

0.12.1

jsonpatch

1.33

jsonpointer

3.1.1

jsonschema

4.25.0

jsonschema-specifications

2025.9.1

jupyter-events

0.12.0

jupyter-lsp

2.2.5

jupyter_client

8.6.3

jupyter_core

5.8.1

jupyter_server

2.16.0

jupyter_server_terminals

0.5.3

jupyterlab

4.4.7

jupyterlab_pygments

0.3.0

jupyterlab_server

2.28.0

jupyterlab_widgets

1.1.11

kiwisolver

1.4.8

langchain

1.3.1

langchain-core

1.4.0

langchain-protocol

0.0.15

langgraph

1.2.1

langgraph-checkpoint

4.1.1

langgraph-prebuilt

1.1.0

langgraph-sdk

0.3.15

langsmith

0.4.41

lark

1.3.1

lazy_loader

0.4

librosa

0.11.0

lightgbm

4.6.0

linkify-it-py

2.0.3

llvmlite

0.45.1

lz4

4.4.5

Mako

1.3.12

marisa-trie

1.2.0

Markdown

3.8

markdown-it-py

2.2.0

MarkupSafe

3.0.2

marshmallow

3.26.2

matplotlib

3.10.6

matplotlib-inline

0.2.1

mccabe

0.7.0

mdit-py-plugins

0.5.0

mdurl

0.1.2

memray

1.19.3

mistune

3.1.2

mlflow-skinny

3.12.0

mmh3

5.2.1

mpmath

1.3.0

msal

1.36.0

msal-extensions

1.3.1

msgpack

1.1.2

msrest

0.7.1

multidict

6.7.0

multiprocess

0.70.18

murmurhash

1.0.15

mypy-extensions

1.0.0

nbclient

0.10.2

nbconvert

7.16.6

nbformat

5.10.4

nest-asyncio

1.6.0

networkx

3.5

ninja

1.13.0

nltk

3.9.2

nodeenv

1.10.0

notebook

7.4.5

notebook_shim

0.2.4

numba

0.62.1

numpy

2.3.4

nvidia-nccl-cu12

2.30.4

oauthlib

3.2.0

openai

2.37.0

opencensus

0.11.4

opencensus-context

0.1.3

opentelemetry-api

1.42.1

opentelemetry-proto

1.42.1

opentelemetry-sdk

1.42.1

opentelemetry-semantic-conventions

0.63b1

optuna

3.6.1

optuna-integration

3.6.0

orjson

3.11.9

ormsgpack

1.12.2

overrides

7.7.0

packaging

25.0

pandas

2.3.3

pandocfilters

1.5.1

parso

0.8.5

pathspec

0.12.1

patsy

1.0.1

pexpect

4.9.0

pillow

12.0.0

pip

25.3

platformdirs

4.5.0

pluggy

1.5.0

pooch

1.9.0

preshed

3.0.13

prometheus_client

0.21.1

prompt_toolkit

3.0.52

propcache

0.3.1

prophet

1.2.1

proto-plus

1.28.0

protobuf

6.33.5

psutil

7.0.0

ptyprocess

0.7.0

pure_eval

0.2.3

py-cpuinfo

9.0.0

py-spy

0.4.2

py4j

0.10.9.9

pyarrow

21.0.0

pyasn1

0.6.1

pyasn1_modules

0.4.2

pyccolo

0.0.83

pycparser

2.23

pydantic

2.13.3

pydantic_core

2.46.3

pyflakes

3.2.0

Pygments

2.19.2

pyiceberg

0.11.1

PyJWT

2.10.1

pyparsing

3.2.5

pyright

1.1.409

pyroaring

1.1.0

pytesseract

0.3.13

pytest

8.4.2

python-dateutil

2.9.0.post0

python-dotenv

1.2.2

python-editor

1.0.4

python-json-logger

3.2.1

pytokens

0.2.0

pytz

2025.2

PyYAML

6.0.3

pyzmq

27.1.0

ray

2.37.0

referencing

0.37.0

regex

2025.9.1

requests

2.32.5

requests-oauthlib

2.0.0

requests-toolbelt

1.0.0

rfc3339-validator

0.1.4

rfc3986-validator

0.1.1

rfc3987-syntax

1.1.0

rich

14.2.0

rpds-py

0.28.0

s3transfer

0.14.0

safetensors

0.7.0

scikit-image

0.25.2

scikit-learn

1.7.2

scipy

1.16.3

Send2Trash

1.8.2

sentence-transformers

5.5.1

sentencepiece

0.2.1

setuptools

80.9.0

shap

0.51.0

shellingham

1.5.4

six

1.17.0

slicer

0.0.8

smart_open

7.6.1

smmap

5.0.0

sniffio

1.3.0

soundfile

0.13.1

soupsieve

2.5

soxr

1.1.0

spacy

3.8.14

spacy-legacy

3.0.12

spacy-loggers

1.0.5

SQLAlchemy

2.0.43

sqlparse

0.5.5

srsly

2.5.3

stack-data

0.6.3

stanio

0.5.1

starlette

0.52.1

statsmodels

0.14.5

strictyaml

1.7.3

sympy

1.14.0

tenacity

9.1.2

tensorboard

2.20.0

tensorboard-data-server

0.7.2

tensorboardX

2.6.5

terminado

0.18.1

textual

8.2.7

thinc

8.3.13

threadpoolctl

3.5.0

tifffile

2025.10.4

tiktoken

0.13.0

tinycss2

1.4.0

tokenize_rt

6.2.0

tokenizers

0.22.1

torch

2.12.0+cpu

torcheval

0.0.7

torchvision

0.27.0+cpu

tornado

6.5.1

tqdm

4.67.1

traitlets

5.14.3

transformers

4.57.6

typer

0.25.1

typing-inspect

0.9.0

typing-inspection

0.4.2

typing_extensions

4.15.0

tzdata

2026.2

uc-micro-py

1.0.3

uri-template

1.3.0

urllib3

2.5.0

uuid_utils

0.16.0

uvicorn

0.47.0

virtualenv

20.35.4

wasabi

1.1.3

wcwidth

0.2.13

weasel

1.0.0

webcolors

25.10.0

webencodings

0.5.1

websocket-client

1.8.0

Werkzeug

3.1.3

wheel

0.45.1

whenever

0.7.3

widgetsnbextension

3.6.6

wrapt

1.17.0

xgboost

3.2.0

xgboost-ray

0.1.19

xxhash

3.5.0

yarl

1.22.0

zipp

3.23.0

zstandard

0.25.0

Installed Java and Scala libraries (Scala 2.13)

The following table lists libraries exposed at runtime under their original package names. Packages shaded into private namespaces are omitted.

A system package is always loaded above user and session dependencies. Packages marked No are compatibility copies re-exposed below the user and session classpath, so a user-supplied version takes precedence.

Group ID

Artifact ID

Version

System package

com.databricks

databricks-connect_2.13

19.1

Yes

com.databricks

databricks-dbutils-scala_2.13

0.1.4

Yes

com.databricks

databricks-sdk-java

0.141.0

Yes

com.fasterxml.jackson.core

jackson-annotations

2.18.9

Yes

com.fasterxml.jackson.core

jackson-core

2.18.9

Yes

com.fasterxml.jackson.core

jackson-databind

2.18.9

Yes

com.fasterxml.jackson.datatype

jackson-datatype-guava

2.18.9

Yes

com.fasterxml.jackson.datatype

jackson-datatype-jdk8

2.18.9

Yes

com.fasterxml.jackson.datatype

jackson-datatype-jsr310

2.18.9

Yes

com.google.auth

google-auth-library-credentials

1.20.0

No

com.google.auth

google-auth-library-oauth2-http

1.20.0

No

com.google.auto.value

auto-value-annotations

1.10.4

No

com.google.code.gson

gson

2.8.9

No

com.google.errorprone

error_prone_annotations

2.18.0

No

com.google.guava

failureaccess

1.0.1

No

com.google.guava

guava

32.0.1-jre

No

com.google.guava

listenablefuture

9999.0-empty-to-avoid-conflict-with-guava

No

com.google.http-client

google-http-client

1.43.3

No

com.google.http-client

google-http-client-gson

1.43.3

No

com.google.j2objc

j2objc-annotations

2.8

No

com.google.protobuf

protobuf-java

3.25.5

Yes

com.google.protobuf

protobuf-java-util

3.25.5

Yes

com.thoughtworks.paranamer

paranamer

2.8

No

commons-codec

commons-codec

1.11

No

commons-io

commons-io

2.14.0

No

commons-logging

commons-logging

1.3.6

No

io.github.java-diff-utils

java-diff-utils

4.16

Yes

io.grpc

grpc-context

1.27.2

No

io.opencensus

opencensus-api

0.31.1

No

io.opencensus

opencensus-contrib-http-util

0.31.1

No

org.apache.commons

commons-configuration2

2.15.0

No

org.apache.commons

commons-lang3

3.20.0

No

org.apache.commons

commons-text

1.15.0

No

org.apache.httpcomponents

httpclient

4.5.14

Yes

org.apache.httpcomponents

httpcore

4.4.16

Yes

org.apache.logging.log4j

log4j-api

2.20.0

Yes

org.apache.logging.log4j

log4j-core

2.20.0

Yes

org.apache.logging.log4j

log4j-slf4j2-impl

2.20.0

No

org.checkerframework

checker-qual

3.33.0

No

org.jline

jline

3.29.0

Yes

org.json

json

20240303

Yes

org.json4s

json4s-ast_2.13

4.0.7

Yes

org.json4s

json4s-core_2.13

4.0.7

Yes

org.json4s

json4s-jackson-core_2.13

4.0.7

Yes

org.json4s

json4s-jackson_2.13

4.0.7

Yes

org.json4s

json4s-scalap_2.13

4.0.7

Yes

org.scala-lang

scala-compiler_2.13

2.13.18

Yes

org.scala-lang

scala-library_2.13

2.13.18

Yes

org.scala-lang

scala-reflect_2.13

2.13.18

Yes

org.scala-lang.modules

scala-collection-compat_2.13

2.13.0

Yes

org.slf4j

slf4j-api

2.0.10

Yes

com.lihaoyi

ammonite-compiler-interface_2.13.18

3.0.8

Yes

com.lihaoyi

ammonite-compiler_2.13.18

3.0.8

Yes

com.lihaoyi

ammonite-interp-api_2.13.18

3.0.8

Yes

com.lihaoyi

ammonite-interp_2.13.18

3.0.8

Yes

com.lihaoyi

ammonite-repl-api_2.13.18

3.0.8

Yes

com.lihaoyi

ammonite-repl_2.13.18

3.0.8

Yes

com.lihaoyi

ammonite-runtime_2.13.18

3.0.8

Yes

com.lihaoyi

ammonite-terminal_2.13

3.0.8

Yes

com.lihaoyi

ammonite-util_2.13

3.0.8

Yes

com.lihaoyi

fansi_2.13

0.5.1

Yes

com.lihaoyi

mainargs_2.13

0.7.6

Yes

com.lihaoyi

os-lib_2.13

0.11.3

Yes

com.lihaoyi

pprint_2.13

0.9.0

Yes

com.lihaoyi

scalaparse_2.13

3.1.1

Yes

com.lihaoyi

scalatags_2.13

0.13.1

Yes

com.thesamet.scalapb

lenses_2.13

0.11.15

Yes

com.thesamet.scalapb

scalapb-runtime_2.13

0.11.15

Yes

org.jline

jline-reader

3.14.1

Yes

org.jline

jline-terminal

3.14.1

Yes

org.scala-lang

scalap_2.13

2.13.13

Yes

org.scala-lang.modules

scala-java8-compat_2.13

1.0.2

Yes

org.scalameta

io_2.13

4.13.10

Yes

org.scalameta

mtags-interfaces

1.6.3

Yes

org.scalameta

mtags-shared_2.13.18

1.6.3

Yes

org.scalameta

mtags_2.13.18

1.6.3

Yes

org.scalameta

parsers_2.13

4.13.10

Yes

org.scalameta

scalameta_2.13

4.13.10

Yes

org.scalameta

semanticdb-scalac-core_2.13.18

4.13.10

Yes

org.scalameta

trees_2.13

4.13.10

Yes

sh.almond

channels_2.13

0.14.5

Yes

sh.almond

coursier-logger_2.13

0.14.5

Yes

sh.almond

interpreter-api_2.13

0.14.5

Yes

sh.almond

interpreter_2.13

0.14.5

Yes

sh.almond

jupyter-api_2.13

0.14.5

Yes

sh.almond

kernel_2.13

0.14.5

Yes

sh.almond

logger-scala2-macros_2.13

0.14.5

Yes

sh.almond

logger_2.13

0.14.5

Yes

sh.almond

protocol_2.13

0.14.5

Yes

sh.almond

scala-interpreter_2.13.18

0.14.5

Yes

sh.almond

scala-kernel-api_2.13.18

0.14.5

Yes

sh.almond

scala-kernel_2.13.18

0.14.5

Yes

sh.almond

shared-directives_2.13

0.14.5

Yes

sh.almond

toree-hooks_2.13

0.14.5

Yes

Group ID

Artifact ID

Version

System package

com.databricks

databricks-connect_2.13

19.1

Yes

com.databricks

databricks-dbutils-scala_2.13

0.1.4

Yes

com.databricks

databricks-sdk-java

0.141.0

Yes

com.fasterxml.jackson.core

jackson-annotations

2.18.9

Yes

com.fasterxml.jackson.core

jackson-core

2.18.9

Yes

com.fasterxml.jackson.core

jackson-databind

2.18.9

Yes

com.fasterxml.jackson.datatype

jackson-datatype-guava

2.18.9

Yes

com.fasterxml.jackson.datatype

jackson-datatype-jdk8

2.18.9

Yes

com.fasterxml.jackson.datatype

jackson-datatype-jsr310

2.18.9

Yes

com.google.auth

google-auth-library-credentials

1.20.0

No

com.google.auth

google-auth-library-oauth2-http

1.20.0

No

com.google.auto.value

auto-value-annotations

1.10.4

No

com.google.code.gson

gson

2.8.9

No

com.google.errorprone

error_prone_annotations

2.18.0

No

com.google.guava

failureaccess

1.0.1

No

com.google.guava

guava

32.0.1-jre

No

com.google.guava

listenablefuture

9999.0-empty-to-avoid-conflict-with-guava

No

com.google.http-client

google-http-client

1.43.3

No

com.google.http-client

google-http-client-gson

1.43.3

No

com.google.j2objc

j2objc-annotations

2.8

No

com.google.protobuf

protobuf-java

3.25.5

Yes

com.google.protobuf

protobuf-java-util

3.25.5

Yes

com.thoughtworks.paranamer

paranamer

2.8

No

commons-codec

commons-codec

1.11

No

commons-io

commons-io

2.14.0

No

commons-logging

commons-logging

1.3.6

No

io.github.java-diff-utils

java-diff-utils

4.16

Yes

io.grpc

grpc-context

1.27.2

No

io.opencensus

opencensus-api

0.31.1

No

io.opencensus

opencensus-contrib-http-util

0.31.1

No

org.apache.commons

commons-configuration2

2.15.0

No

org.apache.commons

commons-lang3

3.20.0

No

org.apache.commons

commons-text

1.15.0

No

org.apache.httpcomponents

httpclient

4.5.14

Yes

org.apache.httpcomponents

httpcore

4.4.16

Yes

org.apache.logging.log4j

log4j-api

2.20.0

Yes

org.apache.logging.log4j

log4j-core

2.20.0

Yes

org.apache.logging.log4j

log4j-slf4j2-impl

2.20.0

No

org.checkerframework

checker-qual

3.33.0

No

org.jline

jline

3.29.0

Yes

org.json

json

20240303

Yes

org.json4s

json4s-ast_2.13

4.0.7

Yes

org.json4s

json4s-core_2.13

4.0.7

Yes

org.json4s

json4s-jackson-core_2.13

4.0.7

Yes

org.json4s

json4s-jackson_2.13

4.0.7

Yes

org.json4s

json4s-scalap_2.13

4.0.7

Yes

org.scala-lang

scala-compiler_2.13

2.13.18

Yes

org.scala-lang

scala-library_2.13

2.13.18

Yes

org.scala-lang

scala-reflect_2.13

2.13.18

Yes

org.scala-lang.modules

scala-collection-compat_2.13

2.13.0

Yes

org.slf4j

slf4j-api

2.0.10

Yes

com.lihaoyi

ammonite-compiler-interface_2.13.18

3.0.8

Yes

com.lihaoyi

ammonite-compiler_2.13.18

3.0.8

Yes

com.lihaoyi

ammonite-interp-api_2.13.18

3.0.8

Yes

com.lihaoyi

ammonite-interp_2.13.18

3.0.8

Yes

com.lihaoyi

ammonite-repl-api_2.13.18

3.0.8

Yes

com.lihaoyi

ammonite-repl_2.13.18

3.0.8

Yes

com.lihaoyi

ammonite-runtime_2.13.18

3.0.8

Yes

com.lihaoyi

ammonite-terminal_2.13

3.0.8

Yes

com.lihaoyi

ammonite-util_2.13

3.0.8

Yes

com.lihaoyi

fansi_2.13

0.5.1

Yes

com.lihaoyi

mainargs_2.13

0.7.6

Yes

com.lihaoyi

os-lib_2.13

0.11.3

Yes

com.lihaoyi

pprint_2.13

0.9.0

Yes

com.lihaoyi

scalaparse_2.13

3.1.1

Yes

com.lihaoyi

scalatags_2.13

0.13.1

Yes

com.thesamet.scalapb

lenses_2.13

0.11.15

Yes

com.thesamet.scalapb

scalapb-runtime_2.13

0.11.15

Yes

org.jline

jline-reader

3.14.1

Yes

org.jline

jline-terminal

3.14.1

Yes

org.scala-lang

scalap_2.13

2.13.13

Yes

org.scala-lang.modules

scala-java8-compat_2.13

1.0.2

Yes

org.scalameta

io_2.13

4.13.10

Yes

org.scalameta

mtags-interfaces

1.6.3

Yes

org.scalameta

mtags-shared_2.13.18

1.6.3

Yes

org.scalameta

mtags_2.13.18

1.6.3

Yes

org.scalameta

parsers_2.13

4.13.10

Yes

org.scalameta

scalameta_2.13

4.13.10

Yes

org.scalameta

semanticdb-scalac-core_2.13.18

4.13.10

Yes

org.scalameta

trees_2.13

4.13.10

Yes

sh.almond

channels_2.13

0.14.5

Yes

sh.almond

coursier-logger_2.13

0.14.5

Yes

sh.almond

interpreter-api_2.13

0.14.5

Yes

sh.almond

interpreter_2.13

0.14.5

Yes

sh.almond

jupyter-api_2.13

0.14.5

Yes

sh.almond

kernel_2.13

0.14.5

Yes

sh.almond

logger-scala2-macros_2.13

0.14.5

Yes

sh.almond

logger_2.13

0.14.5

Yes

sh.almond

protocol_2.13

0.14.5

Yes

sh.almond

scala-interpreter_2.13.18

0.14.5

Yes

sh.almond

scala-kernel-api_2.13.18

0.14.5

Yes

sh.almond

scala-kernel_2.13.18

0.14.5

Yes

sh.almond

shared-directives_2.13

0.14.5

Yes

sh.almond

toree-hooks_2.13

0.14.5

Yes