Skip to main content
Last updated on

Serverless GPU environment version 5 (Beta)

Beta

Serverless GPU compute on Databricks is in Beta. During Beta, the contents of the supported environments, including the list of packages or versions of installed packages, might change.

This page outlines the system environment information for Serverless GPU environment version 5.

Serverless GPU environment 5 is built on top of serverless environment 5 (CPU). See what's new in serverless environment 5 (CPU). It includes two different environments:

To ensure compatibility for the application, Serverless GPU workloads use a versioned API, known as the environment version, which remains compatible with newer server versions.

You can select the environment version using the Environment side panel in your serverless notebooks. See Set up serverless GPU compute.

New features and improvements​

In version 5, Databricks is providing a minimal environment that supports only serverless GPU API, the Databricks dependencies, and MLflow. Users can customize the environment to their needs. The default base environment in version 5 does not include certain packages present in the CPU environment, in order to provide a minimal functional GPU environment. Users wanting a complete environment with comprehensive AI libraries should use the Databricks AI environment.

Packages added to Databricks AI environment​

The following new packages have been added to the Databricks AI environment in version 5:

  • catboost 1.2.8
  • trl 0.23.0
  • unsloth 2025.11.3
  • vllm 0.13.0
  • omegaconf 2.3.0
  • statsmodels 0.14.4
  • networkx 3.4.2

Packages removed from Databricks AI environment​

The following packages have been removed from the Databricks AI environment in version 5:

  • spacy
  • sentencepiece

Packages not included in base environment​

The following packages are not included in the base environment but remain available in the CPU environment:

  • scipy
  • seaborn
  • scikit-learn

The following packages are not included in the base environment but remain available in the Databricks AI environment:

  • flash-attention
  • torch
  • torchvision

System environment​

  • Operating System: Ubuntu 24.04.2 LTS
  • Python: 3.12.3
  • Databricks Connect: 18.0.0
  • NVIDIA CUDA Toolkit: 12.9

Installed Python libraries​

Default base environment​

To reproduce serverless GPU environment 5 in your local Python virtual environment, download the requirements-env-gpu-5.txt file and run pip install -r requirements-env-gpu-5.txt. This command installs all of the open source libraries from serverless environment 5.

Library

Version

Library

Version

Library

Version

aiohappyeyeballs

2.4.4

aiohttp

3.11.10

aiosignal

1.2.0

annotated-doc

0.0.4

annotated-types

0.7.0

anyio

4.7.0

argon2-cffi

21.3.0

argon2-cffi-bindings

21.2.0

arro3-core

0.6.5

arrow

1.3.0

asttokens

3.0.0

astunparse

1.6.3

async-lru

2.0.4

attrs

24.3.0

azure-common

1.1.28

azure-core

1.37.0

azure-identity

1.20.0

azure-mgmt-core

1.6.0

azure-mgmt-web

8.0.0

azure-storage-blob

12.28.0

azure-storage-file-datalake

12.22.0

babel

2.16.0

beautifulsoup4

4.12.3

black

24.10.0

bleach

6.2.0

blinker

1.7.0

boto3

1.40.45

botocore

1.40.45

cachetools

5.5.1

certifi

2025.4.26

cffi

1.17.1

chardet

4.0.0

charset-normalizer

3.3.2

click

8.1.8

cloudpickle

3.0.0

comm

0.2.1

contourpy

1.3.1

cryptography

44.0.1

cycler

0.11.0

Cython

3.1.5

databricks-agents

1.9.1

databricks-connect

18.0.0

databricks-sdk

0.67.0

databricks.serverless_gpu

0.5.11

dataclasses-json

0.6.7

dbus-python

1.3.2

debugpy

1.8.11

decorator

5.1.1

defusedxml

0.7.1

deltalake

1.1.4

Deprecated

1.2.18

distlib

0.3.9

distro

1.9.0

distro-info

1.7+build1

docstring-to-markdown

0.11

executing

1.2.0

facets-overview

1.1.1

fastapi

0.128.0

fastjsonschema

2.21.1

filelock

3.17.0

fonttools

4.55.3

fqdn

1.5.1

frozenlist

1.5.0

fsspec

2023.5.0

future

1.0.0

gitdb

4.0.11

GitPython

3.1.43

google-api-core

2.28.1

google-auth

2.47.0

google-cloud-core

2.5.0

google-cloud-storage

3.7.0

google-crc32c

1.8.0

google-resumable-media

2.8.0

googleapis-common-protos

1.65.0

grpcio

1.67.0

grpcio-status

1.67.0

h11

0.16.0

hf-xet

1.2.0

httpcore

1.0.9

httplib2

0.20.4

httpx

0.28.1

huggingface_hub

1.2.4

idna

3.7

importlib_metadata

8.5.0

iniconfig

1.1.1

ipyflow-core

0.0.209

ipykernel

6.29.5

ipython

8.30.0

ipython-genutils

0.2.0

ipywidgets

7.8.1

isodate

0.7.2

isoduration

20.11.0

jedi

0.19.2

Jinja2

3.1.6

jiter

0.12.0

jmespath

1.0.1

joblib

1.4.2

json5

0.9.25

jsonpatch

1.33

jsonpointer

3.0.0

jsonschema

4.23.0

jsonschema-specifications

2023.7.1

jupyter_client

8.6.3

jupyter_core

5.7.2

jupyter-events

0.12.0

jupyter-lsp

2.2.5

jupyter_server

2.15.0

jupyter_server_terminals

0.5.3

jupyterlab

4.3.4

jupyterlab_pygments

0.3.0

jupyterlab_server

2.27.3

jupyterlab_widgets

1.1.11

kiwisolver

1.4.8

langchain-core

1.2.6

langchain-openai

1.1.6

langsmith

0.6.1

launchpadlib

1.11.0

lazr.restfulclient

0.14.6

lazr.uri

1.0.6

litellm

1.75.9

markdown-it-py

2.2.0

MarkupSafe

3.0.2

marshmallow

3.26.2

matplotlib

3.10.0

matplotlib-inline

0.1.7

mccabe

0.7.0

mdurl

0.1.0

mistune

3.1.2

mlflow-skinny

3.8.1

mmh3

5.2.0

msal

1.34.0

msal-extensions

1.3.1

multidict

6.1.0

mypy-extensions

1.0.0

nbclient

0.10.2

nbconvert

7.16.6

nbformat

5.10.4

nest-asyncio

1.6.0

nodeenv

1.10.0

notebook

7.3.2

notebook_shim

0.2.4

numpy

2.1.3

nvidia-ml-py

13.590.44

oauthlib

3.2.2

openai

2.14.0

opentelemetry-api

1.39.1

opentelemetry-proto

1.39.1

opentelemetry-sdk

1.39.1

opentelemetry-semantic-conventions

0.60b1

orjson

3.11.5

overrides

7.4.0

packaging

24.2

pandas

2.2.3

pandocfilters

1.5.0

parambench-train-comms

0.0.0

parso

0.8.4

pathspec

0.10.3

patsy

1.0.1

pexpect

4.8.0

pillow

11.1.0

pip

25.0.1

platformdirs

4.3.7

plotly

5.24.1

pluggy

1.5.0

prometheus_client

0.21.1

prompt-toolkit

3.0.43

propcache

0.3.1

proto-plus

1.27.0

protobuf

5.29.4

psutil

5.9.0

psycopg2

2.9.11

ptyprocess

0.7.0

pure-eval

0.2.2

py4j

0.10.9.9

pyarrow

21.0.0

pyasn1

0.4.8

pyasn1-modules

0.2.8

pyccolo

0.0.71

pycparser

2.21

pydantic

2.10.6

pydantic_core

2.27.2

pydot

4.0.0

pyflakes

3.2.0

Pygments

2.19.1

PyGObject

3.48.2

pyiceberg

0.10.0

PyJWT

2.10.1

pyodbc

5.2.0

pyparsing

3.2.0

pyright

1.1.394

pyroaring

1.0.3

pyspark

4.1.0+databricks.connect.18.0.0

pytest

8.3.5

python-apt

2.7.7+ubuntu5.1

python-dateutil

2.9.0.post0

python-dotenv

1.2.1

python-json-logger

3.2.1

python-lsp-jsonrpc

1.1.2

python-lsp-server

1.12.2

pytoolconfig

1.2.6

pytz

2024.1

PyYAML

6.0.2

pyzmq

26.2.0

referencing

0.30.2

regex

2024.11.6

requests

2.32.3

requests-toolbelt

1.0.0

rfc3339-validator

0.1.4

rfc3986-validator

0.1.1

rich

13.9.4

rope

1.13.0

rpds-py

0.22.3

rsa

4.9.1

s3transfer

0.14.0

Send2Trash

1.8.2

setuptools

78.1.1

shellingham

1.5.4

six

1.17.0

smmap

5.0.0

sniffio

1.3.0

sortedcontainers

2.4.0

soupsieve

2.5

sqlparse

0.5.5

ssh-import-id

5.11

stack-data

0.6.3

starlette

0.50.0

strictyaml

1.7.3

tenacity

9.0.0

terminado

0.17.1

threadpoolctl

3.5.0

tiktoken

0.12.0

tinycss2

1.4.0

tokenize_rt

6.1.0

tokenizers

0.22.2

tomli

2.0.1

tornado

6.5.1

tqdm

4.67.1

traitlets

5.14.3

typer-slim

0.21.1

types-python-dateutil

2.9.0.20251115

typing_extensions

4.12.2

typing-inspect

0.9.0

tzdata

2024.1

ujson

5.10.0

unattended-upgrades

0.1

uri-template

1.3.0

urllib3

2.3.0

uuid_utils

0.12.0

uvicorn

0.40.0

virtualenv

20.29.3

wadllib

1.3.6

wcwidth

0.2.5

webcolors

25.10.0

webencodings

0.5.1

websocket-client

1.8.0

whatthepatch

1.0.2

wheel

0.45.1

whenever

0.7.3

widgetsnbextension

3.6.6

wrapt

1.17.0

yapf

0.40.2

yarl

1.18.0

zipp

3.21.0

zstandard

0.23.0

AI environment​

The AI environment includes all the packages from the default base environment, as well as the following packages. This environment includes PyTorch and comprehensive machine learning libraries:

  • torch 2.9.0
  • torchvision 0.24.0
  • flash_attn 2.8.3
  • catboost 1.2.8
  • langchain 0.3.27
  • lightgbm 4.6.0
  • openai 2.7.0
  • optuna 4.5.0
  • pytorch-lightning 2.5.4
  • ray 2.51.1
  • scikit-learn 1.6.1
  • scipy 1.15.3
  • seaborn 0.13.2
  • sentence-transformers 5.1.2
  • transformers 4.57.1
  • trl 0.23.0
  • unsloth 2025.11.3
  • vllm 0.13.0
  • xgboost 3.0.4

To reproduce AI environment V5 in your local Python virtual environment, download the requirements-ai-gpu-5.txt file and run pip install -r requirements-ai-gpu-5.txt. This command installs all the open source libraries from AI environment.

Library

Version

Library

Version

Library

Version

absl-py

2.3.1

accelerate

1.11.0

aiohappyeyeballs

2.4.4

aiohttp

3.11.10

aiohttp-cors

0.8.1

aiosignal

1.2.0

alembic

1.18.0

annotated-doc

0.0.4

annotated-types

0.7.0

anthropic

0.71.0

antlr4-python3-runtime

4.9.3

anyio

4.7.0

apache-tvm-ffi

0.1.8.post2

argon2-cffi

21.3.0

argon2-cffi-bindings

21.2.0

arro3-core

0.6.5

arrow

1.3.0

astor

0.8.1

asttokens

3.0.0

astunparse

1.6.3

async-lru

2.0.4

attrs

24.3.0

audioread

3.1.0

azure-common

1.1.28

azure-core

1.37.0

azure-identity

1.20.0

azure-mgmt-core

1.6.0

azure-mgmt-web

8.0.0

azure-storage-blob

12.28.0

azure-storage-file-datalake

12.22.0

babel

2.16.0

bcrypt

4.3.0

beautifulsoup4

4.12.3

bitsandbytes

0.49.1

black

24.10.0

blake3

1.0.8

bleach

6.2.0

blinker

1.7.0

boto3

1.40.45

botocore

1.40.45

brotli

1.2.0

cachetools

5.5.1

catalogue

2.0.10

catboost

1.2.8

cbor2

5.8.0

certifi

2025.4.26

cffi

1.17.1

chardet

4.0.0

charset-normalizer

3.3.2

circuitbreaker

2.1.3

click

8.1.8

cloudpickle

3.0.0

colorful

0.5.8

colorlog

6.10.1

comm

0.2.1

compressed-tensors

0.12.2

contourpy

1.3.1

cramjam

2.11.0

cryptography

44.0.1

cuda-bindings

13.1.1

cuda-pathfinder

1.3.3

cuda-python

13.1.1

cupy-cuda12x

13.6.0

cut-cross-entropy

25.1.1

cycler

0.11.0

Cython

3.1.5

databricks-agents

1.9.1

databricks-connect

18.0.0

databricks-sdk

0.67.0

databricks.serverless_gpu

0.5.11

dataclasses-json

0.6.7

datasets

4.3.0

dbus-python

1.3.2

debugpy

1.8.11

decorator

5.1.1

defusedxml

0.7.1

deltalake

1.1.4

Deprecated

1.2.18

depyf

0.20.0

diffusers

0.36.0

dill

0.3.8

diskcache

5.6.3

distlib

0.3.9

distro

1.9.0

distro-info

1.7+build1

dm-tree

0.1.9

dnspython

2.8.0

docstring_parser

0.17.0

docstring-to-markdown

0.11

einops

0.8.1

email-validator

2.3.0

evaluate

0.4.6

executing

1.2.0

facets-overview

1.1.1

Farama-Notifications

0.0.4

fastapi

0.128.0

fastapi-cli

0.0.20

fastapi-cloud-cli

0.9.0

fastar

0.8.0

fastjsonschema

2.21.1

fastrlock

0.8.3

filelock

3.17.0

flash_attn

2.8.3

flashinfer-python

0.5.3

fonttools

4.55.3

fqdn

1.5.1

frozenlist

1.5.0

fsspec

2023.5.0

future

1.0.0

gguf

0.17.1

gitdb

4.0.11

GitPython

3.1.43

google-api-core

2.28.1

google-auth

2.47.0

google-cloud-core

2.5.0

google-cloud-storage

3.2.0

google-crc32c

1.8.0

google-resumable-media

2.8.0

googleapis-common-protos

1.65.0

graphviz

0.21

greenlet

3.1.1

grpcio

1.67.0

grpcio-status

1.67.0

gymnasium

1.1.1

h11

0.16.0

hf_transfer

0.1.9

hf-xet

1.2.0

httpcore

1.0.9

httplib2

0.20.4

httptools

0.7.1

httpx

0.28.1

httpx-sse

0.4.3

huggingface-hub

0.34.4

idna

3.7

ijson

3.4.0.post0

importlib_metadata

8.5.0

iniconfig

1.1.1

interegular

0.3.3

ipyflow-core

0.0.209

ipykernel

6.29.5

ipython

8.30.0

ipython-genutils

0.2.0

ipywidgets

7.8.1

isodate

0.7.2

isoduration

20.11.0

jedi

0.19.2

Jinja2

3.1.6

jiter

0.12.0

jmespath

1.0.1

joblib

1.4.2

json5

0.9.25

jsonpatch

1.33

jsonpointer

3.0.0

jsonschema

4.23.0

jsonschema-specifications

2023.7.1

jupyter_client

8.6.3

jupyter_core

5.7.2

jupyter-events

0.12.0

jupyter-lsp

2.2.5

jupyter_server

2.15.0

jupyter_server_terminals

0.5.3

jupyterlab

4.3.4

jupyterlab_pygments

0.3.0

jupyterlab_server

2.27.3

jupyterlab_widgets

1.1.11

kiwisolver

1.4.8

langchain

0.3.27

langchain-community

0.3.31

langchain-core

0.3.79

langchain-openai

0.3.35

langchain-text-splitters

0.3.11

langsmith

0.6.1

lark

1.2.2

launchpadlib

1.11.0

lazr.restfulclient

0.14.6

lazr.uri

1.0.6

lazy_loader

0.4

librosa

0.11.0

lightgbm

4.6.0

lightning-utilities

0.15.2

litellm

1.75.9

llguidance

1.3.0

llvmlite

0.44.0

lm-format-enforcer

0.11.3

loguru

0.7.3

lz4

4.3.2

Mako

1.3.10

markdown-it-py

2.2.0

MarkupSafe

3.0.2

marshmallow

3.26.2

matplotlib

3.10.0

matplotlib-inline

0.1.7

mccabe

0.7.0

mcp

1.25.0

mdurl

0.1.0

mistral_common

1.8.8

mistune

3.1.2

mlflow-skinny

3.8.1

mmh3

5.2.0

model-hosting-container-standards

0.1.13

mosaicml-streaming

0.13.0

mpmath

1.3.0

msal

1.34.0

msal-extensions

1.3.1

msgpack

1.1.2

msgspec

0.20.0

multidict

6.1.0

multiprocess

0.70.16

mypy-extensions

1.0.0

nbclient

0.10.2

nbconvert

7.16.6

nbformat

5.10.4

nest-asyncio

1.6.0

networkx

3.4.2

ninja

1.13.0

nodeenv

1.10.0

notebook

7.3.2

notebook_shim

0.2.4

numba

0.61.2

numpy

2.1.3

nvidia-cublas-cu12

12.8.4.1

nvidia-cuda-cupti-cu12

12.8.90

nvidia-cuda-nvrtc-cu12

12.8.93

nvidia-cuda-runtime-cu12

12.8.90

nvidia-cudnn-cu12

9.10.2.21

nvidia-cudnn-frontend

1.17.0

nvidia-cufft-cu12

11.3.3.83

nvidia-cufile-cu12

1.13.1.3

nvidia-curand-cu12

10.3.9.90

nvidia-cusolver-cu12

11.7.3.90

nvidia-cusparse-cu12

12.5.8.93

nvidia-cusparselt-cu12

0.7.1

nvidia-cutlass-dsl

4.3.5

nvidia-ml-py

13.590.44

nvidia-nccl-cu12

2.27.5

nvidia-nvjitlink-cu12

12.8.93

nvidia-nvshmem-cu12

3.3.20

nvidia-nvtx-cu12

12.8.90

oauthlib

3.2.2

oci

2.165.0

omegaconf

2.3.0

openai

2.7.0

openai-harmony

0.0.8

opencensus

0.11.4

opencensus-context

0.1.3

opencv-python

4.12.0.88

opencv-python-headless

4.12.0.88

opentelemetry-api

1.39.1

opentelemetry-exporter-prometheus

0.60b1

opentelemetry-proto

1.39.1

opentelemetry-sdk

1.39.1

opentelemetry-semantic-conventions

0.60b1

optuna

4.5.0

optuna-integration

4.5.0

orjson

3.11.5

ormsgpack

1.7.0

outlines_core

0.2.11

overrides

7.4.0

packaging

24.2

pandas

2.2.3

pandocfilters

1.5.0

parambench-train-comms

0.0.0

paramiko

3.5.1

parso

0.8.4

partial-json-parser

0.2.1.1.post7

pathspec

0.10.3

patsy

1.0.1

peft

0.17.1

pexpect

4.8.0

pillow

11.1.0

pip

25.0.1

platformdirs

4.3.7

plotly

5.24.1

pluggy

1.5.0

pooch

1.8.2

prometheus_client

0.21.1

prometheus-fastapi-instrumentator

7.1.0

prompt-toolkit

3.0.43

propcache

0.3.1

proto-plus

1.27.0

protobuf

5.29.4

psutil

5.9.0

psycopg2

2.9.11

ptyprocess

0.7.0

pure-eval

0.2.2

py-cpuinfo

9.0.0

py-spy

0.4.1

py4j

0.10.9.9

pyarrow

21.0.0

pyasn1

0.4.8

pyasn1-modules

0.2.8

pybase64

1.4.3

pyccolo

0.0.71

pycountry

24.6.1

pycparser

2.21

pydantic

2.12.0

pydantic_core

2.41.1

pydantic-extra-types

2.11.0

pydantic-settings

2.12.0

pydot

4.0.0

pyflakes

3.2.0

Pygments

2.19.1

PyGObject

3.48.2

pyiceberg

0.10.0

PyJWT

2.10.1

PyNaCl

1.5.0

pynndescent

0.6.0

pyodbc

5.2.0

pyOpenSSL

25.0.0

pyparsing

3.2.0

pyright

1.1.394

pyroaring

1.0.3

pyspark

4.1.0+databricks.connect.18.0.0

pytesseract

0.3.13

pytest

8.3.5

python-apt

2.7.7+ubuntu5.1

python-dateutil

2.9.0.post0

python-dotenv

1.1.1

python-json-logger

3.2.1

python-lsp-jsonrpc

1.1.2

python-lsp-server

1.12.2

python-multipart

0.0.21

python-snappy

0.7.3

pytoolconfig

1.2.6

pytorch-lightning

2.5.4

pytorch-ranger

0.1.1

pytz

2024.1

PyYAML

6.0.2

pyzmq

26.2.0

ray

2.51.1

referencing

0.30.2

regex

2024.11.6

requests

2.32.5

requests-toolbelt

1.0.0

rfc3339-validator

0.1.4

rfc3986-validator

0.1.1

rich

13.9.4

rich-toolkit

0.17.1

rignore

0.7.6

rope

1.13.0

rpds-py

0.22.3

rsa

4.9.1

s3transfer

0.14.0

safetensors

0.7.0

scikit-learn

1.6.1

scipy

1.15.3

seaborn

0.13.2

Send2Trash

1.8.2

sentence-transformers

5.1.2

sentencepiece

0.2.1

sentry-sdk

2.49.0

setproctitle

1.3.7

setuptools

78.1.1

shap

0.49.1

shellingham

1.5.4

six

1.17.0

slicer

0.0.8

smart_open

7.5.0

smmap

5.0.0

sniffio

1.3.0

sortedcontainers

2.4.0

soundfile

0.13.1

soupsieve

2.5

soxr

1.0.0

SQLAlchemy

2.0.39

sqlparse

0.5.5

sse-starlette

3.1.2

ssh-import-id

5.11

stack-data

0.6.3

starlette

0.50.0

statsmodels

0.14.4

stevedore

5.6.0

strictyaml

1.7.3

supervisor

4.3.0

sympy

1.13.3

tabulate

0.9.0

tenacity

9.0.0

tensorboardX

2.6.4

terminado

0.17.1

threadpoolctl

3.5.0

tiktoken

0.9.0

tinycss2

1.4.0

tokenize_rt

6.1.0

tokenizers

0.22.1

tomli

2.0.1

torch

2.9.0

torch-optimizer

0.3.0

torchao

0.15.0

torchaudio

2.9.0

torchmetrics

1.8.2

torchvision

0.24.0

tornado

6.5.1

tqdm

4.67.1

traitlets

5.14.3

transformers

4.57.1

triton

3.5.0

trl

0.23.0

typeguard

4.4.4

typer

0.21.1

typer-slim

0.21.1

types-python-dateutil

2.9.0.20251115

typing_extensions

4.14.1

typing-inspect

0.9.0

typing-inspection

0.4.2

tyro

1.0.4

tzdata

2024.1

ujson

5.10.0

umap-learn

0.5.9.post2

unattended-upgrades

0.1

unsloth

2025.11.3

unsloth_zoo

2026.1.2

uri-template

1.3.0

urllib3

2.3.0

uuid_utils

0.12.0

uvicorn

0.40.0

uvloop

0.22.1

virtualenv

20.29.3

virtualenv-clone

0.5.7

virtualenvwrapper

6.1.1

vllm

0.13.0

wadllib

1.3.6

watchfiles

1.1.1

wcwidth

0.2.5

webcolors

25.10.0

webencodings

0.5.1

websocket-client

1.8.0

websockets

16.0

whatthepatch

1.0.2

wheel

0.45.1

whenever

0.7.3

widgetsnbextension

3.6.6

wrapt

1.17.0

xformers

0.0.33.post1

xgboost

3.0.4

xgboost-ray

0.1.19

xgrammar

0.1.27

xxhash

3.5.0

yapf

0.40.2

yarl

1.18.0

zipp

3.21.0

zstandard

0.23.0

zstd

1.5.5.1