Pular para o conteúdo principal
Última atualização em

Serverless GPU environment version 4 (beta)

Beta

Serverless GPU compute on Databricks is in Beta. During Beta, the contents of the supported environments, including the list of packages or versions of installed packages, may change.

This article outlines the system environment information for Serverless GPU environment version 4.

To ensure compatibility for the application, Serverless GPU workloads use a versioned API, known as the environment version, which remains compatible with newer server versions.

You can select the environment version using the Environment side panel in your serverless notebooks. See Set up serverless GPU compute.

New features and improvements​

Serverless GPU environment 4 is built on top of serverless environment 4 (CPU). See what's new in serverless environment 4 (CPU). It includes two different environments:

API updates​

Dec 11, 2025

Serverless GPU Python API upgraded to 0.5.9​

The Serverless GPU Python API 0.5.9 includes the following API updates:

  • Bug fixes:

    • Fixed a bug where the notebook did not displaying the correct workload status.
    • Fixed a logging error with unexpected keyword argument.

Nov 19, 2025

Serverless GPU Python API upgraded to 0.5.8​

The Serverless GPU Python API 0.5.8 includes the following API updates:

  • Bug fixes:

    • Fixed an issue where interrupting the notebook cell did not stop the remote job.
    • Fixed a race condition in synchronization code which caused this error message: torch.distributed.DistBackendError: [1] is setting up NCCL communicator and retrieving ncclUniqueId from [0] via c10d key-value store by key '0', but store->get('0') got error: failed to recv, got 0 bytes.
    • Fixed an issue where a more general exception was being raised instead of a specific exception. This fix also covered additional race conditions that would lead to a final cell being marked as "Ran" instead of "Failed".

  • New features and improvements:

    • Increased the maximum number of A10 and H100 GPUs that a notebook can connect to from 16 to 32.
    • Added timeout and log flushing when syncing environments.

Oct 31, 2025

Serverless GPU Python API upgraded to 0.5.7​

The Serverless GPU Python API 0.5.7 includes the following API updates:

  • Bug fixes:
    • Fixed an issue where a remote job failure incorrectly showed success in the notebook cell.
    • Fixed an intermittent timeout issue during environment synchronization.
    • Fixed the "view logs" link display issue.

Oct 22, 2025

Serverless GPU Python API upgraded to 0.5.6​

The Serverless GPU Python API 0.5.6 includes the following API updates:

  • Bug fixes:
    • Fixed Py4jException error that caused the notebook to crash when running multiple workloads using serverless_gpu with remote=False.
    • Fixed an occasional torch.distributed.DistStoreError that could occur during multi-node training.
    • Fixed environment sync upload-download racing issue with new Python environment manager API.
  • Behavioral changes:
    • Updated default serverless GPU compute selection. By default, users now attach to reserved pools if they have access to them. Users can connect to on-demand pools by setting the "DATABRICKS_USE_POOL" flag. If users don't have access to reserved pools, they will always default to on-demand pools.

System environment​

  • Operating System: Ubuntu 24.04.2 LTS
  • Python: 3.12.3
  • Databricks Connect: 17.2.4
  • NVIDIA CUDA Toolkit: 12.6

Installed Python libraries​

Default base environment​

In addition to what's included in serverless environment 4 (CPU), serverless GPU environment 4 includes the following:

  • flash-attention 2.8.3
  • torch 2.7.1
  • torchvision 0.22.1

To reproduce serverless GPU environment 4 in your local Python virtual environment, download the requirements-env-gpu-4.txt file and run pip install -r requirements-env-gpu-4.txt. This command installs all of the open source libraries from serverless environment 4.

Library

Version

Library

Version

Library

Version

annotated-types

0.7.0

anyio

4.6.2

argon2-cffi

21.3.0

argon2-cffi-bindings

21.2.0

arrow

1.3.0

asttokens

2.0.5

astunparse

1.6.3

async-lru

2.0.4

attrs

24.3.0

autocommand

2.2.2

azure-common

1.1.28

azure-core

1.34.0

azure-identity

1.20.0

azure-mgmt-core

1.5.0

azure-mgmt-web

8.0.0

azure-storage-blob

12.23.0

azure-storage-file-datalake

12.17.0

babel

2.16.0

backports.tarfile

1.2.0

beautifulsoup4

4.12.3

black

24.10.0

bleach

6.2.0

blinker

1.7.0

boto3

1.36.2

botocore

1.36.3

cachetools

5.5.1

certifi

2025.1.31

cffi

1.17.1

chardet

4.0.0

charset-normalizer

3.3.2

click

8.1.7

cloudpickle

3.0.0

comm

0.2.1

contourpy

1.3.1

cryptography

43.0.3

cycler

0.11.0

Cython

3.0.12

databricks-connect

17.0.4

databricks-sdk

0.49.0

databricks.serverless_gpu

0.5.3

dbus-python

1.3.2

debugpy

1.8.11

decorator

5.1.1

defusedxml

0.7.1

Deprecated

1.2.13

distlib

0.3.9

docstring-to-markdown

0.11

executing

0.8.3

facets-overview

1.1.1

fastapi

0.115.12

fastjsonschema

2.21.1

filelock

3.13.1

fonttools

4.55.3

fqdn

1.5.1

fsspec

2023.5.0

future

1.0.0

gitdb

4.0.11

GitPython

3.1.43

google-api-core

2.20.0

google-auth

2.40.0

google-cloud-core

2.4.3

google-cloud-storage

3.1.0

google-crc32c

1.7.1

google-resumable-media

2.7.2

googleapis-common-protos

1.65.0

grpcio

1.67.0

grpcio-status

1.67.0

h11

0.14.0

httpcore

1.0.2

httplib2

0.20.4

httpx

0.27.0

idna

3.7

importlib-metadata

6.6.0

importlib_resources

6.4.0

inflect

7.3.1

iniconfig

1.1.1

ipyflow-core

0.0.209

ipykernel

6.29.5

ipython

8.30.0

ipython-genutils

0.2.0

ipywidgets

7.8.1

isodate

0.6.1

isoduration

20.11.0

jaraco.context

5.3.0

jaraco.functools

4.0.1

jaraco.text

3.12.1

jedi

0.19.2

Jinja2

3.1.5

jmespath

1.0.1

joblib

1.4.2

json5

0.9.25

jsonpointer

3.0.0

jsonschema

4.23.0

jsonschema-specifications

2023.7.1

jupyter-events

0.10.0

jupyter-lsp

2.2.0

jupyter_client

8.6.3

jupyter_core

5.7.2

jupyter_server

2.14.1

jupyter_server_terminals

0.4.4

jupyterlab

4.3.4

jupyterlab-pygments

0.1.2

jupyterlab-widgets

1.0.0

jupyterlab_server

2.27.3

kiwisolver

1.4.8

launchpadlib

1.11.0

lazr.restfulclient

0.14.6

lazr.uri

1.0.6

markdown-it-py

2.2.0

MarkupSafe

3.0.2

matplotlib

3.10.0

matplotlib-inline

0.1.7

mccabe

0.7.0

mdurl

0.1.0

mistune

2.0.4

mlflow-skinny

2.22.0

mmh3

5.1.0

more-itertools

10.3.0

mpmath

1.3.0

msal

1.32.3

msal-extensions

1.3.1

mypy-extensions

1.0.0

nbclient

0.8.0

nbconvert

7.16.4

nbformat

5.10.4

nest-asyncio

1.6.0

networkx

3.4.2

nodeenv

1.9.1

notebook

7.3.2

notebook_shim

0.2.3

numpy

2.1.3

nvidia-cublas-cu12

12.6.4.1

nvidia-cuda-cccl-cu12

12.6.77

nvidia-cuda-cupti-cu12

12.6.80

nvidia-cuda-nvrtc-cu12

12.6.77

nvidia-cuda-runtime-cu12

12.6.77

nvidia-cudnn-cu12

9.5.1.17

nvidia-cufft-cu12

11.3.0.4

nvidia-cufile-cu12

1.11.1.6

nvidia-curand-cu12

10.3.7.77

nvidia-cusolver-cu12

11.7.1.2

nvidia-cusparse-cu12

12.5.4.2

nvidia-cusparselt-cu12

0.6.3

nvidia-nccl-cu12

2.26.2

nvidia-nvjitlink-cu12

12.6.85

nvidia-nvtx-cu12

12.6.77

oauthlib

3.2.2

opentelemetry-api

1.32.1

opentelemetry-sdk

1.32.1

opentelemetry-semantic-conventions

0.53b1

overrides

7.4.0

packaging

24.1

pandas

2.2.3

pandocfilters

1.5.0

parambench-train-comms

0.0.0

parso

0.8.4

pathspec

0.10.3

patsy

1.0.1

pexpect

4.8.0

pillow

11.1.0

pip

25.0.1

platformdirs

3.10.0

plotly

5.24.1

pluggy

1.5.0

prometheus_client

0.21.0

prompt-toolkit

3.0.43

proto-plus

1.26.1

protobuf

5.29.4

psutil

5.9.0

psycopg2

2.9.3

ptyprocess

0.7.0

pure-eval

0.2.2

py4j

0.10.9.9

pyarrow

19.0.1

pyarrow-hotfix

0.7

pyasn1

0.4.8

pyasn1-modules

0.2.8

pyccolo

0.0.71

pycparser

2.21

pydantic

2.10.6

pydantic_core

2.27.2

pydot

4.0.0

pyflakes

3.2.0

Pygments

2.15.1

PyGObject

3.48.2

pyiceberg

0.9.0

PyJWT

2.10.1

pyodbc

5.2.0

pyparsing

3.2.0

pyright

1.1.394

pyspark

4.0.0+databricks.connect.17.2.4

pytest

8.3.5

python-dateutil

2.9.0.post0

python-json-logger

3.2.1

python-lsp-jsonrpc

1.1.2

python-lsp-server

1.12.0

pytoolconfig

1.2.6

pytz

2024.1

PyYAML

6.0.2

pyzmq

26.2.0

referencing

0.30.2

requests

2.32.3

rfc3339-validator

0.1.4

rfc3986-validator

0.1.1

rich

13.9.4

rope

1.12.0

rpds-py

0.22.3

rsa

4.9.1

s3transfer

0.11.3

scikit-learn

1.6.1

scipy

1.15.1

seaborn

0.13.2

Send2Trash

1.8.2

setuptools

74.0.0

six

1.16.0

smmap

5.0.0

sniffio

1.3.0

sortedcontainers

2.4.0

soupsieve

2.5

sqlparse

0.5.3

ssh-import-id

5.11

stack-data

0.2.0

starlette

0.46.2

statsmodels

0.14.4

strictyaml

1.7.3

sympy

1.13.3

tenacity

9.0.0

terminado

0.17.1

threadpoolctl

3.5.0

tinycss2

1.4.0

tokenize_rt

6.1.0

tomli

2.0.1

torch

2.7.1

torchvision

0.22.1

tornado

6.4.2

traitlets

5.14.3

triton

3.3.1

typeguard

4.3.0

types-python-dateutil

2.9.0.20241206

typing_extensions

4.12.2

tzdata

2024.1

ujson

5.10.0

unattended-upgrades

0.1

uri-template

1.3.0

urllib3

2.3.0

uvicorn

0.34.2

virtualenv

20.29.3

wadllib

1.3.6

wcwidth

0.2.5

webcolors

24.11.1

webencodings

0.5.1

websocket-client

1.8.0

whatthepatch

1.0.2

wheel

0.45.1

widgetsnbextension

3.6.6

wrapt

1.17.0

yapf

0.40.2

zipp

3.21.0

zstandard

0.23.0

AI environment​

The AI environment includes all the packages from the default base environment, as well as the following packages:

  • flash-attention 2.8.3
  • langchain 0.3.27
  • lightgbm 4.6.0
  • openai 1.106.1
  • optuna 4.5.0
  • ray 2.49.1
  • sentence-transformers 5.1.0
  • transformers 4.56.1
  • xgboost 3.0.4
  • pytorch-lightning 2.5.4

To reproduce AI environment V4 in your local Python virtual environment, download the requirements-ai-gpu-4.txt file and run pip install -r requirements-ai-gpu-4.txt. This command installs all the open source libraries from AI environment.

Library

Version

Library

Version

Library

Version

absl-py

2.3.1

accelerate

1.10.1

aiohappyeyeballs

2.4.4

aiohttp

3.11.10

aiohttp-cors

0.8.1

aiosignal

1.2.0

alembic

1.16.5

annotated-types

0.7.0

anyio

4.6.2

argon2-cffi

21.3.0

argon2-cffi-bindings

21.2.0

arrow

1.3.0

asttokens

2.0.5

astunparse

1.6.3

async-lru

2.0.4

attrs

24.3.0

audioread

3.0.1

autocommand

2.2.2

azure-common

1.1.28

azure-core

1.34.0

azure-identity

1.20.0

azure-mgmt-core

1.5.0

azure-mgmt-web

8.0.0

azure-storage-blob

12.23.0

azure-storage-file-datalake

12.17.0

babel

2.16.0

backports.tarfile

1.2.0

bcrypt

3.2.0

beautifulsoup4

4.12.3

black

24.10.0

bleach

6.2.0

blinker

1.7.0

blis

1.3.0

boto3

1.36.2

botocore

1.36.3

Brotli

1.1.0

cachetools

5.5.1

catalogue

2.0.10

certifi

2025.1.31

cffi

1.17.1

chardet

4.0.0

charset-normalizer

3.3.2

circuitbreaker

2.1.3

click

8.1.7

cloudpathlib

0.23.0

cloudpickle

3.0.0

colorful

0.5.7

colorlog

6.9.0

comm

0.2.1

confection

0.1.5

contourpy

1.3.1

cramjam

2.11.0

cryptography

43.0.3

cycler

0.11.0

cymem

2.0.11

Cython

3.0.12

databricks-agents

1.4.0

databricks-connect

17.2.4

databricks-sdk

0.49.0

databricks.serverless_gpu

0.5.6

dataclasses-json

0.6.7

datasets

4.0.0

dbus-python

1.3.2

debugpy

1.8.11

decorator

5.1.1

defusedxml

0.7.1

Deprecated

1.2.13

dill

0.3.8

distlib

0.3.9

dm-tree

0.1.9

docstring-to-markdown

0.11

evaluate

0.4.5

executing

0.8.3

facets-overview

1.1.1

Farama-Notifications

0.0.4

fastapi

0.115.12

fastjsonschema

2.21.1

filelock

3.13.1

flash_attn

2.8.3

fonttools

4.55.3

fqdn

1.5.1

frozenlist

1.5.0

fsspec

2023.5.0

future

1.0.0

gitdb

4.0.11

GitPython

3.1.43

google-api-core

2.20.0

google-auth

2.40.0

google-cloud-core

2.4.3

google-cloud-storage

3.1.0

google-crc32c

1.7.1

google-resumable-media

2.7.2

googleapis-common-protos

1.65.0

greenlet

3.1.1

grpcio

1.67.0

grpcio-status

1.67.0

gymnasium

1.1.1

h11

0.14.0

hf-xet

1.1.10

hf_transfer

0.1.9

httpcore

1.0.2

httplib2

0.20.4

httpx

0.27.0

httpx-sse

0.4.2

huggingface-hub

0.34.4

idna

3.7

importlib-metadata

6.6.0

importlib_resources

6.4.0

inflect

7.3.1

iniconfig

1.1.1

ipyflow-core

0.0.209

ipykernel

6.29.5

ipython

8.30.0

ipython-genutils

0.2.0

ipywidgets

7.8.1

isodate

0.6.1

isoduration

20.11.0

jaraco.context

5.3.0

jaraco.functools

4.0.1

jaraco.text

3.12.1

jedi

0.19.2

Jinja2

3.1.5

jiter

0.11.0

jmespath

1.0.1

joblib

1.4.2

json5

0.9.25

jsonpatch

1.33

jsonpointer

3.0.0

jsonschema

4.23.0

jsonschema-specifications

2023.7.1

jupyter-events

0.10.0

jupyter-lsp

2.2.0

jupyter_client

8.6.3

jupyter_core

5.7.2

jupyter_server

2.14.1

jupyter_server_terminals

0.4.4

jupyterlab

4.3.4

jupyterlab-pygments

0.1.2

jupyterlab-widgets

1.0.0

jupyterlab_server

2.27.3

kiwisolver

1.4.8

langchain

0.3.27

langchain-community

0.3.29

langchain-core

0.3.75

langchain-openai

0.3.32

langchain-text-splitters

0.3.11

langcodes

3.5.0

langsmith

0.4.34

language_data

1.3.0

launchpadlib

1.11.0

lazr.restfulclient

0.14.6

lazr.uri

1.0.6

lazy_loader

0.4

librosa

0.11.0

lightgbm

4.6.0

lightning-utilities

0.15.2

llvmlite

0.44.0

lz4

4.3.2

Mako

1.3.10

marisa-trie

1.3.1

markdown-it-py

2.2.0

MarkupSafe

3.0.2

marshmallow

3.26.1

matplotlib

3.10.0

matplotlib-inline

0.1.7

mccabe

0.7.0

mdurl

0.1.0

mistune

2.0.4

mlflow-skinny

2.22.0

mmh3

5.1.0

more-itertools

10.3.0

mosaicml-streaming

0.13.0

mpmath

1.3.0

msal

1.32.3

msal-extensions

1.3.1

msgpack

1.1.2

multidict

6.1.0

multiprocess

0.70.16

murmurhash

1.0.13

mypy-extensions

1.0.0

nbclient

0.8.0

nbconvert

7.16.4

nbformat

5.10.4

nest-asyncio

1.6.0

networkx

3.4.2

ninja

1.11.1.4

nodeenv

1.9.1

notebook

7.3.2

notebook_shim

0.2.3

numba

0.61.0

numpy

2.1.3

nvidia-cublas-cu12

12.6.4.1

nvidia-cuda-cccl-cu12

12.6.77

nvidia-cuda-cupti-cu12

12.6.80

nvidia-cuda-nvrtc-cu12

12.6.77

nvidia-cuda-runtime-cu12

12.6.77

nvidia-cudnn-cu12

9.5.1.17

nvidia-cufft-cu12

11.3.0.4

nvidia-cufile-cu12

1.11.1.6

nvidia-curand-cu12

10.3.7.77

nvidia-cusolver-cu12

11.7.1.2

nvidia-cusparse-cu12

12.5.4.2

nvidia-cusparselt-cu12

0.6.3

nvidia-ml-py

13.580.82

nvidia-nccl-cu12

2.26.2

nvidia-nvjitlink-cu12

12.6.85

nvidia-nvtx-cu12

12.6.77

oauthlib

3.2.2

oci

2.161.0

openai

1.106.1

opencensus

0.11.4

opencensus-context

0.1.3

opencv-python

4.12.0.88

opentelemetry-api

1.32.1

opentelemetry-exporter-prometheus

0.53b1

opentelemetry-proto

1.37.0

opentelemetry-sdk

1.32.1

opentelemetry-semantic-conventions

0.53b1

optuna

4.5.0

optuna-integration

4.5.0

orjson

3.11.3

ormsgpack

1.7.0

overrides

7.4.0

packaging

24.1

pandas

2.2.3

pandocfilters

1.5.0

parambench-train-comms

0.0.0

paramiko

3.5.1

parso

0.8.4

pathspec

0.10.3

patsy

1.0.1

peft

0.17.1

pexpect

4.8.0

pillow

11.1.0

pip

25.0.1

platformdirs

3.10.0

plotly

5.24.1

pluggy

1.5.0

pooch

1.8.2

preshed

3.0.10

prometheus_client

0.21.0

prompt-toolkit

3.0.43

propcache

0.2.0

proto-plus

1.26.1

protobuf

5.29.4

psutil

5.9.0

psycopg2

2.9.3

ptyprocess

0.7.0

pure-eval

0.2.2

py-spy

0.4.1

py4j

0.10.9.9

pyarrow

19.0.1

pyarrow-hotfix

0.7

pyasn1

0.4.8

pyasn1-modules

0.2.8

pyccolo

0.0.71

pycparser

2.21

pydantic

2.10.6

pydantic-settings

2.11.0

pydantic_core

2.27.2

pydot

4.0.0

pyflakes

3.2.0

Pygments

2.15.1

PyGObject

3.48.2

pyiceberg

0.9.0

PyJWT

2.10.1

PyNaCl

1.5.0

pynndescent

0.5.13

pynvml

13.0.1

pyodbc

5.2.0

pyOpenSSL

24.2.1

pyparsing

3.2.0

pyright

1.1.394

pyspark

4.0.0+databricks.connect.17.2.2

pytesseract

0.3.13

pytest

8.3.5

python-dateutil

2.9.0.post0

python-dotenv

1.1.1

python-json-logger

3.2.1

python-lsp-jsonrpc

1.1.2

python-lsp-server

1.12.0

python-snappy

0.7.3

pytoolconfig

1.2.6

pytorch-lightning

2.5.4

pytorch-ranger

0.1.1

pytz

2024.1

PyYAML

6.0.2

pyzmq

26.2.0

ray

2.49.1

referencing

0.30.2

regex

2024.11.6

requests

2.32.3

requests-toolbelt

1.0.0

rfc3339-validator

0.1.4

rfc3986-validator

0.1.1

rich

13.9.4

rope

1.12.0

rpds-py

0.22.3

rsa

4.9.1

s3transfer

0.11.3

safetensors

0.6.2

scikit-learn

1.6.1

scipy

1.15.1

seaborn

0.13.2

Send2Trash

1.8.2

sentence-transformers

5.1.0

sentencepiece

0.2.1

setuptools

74.0.0

shap

0.48.0

shellingham

1.5.4

six

1.16.0

slicer

0.0.8

smart_open

7.3.1

smmap

5.0.0

sniffio

1.3.0

sortedcontainers

2.4.0

soundfile

0.13.1

soupsieve

2.5

soxr

1.0.0

spacy

3.8.7

spacy-legacy

3.0.12

spacy-loggers

1.0.5

SQLAlchemy

2.0.37

sqlparse

0.5.3

srsly

2.5.1

ssh-import-id

5.11

stack-data

0.2.0

starlette

0.46.2

statsmodels

0.14.4

stevedore

5.5.0

strictyaml

1.7.3

sympy

1.13.3

tabulate

0.9.0

tenacity

9.0.0

tensorboardX

2.6.4

terminado

0.17.1

thinc

8.3.6

threadpoolctl

3.5.0

tiktoken

0.9.0

tinycss2

1.4.0

tokenize_rt

6.1.0

tokenizers

0.22.0

tomli

2.0.1

torch

2.7.1

torch-optimizer

0.3.0

torchmetrics

1.8.2

torchvision

0.22.1

tornado

6.4.2

tqdm

4.67.1

traitlets

5.14.3

transformers

4.56.1

triton

3.3.1

typeguard

4.3.0

typer

0.19.2

types-python-dateutil

2.9.0.20241206

typing-inspect

0.9.0

typing-inspection

0.4.2

typing_extensions

4.12.2

tzdata

2024.1

ujson

5.10.0

umap-learn

0.5.9.post2

unattended-upgrades

0.1

uri-template

1.3.0

urllib3

2.3.0

uvicorn

0.34.2

virtualenv

20.29.3

virtualenv-clone

0.5.7

virtualenvwrapper

6.1.1

wadllib

1.3.6

wasabi

1.1.3

wcwidth

0.2.5

weasel

0.4.1

webcolors

24.11.1

webencodings

0.5.1

websocket-client

1.8.0

whatthepatch

1.0.2

wheel

0.45.1

whenever

0.7.3

widgetsnbextension

3.6.6

wrapt

1.17.0

xgboost

3.0.4

xgboost-ray

0.1.19

xxhash

3.5.0

yapf

0.40.2

yarl

1.18.0

zipp

3.21.0

zstandard

0.23.0

zstd

1.5.5.1