Azure DevOps connector reference
This feature is in Beta. To use it, a workspace admin must turn on Lakeflow Connect for Azure DevOps from the Previews page. See Manage Databricks previews.
This page has reference information for the managed Azure DevOps connector, including supported source tables and destination table schemas.
Supported source tables
The Azure DevOps connector supports the following source tables, all under the default source schema:
Source table | Primary key | Description | Sync mode | Cursor field |
|---|---|---|---|---|
|
| Projects in the organization. | Full refresh only | |
|
| Area path classification nodes for each project. | Full refresh only | |
|
| Teams in the organization. | Full refresh only | |
|
| Iteration path classification nodes for each project. | Full refresh only | |
|
| Git repositories in each project. | Full refresh only | |
|
| Commits in each Git repository. | Incremental |
|
|
| Build pipeline definitions in each project. | Full refresh only | |
|
| Security groups in the organization. | Full refresh only | |
|
| Direct members of each group. | Full refresh only | |
|
| Users in the organization. | Full refresh only | |
|
| Service principals in the organization. | Full refresh only | |
|
| Work item revisions in each project, including deleted work items. | Full refresh only | |
|
| Builds in each project, excluding deleted builds. | Full refresh only | |
|
| Pull requests in each Git repository, in any status. | Full refresh only | |
|
| Classic releases in each project, excluding deleted releases. | Full refresh only | |
|
| Test runs in each project. | Full refresh only | |
|
| Service hook subscriptions in the organization. | Full refresh only |
Connector options
For usage, see Examples.
Option | Type | Scope | Required | Applies to | Description |
|---|---|---|---|---|---|
| String | Pipeline | No |
| Earliest commit date to ingest on the first sync, in |
Destination table schemas
projects
Primary key: id
Sync mode: Full refresh only
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
area_paths
Primary key: project_id, identifier
Sync mode: Full refresh only
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This table does not support SCD type 2 because it has VARIANT columns.
teams
Primary key: id
Sync mode: Full refresh only
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This table does not support SCD type 2 because it has VARIANT columns.
iterations
Primary key: project_id, identifier
Sync mode: Full refresh only
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This table does not support SCD type 2 because it has VARIANT columns.
git_repositories
Primary key: id
Sync mode: Full refresh only
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This table does not support SCD type 2 because it has VARIANT columns.
commits
Primary key: commitId, repository_id
Cursor field: committedDate
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This table does not support SCD type 2 because it has VARIANT columns.
build_definitions
Primary key: id, project_id
Sync mode: Full refresh only
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This table does not support SCD type 2 because it has VARIANT columns.
groups
Primary key: descriptor
Sync mode: Full refresh only
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This table does not support SCD type 2 because it has VARIANT columns.
group_members
Primary key: containerDescriptor, memberDescriptor
Sync mode: Full refresh only
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
This table does not support SCD type 2 because it has VARIANT columns.
users
Primary key: descriptor
Sync mode: Full refresh only
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This table does not support SCD type 2 because it has VARIANT columns.
service_principals
Primary key: descriptor
Sync mode: Full refresh only
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This table does not support SCD type 2 because it has VARIANT columns.
work_items
Primary key: id, rev
Sync mode: Full refresh only
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This table does not support SCD type 2 because it has VARIANT columns.
builds
Primary key: id, project_id
Sync mode: Full refresh only
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This table does not support SCD type 2 because it has VARIANT columns.
pull_requests
Primary key: pullRequestId, repository_id
Sync mode: Full refresh only
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This table does not support SCD type 2 because it has VARIANT columns.
releases
Primary key: id, project_id
Sync mode: Full refresh only
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This table does not support SCD type 2 because it has VARIANT columns.
test_runs
Primary key: id, project_id
Sync mode: Full refresh only
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This table does not support SCD type 2 because it has VARIANT columns.
service_hooks_subscriptions
Primary key: id
Sync mode: Full refresh only
Field | Data type |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
This table does not support SCD type 2 because it has VARIANT columns.