Skip to main content

Jira connector

Beta

This feature is in Beta. Workspace admins can control access to this feature from the Previews page. See Manage Databricks previews.

The managed Jira connector in Lakeflow Connect allows you to ingest data from Jira into Databricks.

What to know before you start

Topic

Why it matters

Databricks user persona

The workflow depends on your Databricks user persona:

  • Single-user: An admin user creates a Unity Catalog connection and an ingestion pipeline.
  • Multi-user: An admin user creates a connection for non-admin users to create pipelines with.

Authentication method

The steps to create a connection depend on the authentication method you choose.

Interface

The steps to create a pipeline depend on the interface.

Ingestion frequency

The pipeline schedule depends on your latency and cost requirements.

Common patterns

Depending on your ingestion needs, the pipeline might use configurations like history tracking, column selection, and row filtering. Supported configurations vary by connector. See Feature availability.

Start ingesting from Jira

The following table provides an overview of the end-to-end Jira ingestion flow, based on user type:

User

Steps

Admin

  1. Configure Jira to enable authentication from Databricks. See Configure Jira for ingestion.
  2. Either:
    • Use Catalog Explorer to create a connection to Jira so that non-admins can create pipelines. See Jira.
    • Use the data ingestion UI to create a connection and a pipeline at the same time. See Ingest data from Jira.

Non-admin

Use any supported interface to create a pipeline from an existing connection. See Ingest data from Jira.

Feature availability

Feature

Availability

UI-based pipeline authoring

Green check icon Supported

API-based pipeline authoring

Green check icon Supported

Declarative Automation Bundles

Green check icon Supported

Incremental ingestion

Green check icon Supported

Unity Catalog governance

Green check icon Supported

Orchestration using Databricks Workflows

Green check icon Supported

SCD type 2

Green check icon Supported

API-based column selection and deselection

Green check icon Supported

API-based row filtering

Green check icon Supported

Automated schema evolution: New and deleted columns

Green check icon Supported

Automated schema evolution: Data type changes

Red X icon Not supported

Automated schema evolution: Column renames

Green check icon Supported

Treated as a new column (new name) and deleted column (old name).

Automated schema evolution: New tables

N/A

Maximum number of tables per pipeline

250

Authentication methods

Authentication method

Availability

OAuth U2M

Green check icon Supported

OAuth M2M

Red X icon Not supported

OAuth (manual refresh token)

Red X icon Not supported

Basic authentication (username/password)

Red X icon Not supported

Basic authentication (API key)

Red X icon Not supported

Basic authentication (service account JSON key)

Red X icon Not supported