ServiceNow connector reference

Preview

The ServiceNow connector is in gated Public Preview. To participate in the preview, contact your Databricks account team.

This article contains reference material for ingestion using the ServiceNow connector in Databricks Lakeflow Connect.

General connector behavior

The connector can ingest both standard and custom tables.
When ingesting reference fields, Databricks creates a nested struct with a link field and a value field. The link field links to the referenced table. The value field refers to the sys_id (primary key) in the referenced table. Together, these fields can be used to join the referenced table.
When you select a schema, you are selecting not only the current tables but also the future tables that get added to the schema. To ingest only the current tables, manually list them during pipeline setup.
The connector ingests an extra column called sys_mod_count. This is provided by ServiceNow, and it tracks the number of times a given row has been updated.

Databricks automatically transforms the following ServiceNow data types to Delta-compatible data types:

ServiceNow type	Delta type
`string`	`StringType`
`boolean`	`BooleanType`
`int`	`IntegerType`
`integer`	`IntegerType`
`long`	`LongType`
`longint`	`LongType`
`float`	`FloatType`
`double`	`DoubleType`
`decimal`	`DecimalType.SYSTEM_DEFAULT`
`date`	`DateType`
`glide_date`	`DateType`
`date_time`	`TimestampType`
`datetime`	`TimestampType`
`calendar_date_time`	`TimestampType`
`glide_date_time`	`TimestampType`
`reference`	`StructType(Seq(StructField("link", StringType), StructField("value", StringType)))`
`sys_id`	`StringType`
`glide_duration`	`StringType`
`glide_time`	`StringType`
`attachment`	`StringType`
`email`	`StringType`
`url`	`StringType`
`json`	`StringType`
`xml`	`StringType`
`html`	`StringType`
`textarea`	`StringType`
`encrypted_text`	`StringType`