Consultar dados do OpenTelemetry
Esta página fornece exemplos de consultas SQL para dados OpenTelemetry ingeridos em tabelas Delta pelo Zerobus Ingest OTLP. Para obter detalhes sobre os esquemas das tabelas e as colunas, consulte a referência de tabelas do OpenTelemetry para Zerobus Ingest.
Nos exemplos abaixo, substitua <catalog>.<schema>.<prefix> pelo prefixo do nome do seu catálogo, esquema e tabela.
Colunas como attributes, resource.attributes, instrumentation_scope.attributes e body (logs) são armazenadas como VARIANT. Use a sintaxe :key::type para extrair valores. Por exemplo, attributes:['http.method']::string retorna o atributo http.method como uma string.
Consultar colunas VARIANT requer o Databricks Runtime 15.3 ou superior. Para obter melhores resultados na fragmentação de variantes, utilize Databricks Runtime 17.2 ou superior.
vãos
As consultas a seguir retornam dados da tabela spans, que armazena dados de rastreamento distribuído.
-- Recent spans with duration and attributes
SELECT
time,
service_name,
name,
(end_time_unix_nano - start_time_unix_nano) / 1000000 AS duration_ms,
status.code AS status_code,
attributes:['http.method']::string AS http_method,
attributes:['http.status_code']::int AS http_status
FROM <catalog>.<schema>.<prefix>_otel_spans
WHERE time > current_timestamp() - INTERVAL 1 HOUR
ORDER BY time DESC
LIMIT 100;
-- Filter spans by attribute value
SELECT *
FROM <catalog>.<schema>.<prefix>_otel_spans
WHERE attributes:['http.status_code']::int = 200
AND time > current_timestamp() - INTERVAL 1 HOUR;
-- Slowest operations by service
SELECT
service_name,
name,
COUNT(*) AS call_count,
AVG((end_time_unix_nano - start_time_unix_nano) / 1000000) AS avg_duration_ms,
PERCENTILE_APPROX((end_time_unix_nano - start_time_unix_nano) / 1000000, 0.95) AS p95_duration_ms
FROM <catalog>.<schema>.<prefix>_otel_spans
WHERE time > current_timestamp() - INTERVAL 1 HOUR
GROUP BY service_name, name
ORDER BY avg_duration_ms DESC;
-- Spans by service name, environment, and SDK version
SELECT
service_name,
resource.attributes:['deployment.environment']::string AS environment,
instrumentation_scope.attributes:['otel.library.version']::string AS sdk_version,
COUNT(*) AS span_count
FROM <catalog>.<schema>.<prefix>_otel_spans
WHERE time > current_timestamp() - INTERVAL 1 HOUR
GROUP BY service_name, environment, sdk_version;
logs
As consultas a seguir retornam dados da tabela de logs, que armazena registros de log estruturados e seus níveis de severidade.
-- Recent logs with body and attributes
SELECT
time,
service_name,
severity_text,
body::string AS message,
attributes:['exception.type']::string AS exception_type
FROM <catalog>.<schema>.<prefix>_otel_logs
WHERE time > current_timestamp() - INTERVAL 1 HOUR
ORDER BY time DESC
LIMIT 100;
-- Error logs by service
SELECT
service_name,
severity_text,
COUNT(*) AS log_count
FROM <catalog>.<schema>.<prefix>_otel_logs
WHERE severity_text IN ('ERROR', 'WARN')
AND time > current_timestamp() - INTERVAL 1 HOUR
GROUP BY service_name, severity_text
ORDER BY log_count DESC;
-- Structured log body
SELECT
time,
service_name,
body:message::string AS message,
body:error.code::int AS error_code
FROM <catalog>.<schema>.<prefix>_otel_logs
WHERE time > current_timestamp() - INTERVAL 1 HOUR
AND body:error.code IS NOT NULL;
métricas
As consultas a seguir retornam dados da tabela de métricas, que armazena medições de gauge, soma e histograma.
-- Recent metrics with values
SELECT
time,
service_name,
name,
metric_type,
COALESCE(gauge.value, sum.value) AS value
FROM <catalog>.<schema>.<prefix>_otel_metrics
WHERE time > current_timestamp() - INTERVAL 1 HOUR
ORDER BY time DESC
LIMIT 100;
-- Gauge metrics over time
SELECT
date_trunc('minute', time) AS minute,
name,
AVG(gauge.value) AS avg_value,
MAX(gauge.value) AS max_value
FROM <catalog>.<schema>.<prefix>_otel_metrics
WHERE metric_type = 'gauge'
AND time > current_timestamp() - INTERVAL 1 HOUR
GROUP BY 1, 2
ORDER BY minute;
-- Gauge attributes (attributes are nested inside each metric-type struct)
SELECT
time,
name,
gauge.value,
gauge.attributes:['host.name']::string AS host
FROM <catalog>.<schema>.<prefix>_otel_metrics
WHERE metric_type = 'gauge'
AND time > current_timestamp() - INTERVAL 1 HOUR;
-- Filter metrics by resource attribute
SELECT
time,
name,
gauge.value
FROM <catalog>.<schema>.<prefix>_otel_metrics
WHERE resource.attributes:['deployment.environment']::string = 'production'
AND metric_type = 'gauge'
AND time > current_timestamp() - INTERVAL 1 HOUR;
Recursos adicionais
- Referência de tabelas do OpenTelemetry para Zerobus Ingest: Referência para esquemas de tabelas e definições de colunas para tabelas de spans, logs e métricas.
- Configure os clientes OpenTelemetry (OTLP) para enviar dados ao Unity Catalog: Configure um SDK ou Collector do OpenTelemetry para enviar dados ao Zerobus Ingest.
- Tratamento de erros do Zerobus Ingest: Solução de problemas e códigos de erro comuns.