Document Parsing

Document Parsing uses state-of-the-art research techniques to extract and visualize structured data from a wide range of document types, including but not limited to PDFs, images, Word documents (DOC/DOCX), and PowerPoint files (PPT/PPTX). It's designed to handle complex layouts such as tables, charts, and mixed text-image content.

Document parsing is available through the Agent Bricks UI and in SQL.

Create a document parsing agent in the UI

Requirements

Use Document Parsing to parse your documents and visualize their structure.

1. Go to Agents in the left navigation pane of your workspace.
2. Click Create Agent > Document Parsing.
3. Select your source document. You can choose to upload a file or select one from an existing Unity Catalog catalog. Supported formats include: PDF, images, DOC/DOCX, and PPT/PPTX.
4. Click Parse document.

Parsing your document can take a few minutes. When complete, Document Parsing shows the source document on the left and the parsed document on the right. You can choose to view the parsed document as Formatted text or Raw JSON.

Process and query results

To view the ai_parse_document query and run it on more documents, click Use Agent and choose either to run the query from the SQL Editor or Notebook. You can edit the query to point to the volume or table your documents live in.

To prepare the parsed output for retrieval (RAG), use ai_prep_search (Beta) downstream.

Parse documents in SQL

Call ai_parse_document in SQL to parse documents at scale:

SQL

SELECT
  ai_parse_document(
    content,
    map('version', '2.0')
  ) AS parsed
FROM READ_FILES('/Volumes/my_catalog/my_schema/my_documents', format => 'binaryFile');

See the ai_parse_document SQL reference.

Limitations

See ai_parse_document limitations.