Analogous to /wiki/spaces/SD/pages/353140836, the following custom single page ingestion service enables the use of the GA version 2023-07-31 of Microsoft’s Document Intelligence layout service, formerly called Form Recognizer.

Key capabilities:

• Leading document ingestion service

• Extracts tabular data

• Parses multiple column layouts

• Enhances search results for complex documents

• Can be deployed in Switzerland

Ingestion Config

To use this custom PDF page processing, the ingestion config of the content needs to be adjusted. This ingestion config can be set either on the scope level or on the content directly. This is an example curl for that:

curl --location --request POST 'http://https://gateway.<baseUrl>/ingestion/v1/folder/<scopeId>/properties' \
--header 'Authorization: Bearer <yourToken>' \
--header 'Content-Type: application/json' \
--data-raw '{
    "properties": {
        "ingestionConfig": {
            "pdfReadMode": "CUSTOM_SINGLE_PAGE_API",
            "customApiIdentifier": "Unique Text Extraction API"
        }
    },
    "applyToSubScopes": true
}'

Limitations and Considerations

• The MS Document Intelligence Service costs approx. 1 cent per page and has limited throughput. These costs might be charged additionally by Unique as it is not covered by the Ada Tokens.

• The MS Document Intelligence Service can be deployed in Switzerland.

Activation

Before being able to use MDI, the service must be deployed within a tenant. Depending on your Deployment models one of the following processes must be chosen.

Authentication Methods

MS Document Intelligence can run in two modes:

• Key-based authentication (taking it from the env variables (see code), used in dev)

• Via Workload Identity in production

  • Unique uses only Workload Identity on all its Deployment models