Vendor Analysis
published on Apr 09, 2020
Report Overview:
NelsonHall’s UiPath document cognition benchmark report is a functional “lab” test evaluation of the Entity Extractor document cognition platform.
Who is this Report for:
NelsonHall’s UiPath document cognition benchmark report is a functional “lab” test evaluation of the Entity Extractor document cognition platform, designed for:
- Sourcing managers monitoring the capabilities of existing suppliers of Document Cognition platforms and identifying vendor suitability for document cognition RFPs
- RPA and intelligent automation center of excellence personnel evaluating document cognition platform capability
- Vendor marketing, sales, and business managers looking to benchmark their platforms against their peers
- Financial analysts and investors covering intelligent automation and Document Cognition platforms.
Scope of this Report:
The report provides a comprehensive and objective analysis of UiPath’s capabilities, including:
- Designing the document cognition models
- Document Ingestion
- Document verification
- Testing.
This report provides the quantitative results of the SmartLabTest comparing the platform’s performance for each document type. This report includes:
- The SmartLabTest results
- Analysis of the platform’s strengths & weaknesses
- Identification of the key features of each platform
- An evaluation of comparative platform maturity
Key Findings & Highlights:
This NelsonHall vendor assessment tested UiPath’s capabilities in ingesting and interpreting:
- Structured documents such as mortgage applications and ACORD filings
- Semi-structured documents such as invoices and purchase orders
- Highly unstructured documents such as resumes.
The KPIs assessed for each document type included:
- Proportion of fields correctly recognized
- Accuracy of extraction of recognized fields
- Proportion of fields overall that 100% accurate and require no manual intervention.
NelsonHall developed the bot using UiPath Studio 2019.12.0-beta.61's drag-and-drop functionality to build the workflow using preconfigured functions. These drag and drop functions included calls to digitize a document and perform API calls to OCR and image recognition engines.
Within Studio, RegEx builder can be used to define regular expression search criteria. It contains a text editor, called Test Text, which can test search criteria choose against a test selection of text. Below the text editor, the user can choose the type, value, and quantifiers of the expressions to be matched against. The RegEx builder allows users to select pre-generated expressions, with options including emails, URLs, U.S. date, U.S. phone number, whitespace, digit, and “starts with”. A full expression text box below the wizard displays the current RegEx expression in its raw form.
In addition to RegEx, digitized documents can be analyzed against document object models, more useful when handling more structured documents with templates.