AI-AUGMENTED AUDITING PLATFORM INCLUDING TECHNIQUES FOR AUTOMATED ASSESSMENT OF VOUCHING EVIDENCE
Systems and methods for determining whether an electronic document constitutes vouching evidence is provided. The system may receive ERP item data and generate hypothesis data based thereon, and may receive electronic document data and extract ERP information therefrom. The system may then apply one or more models to compare the hypothesis data to the extracted ERP information to determine whether the electronic document constitutes vouching evidence for the ERP item. Systems and methods for verifying an assertion against a source document are provided. The system may receive first data indicating an unverified assertion and second data comprising a plurality of source documents. The system may apply one or more extraction models to extract a set of key data from the plurality of source documents and may apply one or more matching models to compare the first data to the set of key data to determine whether vouching criteria are met.
1 . A system for determining whether data within an electronic document constitutes vouching evidence for an enterprise resource planning (ERP) item, the system comprising one or more processors configured to cause the system to:
receive data representing an ERP item;
generate hypothesis data based on the received data represent an ERP item;
receive an electronic document;
extract ERP information from the document;
apply a first set of one or more models to the hypothesis data and to extracted ERP information in order to generate first output data indicating whether the extracted ERP information constitutes vouching evidence for the ERP item;
apply a second set of one or more models to the extracted ERP information in order to generate second output data indicating whether the extracted ERP information constitutes vouching evidence for the ERP item; and
generate combined determination data, based on the first output data and the second output data, indicating whether the extracted ERP information constitutes vouching evidence for the ERP item.
2 . The system of claim 1 , wherein extracting the ERP information comprises generating first data representing information content of the ERP information and second data representing a document location for the ERP information
3 . The system of claim 1 , wherein the ERP information comprises one or more of: a purchase order number, a customer name, a date, a delivery term, a shipping term, a unit price, and a quantity.
4 . The system of claim 1 , wherein applying the first set of one or more models to generate output data is based on preexisting information regarding spatial relationships amongst instances of ERP information in documents.
5 . The system of claim 4 , wherein the preexisting information comprises a graph representing spatial relationships amongst instances of ERP information in documents.
6 . The system of claim 1 , wherein the one or more processors are configured to cause the system to augment the hypothesis data based on one or more models representing contextual data.
7 . The system of claim 6 , wherein the contextual data comprises information regarding one or more synonyms for the information content of the ERP information.
8 . The system of claim 1 , wherein the ERP information comprises a single word in the document.
9 . The system of claim 1 , wherein the ERP information comprises a plurality of words in the document.
10 . The system of claim 1 , wherein the second output data comprises one or more of:
a confidence score indicating a confidence level as to whether the extracted ERP information constitutes vouching evidence for the ERP item;
a binary indication as to whether the extracted ERP information constitutes vouching evidence for the ERP item; and
a location within the electronic document corresponding to the determination as to whether the extracted ERP information constitutes vouching evidence for the ERP item.
11 . The system of claim 1 , wherein generating the second output data comprises generating a similarity score representing a comparison of the ERP information and the ERP item.
12 . The system of claim 11 , wherein the similarity score is generated based on an entity graph representing contextual data.
13 . The system of claim 1 , wherein extracting the ERP information from the document comprises applying a fingerprinting operation to determine, based on the receive data representing an ERP item, a characteristic of a data extraction operation to be applied to the electronic document.
14 . The system of claim 1 , wherein applying the second set of one or more models is based at least in part on contextual data.
15 . The system of claim 1 , wherein applying the second set of one or more models comprises:
applying a set of document processing pipelines in parallel to generate a plurality of processing pipeline output data;
applying one or more data normalization operations to the plurality of processing pipeline output data to generate normalized data; and
generating the second output data based on the normalized data.
16 . A non-transitory computer-readable storage medium storing instructions for determining whether data within an electronic document constitutes vouching evidence for an enterprise resource planning (ERP) item, the instructions configured to be executed by a system comprising one or more processors to cause the system to:
receive data representing an ERP item;
generate hypothesis data based on the received data represent an ERP item;
receive an electronic document;
extract ERP information from the document;
apply a first set of one or more models to the hypothesis data and to extracted ERP information in order to generate first output data indicating whether the extracted ERP information constitutes vouching evidence for the ERP item;
apply a second set of one or more models to the extracted ERP information in order to generate second output data indicating whether the extracted ERP information constitutes vouching evidence for the ERP item; and
generate combined determination data, based on the first output data and the second output data, indicating whether the extracted ERP information constitutes vouching evidence for the ERP item.
17 . A method for determining whether data within an electronic document constitutes vouching evidence for an enterprise resource planning (ERP) item, wherein the method is performed by a system comprising one or more processors, the method comprising:
receiving data representing an ERP item;
generating hypothesis data based on the received data represent an ERP item;
receiving an electronic document;
extracting ERP information from the document;
applying a first set of one or more models to the hypothesis data and to extracted ERP information in order to generate first output data indicating whether the extracted ERP information constitutes vouching evidence for the ERP item;
applying a second set of one or more models to the extracted ERP information in order to generate second output data indicating whether the extracted ERP information constitutes vouching evidence for the ERP item; and
generating combined determination data, based on the first output data and the second output data, indicating whether the extracted ERP information constitutes vouching evidence for the ERP item.