Document intelligence system
A method may include obtaining, from a user device, an electronic document to be processed by a model. The method may also include obtaining an optical character recognition output of the electronic document. The method may further include obtaining, from the user device, an output configuration. The method may also include generating a first output and a second output based on the electronic document and the optical character recognition output. The first output and the second output may be defined by the output configuration. The method may further include transmitting the first output and the second output to the user device. The method may also include obtaining a feedback from the user device. The method may further include updating the model using the feedback from the user device.
1 . A system, comprising:
a processor; and
a memory storing instructions that, when executed by the processor, cause the system to:
obtain, from a user device, an electronic document to be processed by a model;
obtain an optical character recognition output of the electronic document;
obtain, from the user device, an output configuration;
generate a first output and a second output based on the electronic document and the optical character recognition output, wherein the first output and the second output are defined by the output configuration;
generate a notification that indicates a difference between the electronic document and the first output or a difference between the electronic document and the second output; and
transmit the first output and the second output to the user device.
2 . The system of claim 1 , wherein the optical character recognition output is obtained from a second model.
3 . The system of claim 2 , wherein the optical character recognition output comprises extracted text and extracted bounding boxes from the electronic document.
4 . The system of claim 1 , wherein the model is a vision language model.
5 . The system of claim 1 , wherein the output configuration comprises a bounding box annotation format and a document format.
6 . The system of claim 1 , wherein the output configuration comprises a schema that defines at least one field to be identified in the electronic document.
7 . The system of claim 6 , the instructions to further cause the system to automatically generate the schema using the model to include at least one of a field name, a field type, a description, and a required option toggle.
8 . The system of claim 6 , the instructions to further cause the system to automatically generate the schema using a second model to include at least one of a field name, a field type, a description, and a required option toggle.
9 . The system of claim 1 , wherein the output configuration comprises an image toggle that directs whether an image from the electronic document is included in the first output or the second output.
10 . The system of claim 1 , wherein the first output is a markdown format and the second output is a structured format.
11 . The system of claim 1 , wherein the first output or the second output are transmitted to the user device to be displayed spatially adjacent to the electronic document.
12 . The system of claim 1 , wherein the electronic document comprises a native format, and the native format is one or more of a PDF, a picture, a scan of a document, and a digital photograph.
13 . The system of claim 1 , wherein in response to the model identifying a URL in the electronic document, including the URL in the first output or the second output.
14 . The system of claim 1 , wherein in response to the model identifying a table in the electronic document, including the table in the first output or the second output in an HTML format.
15 . The system of claim 1 , the instructions to further cause the system to:
obtain a feedback from the user device; and
update the model using the feedback from the user device.
16 . A method, comprising:
obtaining, from a user device, an electronic document to be processed by a model;
obtaining an optical character recognition output of the electronic document;
obtaining, from the user device, an output configuration;
generating a first output and a second output based on the electronic document and the optical character recognition output, wherein the first output and the second output are defined by the output configuration;
generating a notification that indicates a difference between the electronic document and the first output or a difference between the electronic document and the second output; and
transmitting the first output and the second output to the user device.
17 . The method of claim 16 , wherein:
the optical character recognition output is obtained from a second model; and
the optical character recognition output comprises extracted text and extracted bounding boxes from the electronic document.
18 . The method of claim 16 , wherein the output configuration comprises a schema that defines at least one field to be identified in the electronic document.
19 . The method of claim 18 , further comprising automatically generating the schema using the model to include at least one of a field name, a field type, a description, and a required option toggle.
20 . The method of claim 18 , further comprising
obtaining a feedback from the user device; and
updating the model using the feedback from the user device.