Automatic generation and population of digital interfaces based on adaptively processed image data
The disclosed embodiments include computer-implemented systems, apparatuses, and processes that, among other things, automatically generate and populate digital interfaces based on adaptively processed image data captured by a network-connected device operating within a computing environment. For example, an apparatus may receive, from a device, a first signal that includes image data identifying a document associated with a data exchange capable of initiation by the device. The apparatus may detect, within a first portion of the image data, a presence of first textual content associated with a first parameter of the data exchange, extract a first value characterizing the first parameter from the first textual content, and generate and transmit a second signal that includes the first value to the device. The second signal includes information that instructs the device to display the first value within a portion of an interface corresponding to the first parameter.
1. An apparatus, comprising:
a communications unit;
a storage unit storing instructions; and
at least one processor coupled to the communications unit and the storage unit, the at least one processor being configured to execute the instructions to:
obtain image data that includes a digital image of a document associated with an exchange of data, the data exchange being capable of initiation by an application program executed at a device;
process the image data and detect, within a first portion of the digital image, a presence of first textual content associated with a first parameter of the data exchange; and
perform operations that extract the first textual content from the processed image data and that extract a value of the first parameter from the first textual content, and transmit, via the communications unit, a first signal that includes the first parameter value to the device, the first signal comprising information that instructs the executed application program to display the first parameter value within a portion of a digital interface associated with the first parameter.
2. The apparatus of claim 1 , wherein the at least one processor is further configured to execute the instructions to receive, from the device via the communications unit, a second signal that includes the image data.
3. The apparatus of claim 1 , wherein the at least one processor is further configured to execute the instructions to, based on an application of a computer vision process to the image data, detect the presence of the first textual content within the first portion of the digital image, the first portion of the digital image corresponding to a first bounded region of the document that includes the first textual content.
4. The apparatus of claim 3 , wherein the at least one processor is further configured to execute the instructions to:
recognize the first textual content based on an application of an optical character recognition process to the first portion of the digital image; and
generate first output data that includes the recognized first textual content.
5. The apparatus of claim 4 , wherein the at least one processor is further configured to execute the instructions to:
load, from the storage unit, classification data characterizing a plurality of parameters of the transaction, the parameters comprising the first parameter; and
based on an application of a first machine learning process to the first output data and to the classification data, perform operations that classify a first element of the recognized first textual content in accordance with the first parameter.
6. The apparatus of claim 5 , wherein:
the first output data comprises the first element of the recognized first textual content and a second element of the recognized first textual content; and
the at least one processor is further configured to execute the instructions to:
detect a presence of a control character within the first textual content;
decompose the first output data into the first and second elements based on the detected presence of the control character; and
based on an application of the first machine learning process to the decomposed first output data and to the classification data, perform operations that classify (i) the first element in accordance with the first parameter and (ii) the second element in accordance with a second one of the parameters of the transaction.
7. The apparatus of claim 5 , wherein the at least one processor is further configured to execute the instructions to, based on an application of a second machine learning processes to the classified first element, extract the first parameter value from the classified first element and compute a confidence score associated with the first parameter value.
8. The apparatus of claim 4 , wherein the at least one processor is further configured to execute the instructions to:
based on an application of a first machine learning process to the first output data, perform operations that classify a plurality of elements of the recognized first textual content in accordance with the first parameter;
based on an application of a second machine learning process to the classified elements of the recognized first textual content, extract a parameter value from each of the classified elements and compute a confidence score associated with each of the extracted values; and
establish, as the first parameter value, a corresponding one of the extracted parameter values associated with a maximum of the confidence scores.
9. The apparatus of claim 8 , wherein the at least one processor is further configured to execute the instructions to:
generate parameter data that includes a subset of the extracted parameter values and corresponding ones of the confidence scores, the parameter data associating the subset of the extracted parameter values and the first parameter; and
transmit, via the communications unit, a second signal that includes the parameter data to the device, the second signal comprising additional information that instructs the executed application program to display each of the subset of the extracted parameter values within the portion of the digital interface associated with the first parameter.
10. The apparatus of claim 4 , wherein the at least one processor is further configured to execute the instructions to:
based on the application of the computer vision process to the image data, detect a presence of second textual content within a second portion of the digital image, the second portion of the digital image corresponding to a second bounded region of the document that includes the second textual content, and the second bounded region being disposed adjacent to the first bounded region within the document;
recognize the second textual content based on an application of the optical character recognition process to the second portion of the image data;
generate second output data that includes the recognized second textual content; and
generate combined output data representative of a concatenation of the first and second output data.
11. The apparatus of claim 1 , wherein the at least one processor is further configured to execute the instructions to:
based on the image data, extract a value of a second parameter of the data exchange from a second portion of the digital image; and
transmit, to the device via the communications unit, a second signal that includes the first and second parameter values, the second signal comprising additional information that instructs the executed application program to:
display the first parameter value within the portion of the digital interface associated with the first parameter; and
display the second parameter value within an additional portion of the digital interface associated with the second parameter.
12. The apparatus of claim 1 , wherein:
the data exchange comprises a transaction;
the document comprises an invoice associated with the transaction; and
the first parameter value comprises at least one of a transaction date, a transaction amount, an account associated with the transaction, or a counterparty to the transaction.
13. The apparatus of claim 1 , wherein the at least one processor is further configured to execute the instructions to:
apply a trained machine learning process to input data that includes at least the first textual content; and
extract the first parameter value from the first textual content based on the application of the trained machine learning process to the input data.
14. The apparatus of claim 1 , wherein:
the at least one processor is further configured to execute the instructions to receive a second signal that includes the image data from a device via the communications interface, the first signal being received through a programmatic interface associated with the executed application program;
the portion of the digital interface comprises at least one interface element associated with the first parameter; and
the executed application program causes the device to initiate the data exchange based on at least the displayed first parameter value.
15. A computer-implemented method, comprising:
obtaining, using at least one processor, image data that includes a digital image of a document associated with an exchange of data, the data exchange being capable of initiation by an application program executed at a device;
using the at least one processor, processing the image data and detecting, within a first portion of the digital image, a presence of first textual content associated with a first parameter of the data exchange; and
performing operations, using the at least one processor, that extract the first textual content from the processed image data and that extract a value of the first parameter from the first textual content, and transmitting, using the at least one processor, a first signal that includes the first parameter value to a device, the first signal comprising information that instructs an executed application program to display the first parameter value within a portion of a digital interface associated with the first parameter.
16. A device, comprising:
a communications unit;
a storage unit storing instructions; and
at least one processor coupled to the communications unit and the storage unit, the at least one processor being configured to execute the instructions to:
transmit, via the communications unit, a first signal that includes image data to a computing system, the image data comprising a digital image of a document associated with an exchange of data, and the first signal comprising information that instructs the computing system to process the image data and detect, within a portion of the digital image, a presence of textual content associated with a parameter of the data exchange, and to perform operations that extract the textual content from the processed image data and that extract a value of the parameter from the first textual content;
receive a second signal from the computing system via the communications unit, the second signal comprising the parameter value; and
based on the second signal, display, using a display unit, the parameter value within a portion of a digital interface associated with the parameter of the data exchange.
17. The device of claim 16 , wherein:
the device comprises a digital camera coupled to the at least one processor; and
the at least one processor is further configured to execute the instructions to receive the image data from the digital camera.
18. The device of claim 16 , wherein the at least one processor is further configured to execute the instructions to transmit the first signal to the computing system through a programmatic interface, the programmatic interface being associated with an application program executed by the at least one processor.
19. The device of claim 16 , wherein the at least one processor is further configured to execute the instructions to display the parameter value within the portion of the digital interface without intervention from a user.
20. The device of claim 16 , wherein:
the device further comprises an input unit coupled to the at least one processor; and
the at least one processor is further configured to:
receive, through the input unit, input data requesting at least one of (i) an initiation of the data exchange based on the displayed parameter value or (ii) an establishment of a recurring data exchange based on the displayed parameter value; and
perform operations that, based on the displayed parameter value, schedule the initiation of the data exchange or establish the recurring data exchange.
21. The device of claim 16 , wherein:
the data exchange comprises a transaction;
the document comprises an invoice associated with the transaction; and
the parameter comprises at least one of a transaction date, a transaction amount, an account associated with the transaction, or a counterparty to the transaction.