Smart optical input/output (I/O) extension for context-dependent workflows
Systems, methods, and computer program products for smart, automated capture of textual information using optical sensors of a mobile device, and selective provision of such textual information to a user interface for facilitating performance of downstream workflows are disclosed. The capture and provision is context-aware, and determines context of the optical input, and optionally invokes a contextually-appropriate workflow based thereon. The techniques also provide capability to normalize, correct, and/or validate the captured optical input and provide the corrected, normalized, validated, etc. information to the contextually-appropriate workflow. As a result, the overall process of capturing information from optical input using a mobile device, invoking an appropriate workflow, and providing captured information to the workflow is significantly simplified and improved in terms of accuracy of data transfer/entry, speed and efficiency of workflows, and user experience.
1. A computer-implemented method, comprising:
receiving optical input via one or more optical sensors of a mobile device;
analyzing the optical input using a processor of the mobile device to determine a context of the optical input;
determining textual information from the optical input; and
selectively providing the textual information to a user interface based on the context of the optical input.
2. The method as recited in claim 1 , further comprising: automatically invoking a contextually-appropriate workflow based on the context of the optical input.
3. The method as recited in claim 2 , wherein the workflow comprises:
a telecommunications application or function;
an insurance quote;
a health care admission process;
a signing ceremony; and/or
a financial services application configured to facilitate:
displaying at least one of an account statement, an account balance, and a payment due date;
processing a deposit;
preparing a tax return; and/or
processing a loan application.
4. The method as recited in claim 1 , further comprising either or both of:
correcting OCR errors in the textual information prior to selectively providing the textual information to the user interface; and
normalizing a format of the textual information prior to selectively providing the textual information to the user interface.
5. The method as recited in claim 1 , wherein the context comprises either or both of:
a type of document represented in the optical input; and
a content of the document represented in the optical input.
6. The method as recited in claim 5 , wherein the type of document is selected from the group consisting of: a contract, a tender document, an identity document, an insurance document, a title, a quote, and a vehicle registration.
7. The method as recited in claim 5 , wherein the content is selected from the group consisting of: a driver license number, a vehicle identification number, a phone number, a social security number, a signature, a line item of an invoice, a partial or complete address, a universal resource locator, an insurance group number, a credit card number, a tracking number, a photograph, and a distribution of fields depicted on the document.
8. A computer program product comprising: a non-transitory computer readable storage medium having program code embodied therewith, the program code readable/executable by a mobile device to:
receive optical input via one or more optical sensors of a mobile device;
analyze the optical input using a processor of the mobile device to determine a context of the optical input;
determine textual information from the optical input; and
selectively provide the textual information to a user interface based on the context of the optical input.
9. The computer program product as recited in claim 8 , further comprising program code readable/executable by the mobile device to: automatically invoke a contextually-appropriate workflow based on the context of the optical input.
10. The computer program product as recited in claim 9 , wherein the workflow comprises:
a telecommunications application or function;
an insurance quote;
a health care admission process;
a signing ceremony; and/or
a financial services application configured to facilitate one or more of:
displaying at least one of an account statement, an account balance, and a payment due date;
processing a deposit;
preparing a tax return; and/or
processing a loan application.
11. The computer program product as recited in claim 8 , further program code readable/executable by the mobile device to perform either or both of:
correcting OCR errors in the textual information prior to selectively providing the textual information to the user interface; and
normalizing a format of the textual information prior to selectively providing the textual information to the user interface.
12. The computer program product as recited in claim 8 , wherein the context comprises either or both of:
a type of document represented in the optical input; and
a content of the document represented in the optical input.
13. The computer program product as recited in claim 12 , wherein the type of document is selected from the group consisting of: a contract, a tender document, an identity document, an insurance document, a title, a quote, and a vehicle registration.
14. The computer program product as recited in claim 12 , wherein the content is selected from the group consisting of: a driver license number, a vehicle identification number, a phone number, a social security number, a signature, a line item of an invoice, a partial or complete address, a universal resource locator, an insurance group number, a credit card number, a tracking number, a photograph, and a distribution of fields depicted on the document.
15. A computer program product comprising: a non-transitory computer readable storage medium having program code embodied therewith, the program code readable/executable by a mobile device to:
receive optical input via one or more optical sensors of the mobile device;
analyze the optical input using a processor of the mobile device to determine a context of the optical input; and
automatically invoke a contextually-appropriate workflow based on the context of the optical input.
16. The computer program product as recited in claim 15 , further comprising program code readable/executable by the mobile device to perform one or more either or both of:
correcting OCR errors in the optical input and providing the corrected optical input to the contextually-appropriate workflow; and
normalizing a format of the optical input and providing the normalized optical input to the contextually-appropriate workflow.
17. The computer program product as recited in claim 15 , wherein the context comprises either or both of:
a type of document represented in the optical input; and
a content of the document represented in the optical input.
18. The computer program product as recited in claim 17 , wherein the type of document is selected from a group consisting of: a contract, a tender document, an identity document, an insurance document, a title, a quote, and a vehicle registration.
19. The computer program product as recited in claim 17 , wherein the content is selected from the group consisting of: a driver license number, a vehicle identification number, a phone number, a social security number, a signature, a line item of an invoice, a partial or complete address, a universal resource locator, an insurance group number, a credit card number, a tracking number, a photograph, and a distribution of fields depicted on the document.
20. The computer program product as recited in claim 15 , wherein the workflow comprises:
a telecommunications application or function;
an insurance quote;
a health care admission process;
a signing ceremony; and/or
a financial services application configured to facilitate:
displaying at least one of an account statement, an account balance, and a payment due date;
processing a deposit;
preparing a tax return; and/or
processing a loan application.