IP Library Granted Patent US 9,747,269
Granted Patent B2
US 9,747,269 · App. 15/134,318 · Granted Aug 29, 2017

Smart optical input/output (I/O) extension for context-dependent workflows

Inventors: Anthony Macciola (Irvine, CA); Jan W. Amtrup (Silver Spring, MD)
Assignee: Kofax, Inc.
G06F17/243G06F17/211G06F17/276G06K9/00442G06K9/00469G06K9/18G06K9/2018G06Q10/10H04N1/40G06K2209/21
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,747,269
App. No.
15/134,318
Granted
Aug 29, 2017
Kind
B2
Abstract

Systems, methods, and computer program products for smart, automated capture of textual information using optical sensors of a mobile device are disclosed. The capture and provision is context-aware, and determines context of the optical input, and invokes a contextually-appropriate workflow based thereon. The techniques also provide capability to normalize, correct, and/or validate the captured optical input and provide the corrected, normalized, validated, etc. information to the contextually-appropriate workflow. Other information necessary by the workflow and available to the mobile device optical sensors may also be captured and provided, in a single automatic process. As a result, the overall process of capturing information from optical input using a mobile device, invoking an appropriate workflow, and providing captured information to the workflow is significantly simplified and improved in terms of accuracy of data transfer/entry, speed and efficiency of workflows, and user experience.

Claims (46)

1. A method, comprising:

receiving optical input via one or more optical sensors of a mobile device:

analyzing the optical input using a processor of the mobile device to determine a context of the optical input; and

automatically invoking a contextually-appropriate workflow based on the context of the optical input.

2. The method as recited in claim 1 , comprising one or more of:

correcting OCR errors in the optical input and providing the corrected optical input to the contextually-appropriate workflow; and

normalizing a format of the optical input and providing the normalized optical input to the contextually-appropriate workflow.

3. The method as recited in claim 1 , wherein the context comprises one or more of:

a type of document represented in the optical input; and

a content of the document represented in the optical input.

4. The method as recited in claim 3 , wherein the type of document is selected from a group consisting of: a contract, a tender document, an identity document, an insurance document, a title, a quote, and a vehicle registration.

5. The method as recited in claim 3 , wherein the content is selected from: a driver license number, a vehicle identification number, a phone number, a social security number, a signature, a line item of an invoice, a partial or complete address, a universal resource locator, an insurance group number, a credit card number, a tracking number, a photograph, and a distribution of fields depicted on the document.

6. The method as recited in claim 1 , wherein the workflow comprises one or more of a telecommunications application or function; an insurance quote; a health care admission process; a signing ceremony; and a financial services application configured to facilitate one or more of:

displaying at least one of an account statement, an account balance, and a payment due date;

processing a deposit;

preparing a tax return; and

processing a loan application.

7. The method as recited in claim 6 , wherein the context of the optical input is determined to be automobile-related based at least in part on detecting the optical input comprises a driver license number and a vehicle identification number; and

wherein the contextually-appropriate workflow comprises the insurance quote, wherein the quote is for automobile insurance.

8. The method as recited in claim 6 , wherein the context of the optical input is determined to be automobile-related based at least in part on detecting the optical input comprises a driver license number, a signature, and a photograph; and

wherein the contextually-appropriate workflow comprises the insurance quote, wherein the quote is for automobile insurance.

9. The method as recited in claim 6 , wherein the context of the optical input is determined to be financial services based at least in part on detecting the optical input comprises a document depicting a signature and one or more of an account number and a deposit amount; and

wherein the contextually-appropriate workflow comprises the deposit.

10. The method as recited in claim 6 , wherein the context of the optical input is determined to be financial services based at least in part on detecting the optical input comprises a document depicting a signature and a particular font; and

wherein the contextually-appropriate workflow comprises the deposit.

11. The method as recited in claim 6 , wherein the context of the optical input is determined to be financial services based at least in part on detecting the optical input comprises a credit card number; and

wherein the contextually-appropriate workflow comprises the financial services application configured to display at least one of the account statement, the account balance, and the payment due date.

12. The method as recited in claim 6 , wherein the context of the optical input is determined to be financial services based at least in part on detecting the optical input comprises a social security number; and

wherein the contextually-appropriate workflow comprises the financial services application configured to facilitate preparing a tax return.

13. The method as recited in claim 6 , wherein the context of the optical input is determined to be financial services based at least in part on detecting the optical input comprises a signature and a distribution of fields corresponding to a loan agreement; and

wherein the contextually-appropriate workflow comprises the signing ceremony.

14. The method as recited in claim 6 , wherein the context of the optical input is determined to be financial services based at least in part on detecting the optical input comprises a signature and a distribution of fields corresponding to a loan agreement; and

wherein the contextually-appropriate workflow comprises the financial services application configured to facilitate processing the loan application.

15. The method as recited in claim 6 , wherein the context of the optical input is determined to be health care-related based at least in part on detecting the optical input comprises one or more of: a health insurance provider name, a policyholder name, and an insurance group number; and

wherein the contextually-appropriate workflow comprises one or more of the health care admission process and the insurance quote, wherein the insurance quote is a quote for health insurance.

16. The method as recited in claim 6 , wherein the context of the optical input is determined to be Internet browsing based at least in part on detecting the optical input comprises a universal resource locator (URL); and

wherein the contextually-appropriate workflow comprises a browser application.

17. The method as recited in claim 6 , wherein the context of the optical input is determined to be an enterprise service based at least in part on detecting the optical input comprises an invoice; and

wherein the contextually-appropriate workflow comprises an enterprise application configured to display a status of the invoice.

18. The method as recited in claim 6 , wherein the context of the optical input is determined to be telecommunications based at least in part on detecting the optical input comprises a phone number; and

wherein the contextually-appropriate workflow comprises the telecommunications application or function.

19. A mobile device comprising a processor and logic configured to cause the processor to:

receive optical input via one or more optical sensors of a mobile device;

analyze the optical input using the processor to determine a context of the optical input; and

automatically invoke a contextually-appropriate workflow based on the context of the optical input.

20. A computer program product comprising: a non-transitory computer readable storage medium having program code embodied therewith, the program code readable/executable by a processor of a mobile device to: receive optical input via one or more optical sensors of a mobile device; analyze the optical input using the processor to determine a context of the optical input; and automatically invoke a contextually-appropriate workflow based on the context of the optical input.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2024
From: KOFAX, INC.
To: TUNGSTEN AUTOMATION CORPORATION
Reel/Frame 067428/0392 →
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2022
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: KAPOW TECHNOLOGIES, INC.; KOFAX, INC.
Reel/Frame 060805/0161 →
FIRST LIEN INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 20, 2022
From: KOFAX, INC.; PSIGEN SOFTWARE, INC.
To: JPMORGAN CHASE BANK, N.A. AS COLLATERAL AGENT
Reel/Frame 060757/0565 →
SECURITY INTEREST Recorded Jul 20, 2022
From: KOFAX, INC.; PSIGEN SOFTWARE, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 060768/0159 →
SECURITY INTEREST Recorded Jul 7, 2017
From: KOFAX, INC.
To: CREDIT SUISSE
Reel/Frame 043108/0207 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 5, 2017
From: MACCIOLA, ANTHONY; AMTRUP, JAN W.
To: KOFAX, INC.
Reel/Frame 042599/0855 →
Continuity (8)
Division 14686644 · Apr 14, 2015
Continuation In Part 14588147 · Dec 31, 2014
Continuation 14176006 · Feb 7, 2014
Continuation In Part 13948046 · Jul 22, 2013
Continuation 13691610 · Nov 30, 2012
Continuation 12368685 · Feb 10, 2009
Provisional Application 61979949 · Apr 15, 2014
Related Publication 20160232149A1 · Aug 11, 2016