IP Library Granted Patent US 8,984,404
Granted Patent B2
US 8,984,404 · App. 13/476,358 · Granted Mar 17, 2015

Guiding an image-based task execution

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,984,404
App. No.
13/476,358
Granted
Mar 17, 2015
Kind
B2
Abstract

Provided is a method of guiding an image-based task execution. The method allows a user of a computing device to record an association between an image and at least one task, wherein a task is an action related to content present in the image; and upon subsequent recognition of the image, guides a user to perform the at least one task associated with the image, based on previously recorded association.

Claims (41)

1. A computer implemented method for guiding an image-based task execution, comprising:

receiving an image of a document;

allowing a user of a computing device to store an association between the image and at least one task, wherein the at least one task is an action related to content present in the image, wherein allowing the user to store the association includes:

receiving a selection of at least one area of interest on the image, wherein the at least one area of interest includes a plurality of areas of interest on the image and wherein receiving the selection includes receiving a selection of each of the plurality areas of interest; and

storing a mapping of the at least one area of interest with a corresponding parameter of the at least one task including storing a mapping of each area of interest with a parameter of a plurality of parameters and a different task of a plurality of tasks, wherein each task includes steps providing user guidance to perform the task;

subsequently receiving another captured image of the document; and

upon recognition of the subsequently captured image of the document, presenting the user with the plurality of tasks associated with the plurality of areas of interest, receiving a selection of one of the tasks, and guiding the user to perform the at least one task associated with the image based on the mapping of the at least one area of interest to the corresponding parameter of the at least one task, wherein guiding the user to perform the at least one task comprises prompting the user to perform the steps of the selected task based on the stored mappings.

2. The method of claim 1 , wherein the identified at least one area of interest on the image is an input for the at least one task.

3. The method of claim 1 , wherein guiding the user to perform the at least one task comprises:

prompting the user to select the at least one area of interest on the image.

4. The method of claim 1 , wherein guiding the user to perform the at least one task associated with the image comprises:

determining whether the subsequently received image is inadequate to perform the at least one task; and

in response to determining the subsequently received image is inadequate to perform the at least one task, prompting the user to obtain at least one additional copy of the subsequently received image.

5. The method of claim 1 , wherein storing the mapping comprises:

storing the mapping on the computing device, wherein the computing device is a user computing device, or storing the mapping on a remote computing device connectable to the user computing device.

6. The method of claim 1 , wherein the at least one task includes a web based transaction.

7. The method of claim 1 , wherein the image and the subsequently captured image are two different images of the same document.

8. The method of claim 1 , wherein the image is a pre-existing image or an image newly created by the user.

9. A system comprising:

a processor that executes machine readable instructions to:

receive a first image of a paper document;

allow a user to store an association between the image and at least one task, wherein the at least one task is an action related to content of the paper document present in the image, wherein to allow the user to store the association includes:

receive a selection of at least one area of interest on the first image, wherein the at least one area of interest includes a plurality of areas of interest on the image and wherein to receive the selection includes to receive a selection of each of the plurality of areas of interest; and

store a mapping of the at least one area of interest with a corresponding parameter of the at least one task, wherein to store the mapping includes to store a mapping of each area of interest with a parameter of a plurality of parameters and a different task of a plurality of tasks, wherein each task includes steps providing user guidance to perform the task;

subsequently receive a second captured image of the paper document; and

upon recognition of the second image, present the user with the plurality of tasks associated with the plurality of areas of interest, receive a selection of one of the tasks, and guide the user to perform the at least one task based on the mapping of the at least one area of interest to the corresponding parameter of the at least one task, wherein to guide the user to perform the at least one task comprises prompt the user to perform the steps of the selected task based on the stored mappings.

10. The system of claim 9 , further comprising a display device that displays a graphical user interface (GUI), the graphical user interface comprising at least one command, wherein the at least one command allows the user to record the mapping between the at least one area of interest and a corresponding parameter of the at least one task.

11. The system of claim 10 , further comprising an input interface that allows a user to provide an input to record the mapping.

12. The system of claim 11 , wherein the input interface allows the user to identify the at least one area of interest on the first image.

13. The system of claim 11 , wherein the at least one area of interest is an input for the at least one task.

14. The system of claim 9 , further comprising a sensing device that captures an image or a series of images, wherein if a series of images is captured, the images are stitched together by an application to create a single image.

15. The system of claim 9 , comprising an input device including at least one of a keyboard, a mouse, a trackball, a joystick, a touch recognition system, a voice recognition system and a gesture recognition system.

16. The system of claim 9 , wherein the first and second images are two different images of the same paper document.

17. The system of claim 9 , wherein the system is a mobile device.

18. A non-transitory computer readable medium including machine readable instructions that are executable by a computing device to:

receive an image of a document;

allow a user of the computing device to store an association between the image and at least one task, wherein the at least one task is an action related to content present in the image, wherein to allow the user to store the association includes:

receive a selection of at least one area of interest on the image, wherein the at least one area of interest includes a plurality of areas of interest on the image and wherein to receive the selection includes to receive a selection of each of the plurality of areas of interest; and

store a mapping of the at least one area of interest with a corresponding parameter of the at least one task, wherein to store the mapping includes to store a mapping of each area of interest with a parameter of a plurality of parameters and a different task of a plurality of tasks, wherein each task includes steps providing user guidance to perform the task; and

subsequently receive another captured image of the document; and

upon recognition of the subsequently received image, present the user with the plurality of tasks associated with the plurality of areas of interest, receive a selection of one of the tasks, and guide the user to perform the at least one task associated with the image based on the mapping of the at least one area of interest to the corresponding parameter of the at least one task, wherein to guide the user to perform the at least one task comprises prompt the user to perform the steps of the selected task based on the stored mappings.

Assignments (8)
RELEASE OF SECURITY INTEREST REEL/FRAME 044183/0577 Recorded Feb 2, 2023
From: JPMORGAN CHASE BANK, N.A.
To: MICRO FOCUS LLC (F/K/A ENTIT SOFTWARE LLC)
Reel/Frame 063560/0001 →
RELEASE OF SECURITY INTEREST REEL/FRAME 044183/0718 Recorded Feb 2, 2023
From: JPMORGAN CHASE BANK, N.A.
To: MICRO FOCUS LLC (F/K/A ENTIT SOFTWARE LLC); BORLAND SOFTWARE CORPORATION; MICRO FOCUS (US), INC.; SERENA SOFTWARE, INC; ATTACHMATE CORPORATION; MICRO FOCUS SOFTWARE INC. (F/K/A NOVELL, INC.); NETIQ CORPORATION
Reel/Frame 062746/0399 →
CHANGE OF NAME Recorded Feb 25, 2020
From: ENTIT SOFTWARE LLC
To: MICRO FOCUS LLC
Reel/Frame 052010/0029 →
SECURITY INTEREST Recorded Oct 11, 2017
From: ATTACHMATE CORPORATION; BORLAND SOFTWARE CORPORATION; NETIQ CORPORATION; MICRO FOCUS (US), INC.; MICRO FOCUS SOFTWARE, INC.; ENTIT SOFTWARE LLC; ARCSIGHT, LLC; SERENA SOFTWARE, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 044183/0718 →
SECURITY INTEREST Recorded Oct 11, 2017
From: ENTIT SOFTWARE LLC; ARCSIGHT, LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 044183/0577 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2017
From: HEWLETT PACKARD ENTERPRISE DEVELOPMENT LP
To: ENTIT SOFTWARE LLC
Reel/Frame 042746/0130 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2015
From: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
To: HEWLETT PACKARD ENTERPRISE DEVELOPMENT LP
Reel/Frame 037079/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 22, 2012
From: KOMPALLI, SURYAPRAKASH; SHARMA, VIMAL; CHANDRA, PRAPHUL
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 028246/0853 →