IP Library Granted Patent US 9,721,177
Granted Patent B2
US 9,721,177 · App. 15/005,658 · Granted Aug 1, 2017

Image acquisition using a level-indication icon

Inventors: Sammy Lee (San Jose, CA); Grace Pariante (Palo Alto, CA); Eugene Krivopaltsev (San Jose, CA); Sreeneel K. Maddika (San Ramon, CA); Bobby G. Bray, Jr. (San Diego, CA); Andrew B. Firstenberger (Cardiff by the Sea, CA)
Assignee: INTUIT INC.
G06K9/3208G06K9/00463G06K9/209G06K9/2081G06K9/3283G06K9/344G06T7/70H04N5/23222H04N5/23293G06K2209/01G06T2207/30176H04N5/23258
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,721,177
App. No.
15/005,658
Granted
Aug 1, 2017
Kind
B2
Abstract

During an information-extraction technique, visual suitability indicators may be displayed to a user of the electronic device to assist the user in acquiring an image of a document that is suitable for subsequent extraction of textual information. For example, an imaging application executed by the electronic device may display, in a window associated with the imaging application, a visual suitability indicator of a tilt orientation of the electronic device relative to a plane of the document. When the tilt orientation falls within a predefined range, the electronic device may modify the visual suitability indicators to provide visual feedback to the user. Then, the electronic device may acquire the image of the document using an imaging device, which is integrated into the electronic device. Next, the electronic device may extract the textual information from the image of the document using optical character recognition.

Claims (42)

1. An electronic-device-implemented method for extracting textual information from a document, comprising:

launching an imaging application that executes on the electronic device;

displaying, in a window associated with the imaging application, visual suitability indicators of a tilt orientation of the electronic device relative to a plane of the document, wherein the visual suitability indicators include a ball whose position in the window indicates the tilt orientation, and a circular shape in the center of the window;

modifying the visual suitability indicators when the tilt orientation falls within a predefined range, wherein modifying the visual suitability indicators includes displaying the ball within the circular shape in the center of the window;

acquiring an image of the document using an imaging device, which is integrated into the electronic device; and

extracting the textual information from the image of the document using optical character recognition.

2. The method of claim 1 , wherein the method further comprises receiving a user command to extract the textual information; and

wherein the imaging application is launched in response to the user command.

3. The method of claim 1 , wherein the visual suitability indicators are non-textual.

4. The method of claim 1 , wherein the visual suitability indicators include: corner markers proximate to the corners of the window.

5. The method of claim 1 , wherein modifying the visual suitability indicators includes changing color of a visual suitability indicator.

6. The method of claim 1 , wherein the image is acquired without the user activating an acquisition icon associated with the imaging device.

7. The method of claim 1 , wherein the image is acquired after the tilt orientation falls within the predefined range for more than a time interval.

8. The method of claim 1 , wherein, after acquiring the image, the method further comprises:

displaying the image to a user;

receiving user feedback about the image from a user; and

if the user feedback rejects the image, repeating the displaying, modifying and acquiring operations to acquire another image of the document.

9. The method of claim 1 , wherein, after extracting the textual information, the method further comprises receiving user feedback from a user about the accuracy of the extracted textual information.

10. The method of claim 1 , wherein the visual suitability indicators further indicate at least one of: light intensity, an in-plane orientation of the document relative to the electronic device, and framing of the document in the window; and

wherein the visual suitability indicators are further modified when at least one of: the light intensity is sufficient, the in-plane orientation falls within a second predefined range, and the document is suitably framed in the window.

11. A computer-program product for use in conjunction with an electronic device, the computer-program product comprising a non-transitory computer-readable storage medium and a computer-program mechanism embedded therein, to extract textual information from a document, the computer-program mechanism including:

instructions for launching an imaging application that executes on the electronic device;

instructions for displaying, in a window associated with the imaging application, visual suitability indicators of a tilt orientation of the electronic device relative to a plane of the document, wherein the visual suitability indicators include a ball whose position in the window indicates the tilt orientation, and a circular shape in the center of the window;

instructions for modifying the visual suitability indicators when the tilt orientation falls within a predefined range, wherein modifying the visual suitability indicators includes displaying the ball within the circular shape in the center of the window;

instructions for acquiring an image of the document using an imaging device, which is integrated into the electronic device; and

instructions for extracting the textual information from the image of the document using optical character recognition.

12. The computer-program product of claim 11 , wherein the visual suitability indicators are non-textual.

13. The computer-program product of claim 11 , wherein the visual suitability indicators include: corner markers proximate to the corners of the window.

14. The computer-program product of claim 11 , wherein the visual suitability indicators further indicate at least one of: light intensity, an in-plane orientation of the document relative to the electronic device, and framing of the document in the window; and

wherein the visual suitability indicators are further modified when at least one of: the light intensity is sufficient, the in-plane orientation falls within a second predefined range, and the document is suitably framed in the window.

15. An electronic device, comprising:

a processor;

memory; and

a program module, wherein the program module is stored in the memory and configurable to be executed by the processor to extract textual information from a document, the program module including:

instructions for launching an imaging application that executes on the electronic device;

instructions for displaying, in a window associated with the imaging application, visual suitability indicators of a tilt orientation of the electronic device relative to a plane of the document, wherein the visual suitability indicators include a ball whose position in the window indicates the tilt orientation, and a circular shape in the center of the window;

instructions for modifying the visual suitability indicators when the tilt orientation falls within a predefined range, wherein modifying the visual suitability indicators includes displaying the ball within the circular shape in the center of the window;

instructions for acquiring an image of the document using an imaging device, which is integrated into the electronic device; and

instructions for extracting the textual information from the image of the document using optical character recognition.

16. The electronic device of claim 15 , wherein the visual suitability indicators include: corner markers proximate to the corners of the window.

17. The electronic device of claim 15 , wherein the visual suitability indicators further indicate at least one of: light intensity, an in-plane orientation of the document relative to the electronic device, and framing of the document in the window; and

wherein the visual suitability indicators are further modified when at least one of: the light intensity is sufficient, the in-plane orientation falls within a second predefined range, and the document is suitably framed in the window.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2017
From: LEE, SAMMY; PARIANTE, GRACE; KRIVOPALTSEV, EUGENE; MADDIKA, SREENEEL K.; BRAY, JR., BOBBY G.; FIRSTENBERGER, ANDREW B.
To: INTUIT, INC.
Reel/Frame 042731/0305 →
Continuity (2)
Continuation 14252675 · Apr 14, 2014
Related Publication 20160140410A1 · May 19, 2016