IP Library Granted Patent US 8,831,365
Granted Patent B2
US 8,831,365 · App. 13/792,501 · Granted Sep 9, 2014

Capturing text from rendered documents using supplement information

Inventors: Martin Towle King (Vashon Island, WA); Dale L. Grover (Ann Arbor, MI); Clifford A. Kushler (Lynnwood, WA); James Quentin Stafford-Fraser (Cambridge, GB)
Assignee: Google Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,831,365
App. No.
13/792,501
Filed
Mar 11, 2013
Granted
Sep 9, 2014
Kind
B2
Art Unit
2665
USPC
382/229
Abstract

A system for processing a text capture operation is described. The system receives text captured from a rendered document in the text capture operation. The system also receives supplemental information distinct from the captured text. The system determines an action to perform in response to the text capture operation based upon both the captured text and the supplemental information.

Claims (52)

1. A method comprising:

receiving, at a computing device, text captured from a rendered document during a text capture operation;

receiving, at the computing device, supplemental information relating to circumstances under which the text capture operation was performed, the supplemental information comprising information indicating a geographical location at which the text capture operation occurs, the information indicating a geographical location at which the text capture operation occurs comprising information indicating a location as being indoors or outdoors; and

determining, by the computing device and based on the captured text and the supplemental information, an action to be performed;

wherein a determination of the location as being indoors or outdoors is based on light entering a sensor of an optical capture device.

2. The method of claim 1 , wherein determining the action to be performed comprises determining to discard at least one document from among a plurality of documents identified as having the captured text.

3. The method of claim 2 , wherein determining the action to be performed further comprises determining to prioritize any documents of the plurality of documents remaining after discarding the at least one document.

4. The method of claim 1 , wherein determining the action to be performed comprises determining to select a default action to perform from among a plurality of actions.

5. The method of claim 1 , wherein the information indicating a geographical location at which the text capture operation occurs comprises information expressed in terms of latitude and longitude.

6. The method of claim 1 , further comprising: predicting, by the computing device, context with respect to a user of a capture device that performs the text capture operation,

wherein at least a portion of the supplemental information is based on the predicted context.

7. The method of claim 6 ,

wherein the predicted context is based on information indicating the user is on an airplane being flown to a particular city.

8. A method comprising:

receiving, at a computing device, text captured from a rendered document during a text capture operation;

receiving, at the computing device, supplemental information relating to circumstances under which the text capture operation was performed, the supplemental information comprising information indicating a geographical location at which the text capture operation occurs; and

determining, by the computing device and based on the captured text and the supplemental information, an action to be performed;

wherein the information indicating a geographical location at which the text capture operation occurs comprises information indicating a location deduced from an ambient noise of an audio capture device that performs the text capture operation.

9. A method comprising:

receiving, at a computing device, text captured from a rendered document during a text capture operation;

receiving, at the computing device, supplemental information relating to circumstances under which the text capture operation was performed;

predicting, by the computing device, context with respect to a user of a capture device that performs the text capture operation, wherein at least a portion of the supplemental information is based on the predicted context; and

determining, by the computing device and based on the captured text and the supplemental information, an action to be performed;

wherein the predicted context is based on information indicating the user is on an airplane being flown to a particular city; and

wherein the predicted context indicates the user is reading a document about the particular city.

10. A method comprising:

receiving, at a computing device, text captured from a rendered document during a text capture operation;

receiving, at the computing device, supplemental information relating to circumstances under which the text capture operation was performed;

predicting, by the computing device, context with respect to a user of a capture device that performs the text capture operation, wherein at least a portion of the supplemental information is based on the predicted context; and

determining, by the computing device and based on the captured text and the supplemental information, an action to be performed;

wherein the predicted context is based on schedule information indicating the user is meeting with a particular person.

11. The method of claim 10 , wherein the predicted context indicates the user is reading a document by or about the particular person.

12. A system comprising:

an input receiver operable to receive text captured from a rendered document during a text capture operation, and supplemental information relating to circumstances of performing the text capture operation, the supplemental information comprising information indicating a geographical location at which the text capture operation occurs, the information indicating a geographical location at which the text capture operation occurs comprising information indicating a location as being indoors or outdoors;

a processing unit; and

a computer memory configured to store the captured text, the supplemental information, and computer-readable programs executable by the processing unit;

wherein the computer-readable program instructions are executable by the processing unit to determine, based on the captured text and the supplemental information, an action to be performed; and

wherein a determination of the location as being indoors or outdoors is based on light entering a sensor of an optical capture device.

13. The system of claim 12 , wherein the input receiver comprises a network connection that connects the system to the Internet.

14. The system of claim 12 , wherein the computer-readable program instructions are executable by the processing unit to perform the determined action.

15. The system of claim 12 ,

wherein the computer-readable program instructions are executable by the processing unit to predict context with respect to a user of a capture device that performs the text capture operation, and

wherein at least a portion of the supplemental information is based on the predicted context.

16. A non-transitory computer readable medium having stored therein instructions, that when executed by a computing device, cause the computing device to perform functions comprising:

receiving, at a computing device, text captured from a rendered document during a text capture operation;

receiving, at the computing device, supplemental information relating to circumstances under which the text capture operation was performed, the supplemental information comprising information indicating a geographical location at which the text capture operation occurs, the information indicating a geographical location at which the text capture operation occurs comprising information indicating a location as being indoors or outdoors; and

determining, by the computing device and based on the captured text and the supplemental information, an action to be performed;

wherein a determination of the location as being indoors or outdoors is based on light entering a sensor of an optical capture device.

17. The non-transitory computer readable medium of claim 16 , wherein the stored instructions, when executed by the computing device, further cause performance of the determined action.

18. The non-transitory computer readable medium of claim 16 ,

wherein the stored instructions, when executed by the computing device, further cause the computing device to predict context with respect to a user of a capture device that performs the text capture operation, and

wherein at least a portion of the supplemental information is based on the predicted context.

Assignments (4)
NUNC PRO TUNC ASSIGNMENT Recorded Aug 3, 2021
From: GOOGLE LLC
To: KYOCERA CORPORATION
Reel/Frame 057651/0445 →
CHANGE OF NAME Recorded Oct 6, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044141/0827 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2013
From: KING, MARTIN T.; GROVER, DALE L.; KUSHLER, CLIFFORD A.; STAFFORD-FRASER, JAMES Q.
To: EXBIBLIO B.V.
Reel/Frame 030315/0039 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2013
From: EXBIBLIO B.V.
To: GOOGLE INC.
Reel/Frame 030315/0148 →
Continuity (106)
Continuation 12542816 · Aug 18, 2009
Continuation 11096704 · Apr 1, 2005
Continuation In Part 11004637 · Dec 3, 2004
Provisional Application 60657309 · Feb 28, 2005
Provisional Application 60655697 · Feb 22, 2005
Provisional Application 60655279 · Feb 22, 2005
Provisional Application 60655281 · Feb 22, 2005
Provisional Application 60655280 · Feb 22, 2005
Provisional Application 60655987 · Feb 22, 2005
Provisional Application 60654196 · Feb 18, 2005
Provisional Application 60654326 · Feb 18, 2005
Provisional Application 60654368 · Feb 18, 2005
Provisional Application 60654379 · Feb 17, 2005
Provisional Application 60653669 · Feb 16, 2005
Provisional Application 60653663 · Feb 16, 2005
Provisional Application 60653679 · Feb 16, 2005
Provisional Application 60653847 · Feb 16, 2005
Provisional Application 60653899 · Feb 16, 2005
Provisional Application 60653372 · Feb 15, 2005
Provisional Application 60648746 · Jan 31, 2005
Provisional Application 60647684 · Jan 26, 2005
Provisional Application 60634627 · Dec 9, 2004
Provisional Application 60634739 · Dec 9, 2004
Provisional Application 60633486 · Dec 6, 2004
Provisional Application 60633678 · Dec 6, 2004
Provisional Application 60633452 · Dec 6, 2004
Provisional Application 60633453 · Dec 6, 2004
Provisional Application 60622906 · Oct 28, 2004
Provisional Application 60617122 · Oct 7, 2004
Provisional Application 60615378 · Oct 1, 2004
Provisional Application 60615112 · Oct 1, 2004
Provisional Application 60615538 · Oct 1, 2004
Provisional Application 60613243 · Sep 27, 2004
Provisional Application 60613628 · Sep 27, 2004
Provisional Application 60613632 · Sep 27, 2004
Provisional Application 60613589 · Sep 27, 2004
Provisional Application 60613242 · Sep 27, 2004
Provisional Application 60613602 · Sep 27, 2004
Provisional Application 60613340 · Sep 27, 2004
Provisional Application 60613634 · Sep 27, 2004
Provisional Application 60613461 · Sep 27, 2004
Provisional Application 60613455 · Sep 27, 2004
Provisional Application 60613460 · Sep 27, 2004
Provisional Application 60613400 · Sep 27, 2004
Provisional Application 60613456 · Sep 27, 2004
Provisional Application 60613341 · Sep 27, 2004
Provisional Application 60613361 · Sep 27, 2004
Provisional Application 60613454 · Sep 27, 2004
Provisional Application 60613339 · Sep 27, 2004
Provisional Application 60613633 · Sep 27, 2004
Provisional Application 60605229 · Aug 27, 2004
Provisional Application 60605105 · Aug 27, 2004
Provisional Application 60604103 · Aug 23, 2004
Provisional Application 60604098 · Aug 23, 2004
Provisional Application 60604100 · Aug 23, 2004
Provisional Application 60604102 · Aug 23, 2004
Provisional Application 60603498 · Aug 20, 2004
Provisional Application 60603358 · Aug 20, 2004
Provisional Application 60603466 · Aug 19, 2004
Provisional Application 60603082 · Aug 19, 2004
Provisional Application 60603081 · Aug 19, 2004
Provisional Application 60602956 · Aug 18, 2004
Provisional Application 60602925 · Aug 18, 2004
Provisional Application 60602947 · Aug 18, 2004
Provisional Application 60602897 · Aug 18, 2004
Provisional Application 60602896 · Aug 18, 2004
Provisional Application 60602930 · Aug 18, 2004
Provisional Application 60602898 · Aug 18, 2004
Provisional Application 60598821 · Aug 2, 2004
Provisional Application 60589203 · Jul 19, 2004
Provisional Application 60589201 · Jul 19, 2004
Provisional Application 60589202 · Jul 19, 2004
Provisional Application 60571715 · May 17, 2004
Provisional Application 60571381 · May 14, 2004
Provisional Application 60571560 · May 14, 2004
Provisional Application 60566667 · Apr 30, 2004
Provisional Application 60564688 · Apr 23, 2004
Provisional Application 60564846 · Apr 23, 2004
Provisional Application 60563520 · Apr 19, 2004
Provisional Application 60563485 · Apr 19, 2004
Provisional Application 60561768 · Apr 12, 2004
Provisional Application 60559766 · Apr 6, 2004
Provisional Application 60559125 · Apr 2, 2004
Provisional Application 60558909 · Apr 2, 2004
Provisional Application 60559033 · Apr 2, 2004
Provisional Application 60559127 · Apr 2, 2004
Provisional Application 60559087 · Apr 2, 2004
Provisional Application 60559131 · Apr 2, 2004
Provisional Application 60559226 · Apr 1, 2004
Provisional Application 60558893 · Apr 1, 2004
Provisional Application 60558968 · Apr 1, 2004
Provisional Application 60558867 · Apr 1, 2004
Provisional Application 60559278 · Apr 1, 2004
Provisional Application 60559279 · Apr 1, 2004
Provisional Application 60559265 · Apr 1, 2004
Provisional Application 60559277 · Apr 1, 2004
Provisional Application 60558969 · Apr 1, 2004
Provisional Application 60558892 · Apr 1, 2004
Provisional Application 60558760 · Apr 1, 2004
Provisional Application 60558717 · Apr 1, 2004
Provisional Application 60558499 · Apr 1, 2004
Provisional Application 60558370 · Apr 1, 2004
Provisional Application 60558789 · Apr 1, 2004
Provisional Application 60558791 · Apr 1, 2004
Provisional Application 60558527 · Apr 1, 2004
Related Publication 20130201527A1 · Aug 8, 2013