IP Library Granted Patent US 10,423,862
Granted Patent B2
US 10,423,862 · App. 16/130,142 · Granted Sep 24, 2019

Capturing text from rendered documents using supplemental information

Inventors: Martin T. King (Vashon Island, WA); Dale L. Grover (Ann Arbor, MI); Clifford A. Kushler (North San Juan, CA); James Q. Stafford-Fraser (Cambridge, GB)
Assignee: Google LLC
G06K9/72G06F17/20G06K9/00442G06F17/214G06F17/241
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,423,862
App. No.
16/130,142
Granted
Sep 24, 2019
Kind
B2
Abstract

A system for processing a text capture operation is described. The system receives text captured from a rendered document in the text capture operation. The system also receives supplemental information distinct from the captured text. The system determines an action to perform in response to the text capture operation based upon both the captured text and the supplemental information.

Claims (49)

1. A method performed by a data processing apparatus, the method comprising:

receiving, at a computing device, data representing a symbol captured from a rendered document during a symbol capture operation;

receiving, at the computing device, supplemental information including information relating to circumstances under which the symbol capture operation was performed, the information relating to circumstances under which the symbol capture operation was performed comprising at least one of (i) a geographic location at which the symbol capture operation was performed to capture the symbol from the rendered document, (ii) actions performed by a user that initiated the symbol capture operation within a threshold amount of time of a time at which the symbol capture operation was performed or (iii) information describing an environment in which the symbol capture operation was performed;

determining, by the computing device and based on the supplemental information, an action to be performed; and

causing the action to be performed.

2. The method of claim 1 , wherein the symbol comprises a bar code.

3. The method of claim 1 , wherein the information describing the environment comprises at least one of information describing lighting, temperature, or sound at a location in which the symbol capture operation was performed.

4. The method of claim 3 , wherein determining, by the computing device and based on the supplemental information, an action to be performed comprises:

determining whether to prevent use of a scanner that captured the symbol based on the information describing the environment.

5. The method of claim 1 , wherein determining, by the computing device and based on the supplemental information, an action to be performed comprises:

identifying the document from which the symbol was captured; and

determining to provide content related to the document.

6. The method of claim 1 , wherein determining, by the computing device and based on the supplemental information, an action to be performed comprises:

determining, based on the symbol being captured, that the user that initiated the symbol capture operation is in possession of a printed version of the document; and

determining, based on the user being in possession of the printed version of the document, to provide, to the user, access to electronic content related to the document.

7. The method of claim 1 , wherein determining the action to be performed comprises determining the action based on actions being performed by users in the geographic location at which the symbol was captured from the rendered document.

8. A system, comprising:

a data processing apparatus; and

a memory apparatus in data communication with the data processing apparatus and storing instructions executable by the data processing apparatus and that upon such execution cause the data processing apparatus to perform operations comprising:

receiving, at a computing device, data representing a symbol captured from a rendered document during a symbol capture operation;

receiving, at the computing device, supplemental information including information relating to circumstances under which the symbol capture operation was performed, the information relating to circumstances under which the symbol capture operation was performed comprising at least one of (i) a geographic location at which the symbol capture operation was performed to capture the symbol from the rendered document, (ii) actions performed by a user that initiated the symbol capture operation within a threshold amount of time of a time at which the symbol capture operation was performed or (iii) information describing an environment in which the symbol capture operation was performed;

determining, by the computing device and based on the supplemental information, an action to be performed; and

causing the action to be performed.

9. The system of claim 8 , wherein the symbol comprises a bar code.

10. The system of claim 8 , wherein the information describing the environment comprises at least one of information describing lighting, temperature, or sound at a location in which the symbol capture operation was performed.

11. The system of claim 10 , wherein determining, by the computing device and based on the supplemental information, an action to be performed comprises:

determining whether to prevent use of a scanner that captured the symbol based on the information describing the environment.

12. The system of claim 8 , wherein determining, by the computing device and based on the supplemental information, an action to be performed comprises:

identifying the document from which the symbol was captured; and

determining to provide content related to the document.

13. The system of claim 8 , wherein determining, by the computing device and based on the supplemental information, an action to be performed comprises:

determining, based on the symbol being captured, that the user that initiated the symbol capture operation is in possession of a printed version of the document; and

determining, based on the user being in possession of the printed version of the document, to provide, to the user, access to electronic content related to the document.

14. The system of claim 8 , wherein determining the action to be performed comprises determining the action based on actions being performed by users in the geographic location at which the symbol was captured from the rendered document.

15. A non-transitory computer storage medium encoded with a computer program, the program comprising instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations comprising:

receiving, at a computing device, data representing a symbol captured from a rendered document during a symbol capture operation;

receiving, at the computing device, supplemental information including information relating to circumstances under which the symbol capture operation was performed, the information relating to circumstances under which the symbol capture operation was performed comprising at least one of (i) a geographic location at which the symbol capture operation was performed to capture the symbol from the rendered document, (ii) actions performed by a user that initiated the symbol capture operation within a threshold amount of time of a time at which the symbol capture operation was performed or (iii) information describing an environment in which the symbol capture operation was performed;

determining, by the computing device and based on the supplemental information, an action to be performed; and

causing the action to be performed.

16. The non-transitory computer storage medium of claim 15 , wherein the symbol comprises a bar code.

17. The non-transitory computer storage medium of claim 15 , wherein the information describing the environment comprises at least one of information describing lighting, temperature, or sound at a location in which the symbol capture operation was performed.

18. The non-transitory computer storage medium of claim 17 , wherein determining, by the computing device and based on the supplemental information, an action to be performed comprises:

determining whether to prevent use of a scanner that captured the symbol based on the information describing the environment.

19. The non-transitory computer storage medium of claim 15 , wherein determining, by the computing device and based on the supplemental information, an action to be performed comprises:

identifying the document from which the symbol was captured; and

determining to provide content related to the document.

20. The non-transitory computer storage medium of claim 15 , wherein determining, by the computing device and based on the supplemental information, an action to be performed comprises:

determining, based on the symbol being captured, that the user that initiated the symbol capture operation is in possession of a printed version of the document; and

determining, based on the user being in possession of the printed version of the document, to provide, to the user, access to electronic content related to the document.

Assignments (4)
NUNC PRO TUNC ASSIGNMENT Recorded Aug 3, 2021
From: GOOGLE LLC
To: KYOCERA CORPORATION
Reel/Frame 057651/0445 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2018
From: KING, MARTIN T.; GROVER, DALE L.; KUSHLER, CLIFFORD A.; STAFFORD-FRASER, JAMES Q.
To: EXBIBLIO B.V
Reel/Frame 047504/0769 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2018
From: EXBIBLIO B.V.
To: GOOGLE INC
Reel/Frame 047504/0927 →
CONVEYANCE CHANGE OF NAME Recorded Nov 14, 2018
From: GOOGLE INC
To: GOOGLE LLC
Reel/Frame 047546/0143 →
Continuity (85)
Continuation 14479145 · Sep 5, 2014
Continuation 13792501 · Mar 11, 2013
Continuation 12542816 · Aug 18, 2009
Continuation 11096704 · Apr 1, 2005
Continuation In Part 11004637 · Dec 3, 2004
Provisional Application 60602898 · Aug 18, 2004
Provisional Application 60564846 · Apr 23, 2004
Provisional Application 60564688 · Apr 23, 2004
Provisional Application 60561768 · Apr 12, 2004
Provisional Application 60559766 · Apr 6, 2004
Provisional Application 60558909 · Apr 2, 2004
Provisional Application 60558527 · Apr 1, 2004
Provisional Application 60657309 · Feb 28, 2005
Provisional Application 60655281 · Feb 22, 2005
Provisional Application 60655280 · Feb 22, 2005
Provisional Application 60655987 · Feb 22, 2005
Provisional Application 60655279 · Feb 22, 2005
Provisional Application 60655697 · Feb 22, 2005
Provisional Application 60654368 · Feb 18, 2005
Provisional Application 60654326 · Feb 18, 2005
Provisional Application 60654196 · Feb 18, 2005
Provisional Application 60654379 · Feb 17, 2005
Provisional Application 60653669 · Feb 16, 2005
Provisional Application 60653679 · Feb 16, 2005
Provisional Application 60653899 · Feb 16, 2005
Provisional Application 60653847 · Feb 16, 2005
Provisional Application 60635663 · Feb 16, 2005
Provisional Application 60653372 · Feb 15, 2005
Provisional Application 60648746 · Jan 31, 2005
Provisional Application 60647684 · Jan 26, 2005
Provisional Application 60634739 · Dec 9, 2004
Provisional Application 60634627 · Dec 9, 2004
Provisional Application 60633486 · Dec 6, 2004
Provisional Application 60633678 · Dec 6, 2004
Provisional Application 60633452 · Dec 6, 2004
Provisional Application 60633453 · Dec 16, 2004
Provisional Application 60622906 · Oct 28, 2004
Provisional Application 60617122 · Oct 7, 2004
Provisional Application 60615378 · Oct 1, 2004
Provisional Application 60615112 · Oct 1, 2004
Provisional Application 60615538 · Oct 1, 2004
Provisional Application 60613456 · Sep 27, 2004
Provisional Application 60613361 · Sep 27, 2004
Provisional Application 60613400 · Sep 27, 2004
Provisional Application 60613602 · Sep 27, 2004
Provisional Application 60613632 · Sep 27, 2004
Provisional Application 60613633 · Sep 27, 2004
Provisional Application 60613634 · Sep 27, 2004
Provisional Application 60613242 · Sep 27, 2004
Provisional Application 60613243 · Sep 27, 2004
Provisional Application 60613589 · Sep 27, 2004
Provisional Application 60613339 · Sep 27, 2004
Provisional Application 60613341 · Sep 27, 2004
Provisional Application 60613340 · Sep 27, 2004
Provisional Application 60613455 · Sep 27, 2004
Provisional Application 60613454 · Sep 27, 2004
Provisional Application 60613461 · Sep 27, 2004
Provisional Application 60613460 · Sep 27, 2004
Provisional Application 60613628 · Sep 27, 2004
Provisional Application 60605105 · Aug 27, 2004
Provisional Application 60605229 · Aug 27, 2004
Provisional Application 60604098 · Aug 23, 2004
Provisional Application 60604100 · Aug 23, 2004
Provisional Application 60604102 · Aug 23, 2004
Provisional Application 60604103 · Aug 23, 2004
Provisional Application 60603498 · Aug 20, 2004
Provisional Application 60603358 · Aug 20, 2004
Provisional Application 60603466 · Aug 19, 2004
Provisional Application 60603081 · Aug 19, 2004
Provisional Application 60603082 · Aug 19, 2004
Provisional Application 60602947 · Aug 18, 2004
Provisional Application 60602956 · Aug 18, 2004
Provisional Application 60602930 · Aug 18, 2004
Provisional Application 60602897 · Aug 18, 2004
Provisional Application 60602896 · Aug 18, 2004
Provisional Application 60602925 · Aug 18, 2004
Provisional Application 60598821 · Aug 2, 2004
Provisional Application 60589201 · Jul 19, 2004
Provisional Application 60589203 · Jul 19, 2004
Provisional Application 60589202 · Jul 19, 2004
Provisional Application 60571715 · May 17, 2004
Provisional Application 60571560 · May 14, 2004
Provisional Application 60571381 · May 14, 2004
Provisional Application 60566667 · Apr 30, 2004
Related Publication 20190156162A1 · May 23, 2019
Cited By (1)
US 12,501,225