IP Library Granted Patent US 9,319,555
Granted Patent B2
US 9,319,555 · App. 14/252,395 · Granted Apr 19, 2016

Handheld device for capturing text from both a document printed on paper and a document displayed on a dynamic display device

Inventors: Martin T. King (Vashon Island, WA); Dale L. Grover (Ann Arbor, MI); Clifford A. Kushler (Lynnwood, WA); James Q. Stafford-Fraser (Crambridge, GB)
Assignee: Google Inc.
H04N1/107G06K9/00422G06K9/00979G06K9/228G06Q30/00H04N1/32101H04N1/0049H04N1/00241H04N1/00307H04N1/00488H04N2201/0041H04N2201/0055H04N2201/0058H04N2201/0081H04N2201/0084H04N2201/0096H04N2201/3249H04N2201/3264H04N2201/3269
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,319,555
App. No.
14/252,395
Granted
Apr 19, 2016
Kind
B2
Abstract

A device for capturing rendered text is described. The device incorporates one or more visual sensors that receive visual information as a part of capturing rendered text. The visual sensors are collectively capable of capturing both text that is permanently printed on a page, and text that is displayed transitorily on a dynamic device. The device further incorporates a visual information disposition subsystem for disposing of visual information received by the visual sensors. The device further incorporates a package that bears the visual sensors and the visual information disposition subsystem, and is suitable to be held in a human hand.

Claims (58)

1. A computer-implemented method comprising:

receiving document capture data that represents an output of performing a document capture process on a rendered document;

determining, based at least on the document capture data, that the rendered document includes a particular symbol;

accessing a registry that associates symbols with predetermined actions, wherein each symbol is associated with a different predetermined action;

determining a particular predetermined action associated with the particular symbol; and

providing, to a document management system, (i) at least a portion of the document capture data, and (ii) an indication of the predetermined action associated with the particular symbol.

2. The computer-implemented method of claim 1 , further comprising:

identifying, from a corpus of electronic documents, an electronic document that corresponds to the rendered document, based on the portion of the document capture data; and

performing the predetermined action associated with the particular symbol.

3. The computer-implemented method of claim 2 , wherein performing the predetermined action comprises causing a control program to be executed.

4. The computer-implemented method of claim 2 , wherein performing the predetermined action comprises causing the electronic document to be printed.

5. The computer-implemented method of claim 2 , further comprising:

receiving information associated with a user initiating the document capture process on the rendered document; and

identifying the user, based on the received information.

6. The computer-implemented method of claim 5 , wherein performing the predetermined action comprises providing the electronic document for display on a display device to the user.

7. The computer-implemented method of claim 5 , wherein performing the predetermined action comprises sending the electronic document to an email address associated with the user.

8. The computer-implemented method of claim 5 , further comprising:

maintaining a record of performing the predetermined action, wherein the record comprises a user identifier associated with the user, an electronic document identifier associated with the electronic document, and an action identifier associated with the performed action.

9. The computer-implemented method of claim 5 , further comprising:

determining that the user is authorized to access a document archive that is accessible to a plurality of users of a user group; and

storing information associated with the rendered document in the document archive.

10. A computer-readable storage device storing software including instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:

receiving document capture data that represents an output of performing a document capture process on a rendered document;

determining, based at least on the document capture data, that the rendered document includes a particular symbol;

accessing a registry that associates symbols with predetermined actions, wherein each symbol is associated with a different predetermined action;

determining a particular predetermined action associated with the particular symbol; and

providing, to a document management system, (i) at least a portion of the document capture data, and (ii) an indication of the predetermined action associated with the particular symbol.

11. The computer-readable storage device of claim 10 , wherein the operations further comprise:

identifying, from a corpus of electronic documents, an electronic document that corresponds to the rendered document, based on the portion of the document capture data; and

performing the predetermined action associated with the particular symbol.

12. The computer-readable storage device of claim 11 , wherein the operations further comprise:

receiving information associated with a user initiating the document capture process on the rendered document; and

identifying the user, based on the received information.

13. The computer-readable storage device of claim 12 , wherein the operations further comprise:

maintaining a record of performing the predetermined action, wherein the record comprises a user identifier associated with the user, an electronic document identifier associated with the electronic document, and an action identifier associated with the performed action.

14. The computer-readable storage device of claim 12 , wherein the operations further comprise:

determining that the user is authorized to access a document archive that is accessible to a plurality of users of a user group; and

storing information associated with the rendered document in the document archive.

15. A system, comprising:

one or more data processing apparatus; and

a computer-readable storage device including instructions executable by the data processing apparatus and upon such execution cause the data processing apparatus to perform operations comprising:

receiving document capture data that represents an output of performing a document capture process on a rendered document;

determining, based at least on the document capture data, that the rendered document includes a particular symbol;

accessing a registry that associates symbols with predetermined actions, wherein each symbol is associated with a different predetermined action;

determining a particular predetermined action associated with the particular symbol; and

providing, to a document management system, (i) at least a portion of the document capture data, and (ii) an indication of the predetermined action associated with the particular symbol.

16. The system of claim 15 , wherein the operations further comprise:

identifying, from a corpus of electronic documents, an electronic document that corresponds to the rendered document, based on the portion of the document capture data; and

performing the predetermined action associated with the particular symbol.

17. The system of claim 16 , wherein the operations further comprise:

receiving information associated with a user initiating the document capture process on the rendered document; and

identifying the user, based on the received information.

18. The system of claim 17 , wherein the operations further comprise:

maintaining a record of performing the predetermined action, wherein the record comprises a user identifier associated with the user, an electronic document identifier associated with the electronic document, and an action identifier associated with the performed action.

19. The system of claim 17 , wherein the operations further comprise:

determining that the user is authorized to access a document archive that is accessible to a plurality of users of a user group; and

storing information associated with the rendered document in the document archive.

20. The system of claim 17 , wherein performing the predetermined action comprises one or more of causing the electronic document to be printed, providing the electronic document for display on a display device to the user, or sending the electronic document to an email address associated with the user.

Assignments (4)
NUNC PRO TUNC ASSIGNMENT Recorded Aug 3, 2021
From: GOOGLE LLC
To: KYOCERA CORPORATION
Reel/Frame 057651/0445 →
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2014
From: KING, MARTIN T.; GROVER, DALE L.; KUSHLER, CLIFFORD A.; STAFFORD-FRASER, JAMES Q.
To: EXBIBLIO B.V.
Reel/Frame 032942/0748 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2014
From: EXBIBLIO B.V.
To: GOOGLE INC.
Reel/Frame 032942/0792 →
Continuity (78)
Continuation 14080305 · Nov 14, 2013
Division 12899462 · Oct 6, 2010
Continuation 11236330 · Sep 27, 2005
Continuation In Part 11004637 · Dec 3, 2004
Continuation In Part 11097961 · Apr 1, 2005
Continuation In Part 11097093 · Apr 1, 2005
Continuation In Part 11098038 · Apr 1, 2005
Continuation In Part 11098014 · Apr 1, 2005
Continuation In Part 11097103 · Apr 1, 2005
Continuation In Part 11098043 · Apr 1, 2005
Continuation In Part 11097981 · Apr 1, 2005
Continuation In Part 11097089 · Apr 1, 2005
Continuation In Part 11097835 · Apr 1, 2005
Continuation In Part 11098016 · Apr 1, 2005
Continuation In Part 11097828 · Apr 1, 2005
Continuation In Part 11097833 · Apr 1, 2005
Continuation In Part 11097836 · Apr 1, 2005
Continuation In Part 11098042 · Apr 1, 2005
Continuation In Part 11096704 · Apr 1, 2005
Continuation In Part 11110353 · Apr 19, 2005
Continuation In Part 11131945 · May 17, 2005
Continuation In Part 11185908 · Jul 19, 2005
Continuation In Part 11208408 · Aug 18, 2005
Continuation In Part 11208457 · Aug 18, 2005
Continuation In Part 11208458 · Aug 18, 2005
Continuation In Part 11208461 · Aug 18, 2005
Continuation In Part 11209333 · Aug 23, 2005
Continuation In Part 11210260 · Aug 23, 2005
Continuation In Part PCTUS2005011533 · Apr 1, 2005
Continuation In Part PCTUS2005013586 · Apr 6, 2005
Continuation In Part PCTUS2005012510 · Apr 12, 2005
Provisional Application 60613243 · Sep 27, 2004
Provisional Application 60613628 · Sep 27, 2004
Provisional Application 60613632 · Sep 27, 2004
Provisional Application 60613589 · Sep 27, 2004
Provisional Application 60613242 · Sep 27, 2004
Provisional Application 60613602 · Sep 27, 2004
Provisional Application 60613340 · Sep 27, 2004
Provisional Application 60613634 · Sep 27, 2004
Provisional Application 60613461 · Sep 27, 2004
Provisional Application 60613341 · Sep 27, 2004
Provisional Application 60613455 · Sep 27, 2004
Provisional Application 60613460 · Sep 27, 2004
Provisional Application 60613400 · Sep 27, 2004
Provisional Application 60613456 · Sep 27, 2004
Provisional Application 60613361 · Sep 27, 2004
Provisional Application 60613454 · Sep 27, 2004
Provisional Application 60613339 · Sep 27, 2004
Provisional Application 60613633 · Sep 27, 2004
Provisional Application 60615378 · Oct 1, 2004
Provisional Application 60615122 · Oct 1, 2004
Provisional Application 60615538 · Oct 1, 2004
Provisional Application 60617122 · Oct 7, 2004
Provisional Application 60622906 · Oct 28, 2004
Provisional Application 60633452 · Dec 6, 2004
Provisional Application 60633678 · Dec 6, 2004
Provisional Application 60633486 · Dec 6, 2004
Provisional Application 60633453 · Dec 6, 2004
Provisional Application 60634627 · Dec 9, 2004
Provisional Application 60634739 · Dec 9, 2004
Provisional Application 60647684 · Jan 26, 2005
Provisional Application 60648746 · Jan 31, 2005
Provisional Application 60653372 · Feb 15, 2005
Provisional Application 60653663 · Feb 17, 2005
Provisional Application 60653669 · Feb 16, 2005
Provisional Application 60653899 · Feb 16, 2005
Provisional Application 60653679 · Feb 16, 2005
Provisional Application 60653847 · Feb 16, 2005
Provisional Application 60654379 · Feb 17, 2005
Provisional Application 60654368 · Feb 18, 2005
Provisional Application 60654326 · Feb 18, 2005
Provisional Application 60654196 · Feb 18, 2005
Provisional Application 60655279 · Feb 22, 2005
Provisional Application 60655280 · Feb 22, 2005
Provisional Application 60655987 · Feb 22, 2005
Provisional Application 60655697 · Feb 22, 2005
Provisional Application 60655281 · Feb 22, 2005
Related Publication 20140253977A1 · Sep 11, 2014