IP Library Granted Patent US 8,619,147
Granted Patent B2
US 8,619,147 · App. 12/899,462 · Granted Dec 31, 2013

Handheld device for capturing text from both a document printed on paper and a document displayed on a dynamic display device

Inventors: Martin T. King (Vashon Island, WA); Dale L. Grover (Ann Arbor, MI); Clifford A. Kushler (Lynnwood, WA); James Q. Stafford-Fraser (Cambridge, GB)
Assignee: Google Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,619,147
App. No.
12/899,462
Filed
Oct 6, 2010
Granted
Dec 31, 2013
Kind
B2
Art Unit
2662
USPC
348/210.99
Abstract

A device for capturing rendered text is described. The device incorporates one or more visual sensors that receive visual information as a part of capturing rendered text. The visual sensors are collectively capable of capturing both text that is permanently printed on a page, and text that is displayed transitorily on a dynamic device. The device further incorporates a visual information disposition subsystem for disposing of visual information received by the visual sensors. The device further incorporates a package that bears the visual sensors and the visual information disposition subsystem, and is suitable to be held in a human hand.

Claims (36)

1. A method comprising:

receiving, using one or more visual sensors of a scanner device, information from a dynamic display device, wherein receiving the information from the dynamic display device comprises receiving information that identifies a position on the dynamic display device; and

transmitting, from the scanner device to a first computer system, an information-request that includes the information from the dynamic display device, wherein the information from the dynamic display device identifies or can be used to identify content to be provided to a scanner-associated device; and

determining text currently being displayed at the position on the dynamic display device without receiving, from the dynamic display device, data directly representing an image of the text.

2. The method of claim 1 , further comprising:

transmitting, from the scanner device to the first computer system, a timestamp indicating a time at which at least one of the visual sensors receives the information from the dynamic display device; and

determining text that was displayed at the position on the dynamic display device at the time indicated by the timestamp.

3. The method of claim 1 , further comprising:

receiving, using the one or more visual sensors of the scanner device, information from a printed document, and

transmitting, from the scanner device to the first computer system, an information-request that includes the information from the printed document, wherein the information from the printed document identifies or can be used to identify additional content to be provided to the scanner-associated device or a second scanner-associated device.

4. The method of claim 3 ,

wherein receiving the information from the printed document comprises the one or more visual sensors detecting hidden control symbols printed with ink having ultraviolet or infrared properties.

5. The method of claim 1 , further comprising:

changing, prior to receiving the information from the dynamic display device, a depth of field setting of the visual sensors to a particular depth of field setting for the dynamic display device.

6. The method of claim 1 , further comprising:

changing, prior to receiving the information from the dynamic display device, a focus setting of the visual sensors to a particular focus setting for the dynamic display device.

7. The method of claim 1 , further comprising:

transmitting, from the scanner device to the first computer system, a device identifier that uniquely identifies the scanner-associated device to which the content is to be provided.

8. The method of claim 7 , further comprising:

transmitting, from the scanner device to the first computer system, a command for the computer system to look up a current network address of the scanner-associated device.

9. The method of claim 1 , further comprising:

detecting, using the scanner device, a lighting environment provided by an illumination source of the dynamic display device; and

adjusting, using the scanner device, at least one setting of the scanner device based on the detected lighting environment.

10. The method of claim 9 , wherein adjusting the at least one setting of the scanner device comprises adjusting a frame capture rate, adjusting a shutter speed, adjusting an illumination setting of an illumination source of the scanner device, or turning the illumination source of the scanner device off.

11. A method comprising:

receiving, using one or more visual sensors of a scanner device, information from a dynamic display device; and

transmitting, from the scanner device to a first computer system, an information-request that includes the information from the dynamic display device, wherein the information from the dynamic display device identifies or can be used to identify content to be provided to a scanner-associated device,

wherein receiving the information from the dynamic display device comprises receiving position information that represents a position on the dynamic display device from which one of the visual sensors is receiving visual information from the dynamic display device.

12. A method comprising:

receiving, using one or more visual sensors of a scanner device, information from a dynamic display device;

transmitting, from the scanner device to a first computer system, an information-request that includes the information from the dynamic display device, wherein the information from the dynamic display device identifies or can be used to identify content to be provided to a scanner-associated device, wherein receiving the information from the dynamic display device comprises receiving a session-identifier code that uniquely identifies a browser communication session carried out via a computer system that comprises the dynamic display device, and

transmitting, from the scanner device to the first computer system, the session-identifier code that uniquely identifies the browser communication session carried out via the computer system that comprises the dynamic display device.

13. A method comprising:

receiving, using one or more visual sensors of a scanner device, information from a dynamic display device; and

transmitting, from the scanner device to a first computer system, an information-request that includes the information from the dynamic display device, wherein the information from the dynamic display device identifies or can be used to identify content to be provided to a scanner-associated device,

wherein receiving the information from the dynamic display device comprises receiving information that the scanner device uses to determine a position on the dynamic display device by optically sensing a refresh cycles on a raster of the dynamic display device and comparing the refresh cycles to timing signals from drive circuitry of the dynamic display device.

Assignments (4)
NUNC PRO TUNC ASSIGNMENT Recorded Aug 3, 2021
From: GOOGLE LLC
To: KYOCERA CORPORATION
Reel/Frame 057651/0445 →
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2011
From: KING, MARTIN T.; GROVER, DALE L.; KUSHLER, CLIFFORD A.; STAFFORD-FRASER, JAMES Q.
To: EXBIBLIO B.V.
Reel/Frame 025801/0462 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2011
From: EXBIBLIO B.V.
To: GOOGLE INC.
Reel/Frame 025801/0487 →
Continuity (77)
Continuation 11236330 · Sep 27, 2005
Continuation In Part 11004637 · Dec 3, 2004
Continuation In Part 11097961 · Apr 1, 2005
Continuation In Part 11097093 · Apr 1, 2005
Continuation In Part 11098038 · Apr 1, 2005
Continuation In Part 11098014 · Apr 1, 2005
Continuation In Part 11097103 · Apr 1, 2005
Continuation In Part 11098043 · Apr 1, 2005
Continuation In Part 11097981 · Apr 1, 2005
Continuation In Part 11097089 · Apr 1, 2005
Continuation In Part 11097835 · Apr 1, 2005
Continuation In Part 11098016 · Apr 1, 2005
Continuation In Part 11097828 · Apr 1, 2005
Continuation In Part 11097833 · Apr 1, 2005
Continuation In Part 11097836 · Apr 1, 2005
Continuation In Part 11098042 · Apr 1, 2005
Continuation In Part 11096704 · Apr 1, 2005
Continuation In Part 11110353 · Apr 19, 2005
Continuation In Part 11131945 · May 17, 2005
Continuation In Part 11185908 · Jul 19, 2005
Continuation In Part 11208408 · Aug 18, 2005
Continuation In Part 11208457 · Aug 18, 2005
Continuation In Part 11208458 · Aug 18, 2005
Continuation In Part 11208461 · Aug 18, 2005
Continuation In Part 11209333 · Aug 23, 2005
Continuation In Part 11210260 · Aug 23, 2005
Continuation In Part PCTUS2005011533 · Apr 1, 2005
Continuation In Part PCTUS2005013586 · Apr 6, 2005
Continuation In Part PCTUS2005012510 · Apr 12, 2005
Provisional Application 60613243 · Sep 27, 2004
Provisional Application 60613628 · Sep 27, 2004
Provisional Application 60613632 · Sep 27, 2004
Provisional Application 60613589 · Sep 27, 2004
Provisional Application 60613242 · Sep 27, 2004
Provisional Application 60613602 · Sep 27, 2004
Provisional Application 60613340 · Sep 27, 2004
Provisional Application 60613634 · Sep 27, 2004
Provisional Application 60613461 · Sep 27, 2004
Provisional Application 60613455 · Sep 27, 2004
Provisional Application 60613460 · Sep 27, 2004
Provisional Application 60613400 · Sep 27, 2004
Provisional Application 60613456 · Sep 27, 2004
Provisional Application 60613341 · Sep 27, 2004
Provisional Application 60613361 · Sep 27, 2004
Provisional Application 60613454 · Sep 27, 2004
Provisional Application 60613339 · Sep 27, 2004
Provisional Application 60613633 · Sep 27, 2004
Provisional Application 60615378 · Oct 1, 2004
Provisional Application 60615112 · Oct 1, 2004
Provisional Application 60615538 · Oct 1, 2004
Provisional Application 60617122 · Oct 7, 2004
Provisional Application 60622906 · Oct 28, 2004
Provisional Application 60633452 · Dec 6, 2004
Provisional Application 60633678 · Dec 6, 2004
Provisional Application 60633486 · Dec 6, 2004
Provisional Application 60633453 · Dec 6, 2004
Provisional Application 60634627 · Dec 9, 2004
Provisional Application 60634739 · Dec 9, 2004
Provisional Application 60647684 · Jan 26, 2005
Provisional Application 60648746 · Jan 31, 2005
Provisional Application 60653372 · Feb 15, 2005
Provisional Application 60653663 · Feb 16, 2005
Provisional Application 60653669 · Feb 16, 2005
Provisional Application 60653899 · Feb 16, 2005
Provisional Application 60653679 · Feb 16, 2005
Provisional Application 60653847 · Feb 16, 2005
Provisional Application 60654379 · Feb 17, 2005
Provisional Application 60654368 · Feb 18, 2005
Provisional Application 60654326 · Feb 18, 2005
Provisional Application 60654196 · Feb 18, 2005
Provisional Application 60655279 · Feb 22, 2005
Provisional Application 60655280 · Feb 22, 2005
Provisional Application 60655987 · Feb 22, 2005
Provisional Application 60655697 · Feb 22, 2005
Provisional Application 60655281 · Feb 22, 2005
Provisional Application 60657309 · Feb 28, 2005
Related Publication 20110085211A1 · Apr 14, 2011