Granted Patent B2

US 8,521,772 · App. 13/468,830 · Granted Aug 27, 2013

Inventors: Martin T. King (Vashon Island, WA); Dale L. Grover (Ann Arbor, MI); Clifford A. Kushler (Lynnwood, WA); James Q. Stafford-Fraser (Cambridge, GB)

Assignee: Google Inc.

Abstract

Claims (52)

1. A computer-implemented method, the method comprising:

capturing a first portion of a rendered document using a portable data capture device;

sending a text segment from the first captured portion to a document server, wherein the document server is configured to index text of a corpus of documents;

receiving from the document server a document identifier of an electronic document containing the text segment;

sending an enhancement package request including the document identifier to a media server, wherein the media server is different from the document server;

receiving from the media server an enhancement package associated with the document identifier, wherein the enhancement package includes multiple media presentations associated with multiple words of the rendered document, wherein each word of the multiple words is associated with a respective media presentation of the multiple media presentations;

capturing a second portion of the rendered document using the portable data capture device;

locating within the enhancement package a media presentation associated with one or more identified words within the second captured portion; and

providing for presentation of the associated media presentation using the portable data capture device.

2. The method of claim 1 , wherein the associated media presentation comprises an audio presentation.

3. The method of claim 1 , wherein the associated media presentation comprises a video presentation.

4. The method of claim 1 , wherein the associated media presentation comprises an image presentation.

5. The method of claim 1 , further comprising

identifying the text segment from the first captured portion.

6. The method of claim 1 , wherein the second captured portion includes at least a portion of an advertisement printed on the rendered document, and wherein the associated media presentation comprises information regarding a sale of an item being advertised in the advertisement.

7. The method of claim 1 , wherein the enhancement package request further includes a scanning device identifier, and wherein the enhancement package is further associated with the scanning device identifier.

8. A non-transitory computer-readable storage medium whose contents cause a mobile device to perform operations when executed, the operations comprising:

capturing a first portion of a rendered document using a portable data capture device;

sending a text segment from the first captured portion to a document server, wherein the document server is configured to index text of a corpus of documents;

receiving from the document server a document identifier of an electronic document containing the text segment;

sending an enhancement package request including the document identifier to a media server, wherein the media server is different from the document server;

receiving from the media server an enhancement package associated with the document identifier, wherein the enhancement package includes multiple media presentations associated with multiple words of the rendered document, wherein each word of the multiple words is associated with a respective media presentation of the multiple media presentations;

capturing a second portion of the rendered document using the portable data capture device;

locating within the enhancement package a media presentation associated with one or more identified words within the second captured portion; and

providing for presentation of the associated media presentation using the portable data capture device.

9. The non-transitory computer-readable storage medium of claim 8 , wherein the associated media presentation comprises an audio presentation.

10. The non-transitory computer-readable storage medium of claim 8 , wherein the associated media presentation comprises a video presentation.

11. The non-transitory computer-readable storage medium of claim 8 , wherein the associated media presentation comprises an image presentation.

12. The non-transitory computer-readable storage medium of claim 8 , wherein the

operations further comprise identifying the text segment from the first captured portion.

13. The non-transitory computer-readable storage medium of claim 8 , wherein the second captured portion includes at least a portion of an advertisement printed on the rendered document, and wherein the associated media presentation comprises information regarding a sale of an item being advertised in the advertisement.

14. The non-transitory computer-readable storage medium of claim 8 , wherein the enhancement package request further includes a scanning device identifier, and wherein the enhancement package is further associated with the scanning device identifier.

15. A system, comprising:

a memory;

a data capture subsystem configured to capture a first text-based portion of a rendered document and a second text-based portion of the rendered document;

an enhancement subsystem configured to:

send a text segment from the first text-based portion to a document server, wherein the document server is configured to index text of a corpus of documents;

receive from the document server a document identifier of an electronic document containing the text segment;

send an enhancement package request including the document identifier to a media server, wherein the media server is different from the document server;

send an enhancement package request including the document identifier to a media server; and

receive from the server an enhancement package associated with the document identifier, wherein the enhancement package includes multiple media presentations associated with multiple words of the rendered document, wherein each word of the multiple words is associated with a respective media presentation of the multiple media presentation;

a location subsystem configured to locate within the enhancement package received by the enhancement subsystem media associated with one or more words identified within the second text-based portion; and

a presentation subsystem configured to provide for presentation of the media identified by the location subsystem.

16. The system of claim 15 , wherein the data capture subsystem includes a camera or a microphone.

17. The system of claim 15 , wherein the presentation subsystem includes a display or speaker.

18. The system of claim 15 , wherein the media identified by the location subsystem comprises a video presentation.

19. The system of claim 15 , further comprising a digest subsystem

configured to identify the text segment from the first text-based portion.

20. The system of claim 15 , further comprising a global positioning subsystem configured to determine a location; and

wherein the enhancement subsystem is further configured to:

send the location within the enhancement package request; and

receive from the server an enhancement package associated with the document identifier and the location.

Assignments (4)

Continuity (105)