IP Library Granted Patent US 8,621,349
Granted Patent B2
US 8,621,349 · App. 12/898,653 · Granted Dec 31, 2013

Publishing techniques for adding value to a rendered document

Inventors: Martin T. King (Vashon Island, WA); Dale L. Grover (Ann Arbor, MI); Clifford A. Kushler (Lynnwood, WA); James Q. Stafford-Fraser (Cambridge, GB)
Assignee: Google Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,621,349
App. No.
12/898,653
Filed
Oct 5, 2010
Granted
Dec 31, 2013
Kind
B2
Art Unit
2142
USPC
715/708
Abstract

A system for processing a visual capture operation as described. The system receives an indication of a visual capture operation performed from a rendered document. The indication specifies both a text sequence capture As part of the capture operation and a supplemental marking captured as part of the capture operation. The system determines an action to perform in response to receiving the indication, based both upon the text sequence specified in the indication and the supplemental markings specified by the indication.

Claims (54)

1. A method, comprising:

capturing an image from a printed document using a mobile device, the image including a text fragment;

locating a position in the printed document containing the text fragment; and

presenting a time-indexed media sequence at a time index for the time-indexed media sequence that corresponds to the located position in the printed document.

2. The method of claim 1 , further comprising: identifying the printed document using the text fragment.

3. The method of claim 1 wherein presenting the time-indexed media sequence comprises presenting the time-indexed media sequence using the mobile device.

4. The method of claim 1 wherein the media sequence comprises an audio sequence, a movie, a video sequence, a sequence of images, an audio/video sequence, or combinations thereof.

5. The method of claim 1 wherein the printed document comprises a book.

6. The method of claim 1 wherein the time-indexed media sequence contains all words of a contiguous portion of the printed document, and wherein the contiguous portion comprises multiple words and includes the text fragment.

7. A non-transitory computer-readable medium having instructions stored thereon that, if executed by a mobile device, cause the mobile device to perform functions comprising:

capturing an image from a printed document, the image including a text fragment;

locating a position in the printed document containing the text fragment; and

presenting a time-indexed media sequence at a time index for the time-indexed media sequence that corresponds to the located position in the printed document.

8. A mobile device, comprising:

an image sensor configured to capture an image of a printed document, the image including a text fragment;

a location subsystem configured to locate a position in the printed document containing the text fragment; and

a displaying subsystem configured to present a time-indexed media sequence at a time index for the time-indexed media sequence that corresponds to the located position in the printed document.

9. The mobile device of claim 8 wherein the mobile device further comprises a wireless transceiver for mobile telephony.

10. A method, comprising:

performing an optical capture from a book using an optical component of a mobile device

identifying the book from the optical capture, using the mobile device, by at least:

identifying a text fragment within the optical capture, and

locating, a position in the book containing the identified text fragment;

retrieving a media sequence associated with the book using the mobile device; and

presenting the retrieved media sequence using the mobile device by at least presenting the retrieved media sequence at a time in the time-indexed media sequence that corresponds to the located position in the book.

11. The method of claim 10 , wherein the book comprises an academic textbook.

12. The method of claim 10 , wherein the retrieved media sequence was created after the book was produced.

13. The method of claim 10 , wherein the retrieved media sequence was created by a creator unrelated to a publisher of the book.

14. The method, of claim 10 , wherein the mobile device comprises a cell phone.

15. The method of claim 10 , wherein the presented media sequence contains all words of a contiguous portion of the book, and wherein the contiguous portion comprises multiple words and includes the text fragment.

16. A non-transitory computer-readable medium having instructions stored thereon that, if executed by a mobile device, cause the mobile device to perform functions comprising:

performing a optical capture from a book;

identifying the book from the optical capture, by at least:

identifying a text fragment within the optical capture, and

locating a position in the book containing the identified text fragment;

retrieving a media sequence associated with the book; and

presenting the retrieved media sequence by at least presenting the retrieved media sequence at a time in the time-indexed media sequence that corresponds to the located position in the book.

17. The non-transitory computer-readable medium of claim 16 , wherein the book comprises an academic textbook.

18. The non-transitory computer-readable medium of claim 16 , wherein the retrieved media sequence was created after the book was produced.

19. The non-transitory computer-readable medium of claim 16 , wherein the retrieved media sequence was created by a creator unrelated to a publisher of the book.

20. The non-transitory compute-readable medium of claim 16 , wherein the mobile device comprises a cell phone.

21. The non-transitory computer -readable medium of claim 16 , wherein the presented media sequence contains all words of a contiguous portion of the book, and wherein the contiguous portion comprises multiple words that include the text fragment.

22. A mobile device, comprising:

an image sensor configured to perform an optical capture from a book;

an identification subsystem that is configured to identify the book from the optical capture by at least:

identifying a text fragment within the optical capture, and

locating a position in the book containing the identified text fragment;

a retrieval subsystem configured to retrieve a media sequence associated with the book; and

a display subsystem configured to present the retrieved media sequence by at least presenting the retrieved media sequence at a time in the media sequence that corresponds to the located position in the book.

23. The mobile device of claim 22 , wherein the book comprises an academic textbook.

24. The mobile device of claim 22 , wherein the retrieved media sequence was created after the book was produced.

25. The mobile device of claim 22 , wherein the retrieved media. sequence was created by a creator unrelated to a publisher of the book.

26. The mobile device of claim 22 , further comprising a wireless transceiver configured for mobile telephony.

27. The mobile device of claim 22 , wherein the presented media sequence contains all words of a contiguous portion of the book, and wherein the contiguous portion comprises multiple words and includes the text fragment.

Assignments (4)
NUNC PRO TUNC ASSIGNMENT Recorded Aug 3, 2021
From: GOOGLE LLC
To: KYOCERA CORPORATION
Reel/Frame 057651/0445 →
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2011
From: KING, MARTIN T.; GROVER, DALE L.; KUSHLER, CLIFFORD A.; STAFFORD-FRASER, JAMES Q.
To: EXBIBLIO B.V.
Reel/Frame 025804/0233 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2011
From: EXBIBLIO B.V.
To: GOOGLE INC.
Reel/Frame 025804/0677 →
Continuity (104)
Continuation 11097835 · Apr 1, 2005
Continuation 11004637 · Dec 3, 2004
Provisional Application 60657309 · Feb 28, 2005
Provisional Application 60655281 · Feb 22, 2005
Provisional Application 60655697 · Feb 22, 2005
Provisional Application 60655987 · Feb 22, 2005
Provisional Application 60655280 · Feb 22, 2005
Provisional Application 60655279 · Feb 22, 2005
Provisional Application 60654196 · Feb 18, 2005
Provisional Application 60654326 · Feb 18, 2005
Provisional Application 60654368 · Feb 18, 2005
Provisional Application 60654379 · Feb 17, 2005
Provisional Application 60653847 · Feb 16, 2005
Provisional Application 60653679 · Feb 16, 2005
Provisional Application 60653899 · Feb 16, 2005
Provisional Application 60653669 · Feb 16, 2005
Provisional Application 60653663 · Feb 16, 2005
Provisional Application 60653372 · Feb 15, 2005
Provisional Application 60648746 · Jan 31, 2005
Provisional Application 60647684 · Jan 26, 2005
Provisional Application 60634739 · Dec 9, 2004
Provisional Application 60634627 · Dec 9, 2004
Provisional Application 60633453 · Dec 6, 2004
Provisional Application 60633486 · Dec 6, 2004
Provisional Application 60633678 · Dec 6, 2004
Provisional Application 60633452 · Dec 6, 2004
Provisional Application 60622906 · Oct 28, 2004
Provisional Application 60617122 · Oct 7, 2004
Provisional Application 60615538 · Oct 1, 2004
Provisional Application 60615112 · Oct 1, 2004
Provisional Application 60615378 · Oct 1, 2004
Provisional Application 60613633 · Sep 27, 2004
Provisional Application 60613339 · Sep 27, 2004
Provisional Application 60613454 · Sep 27, 2004
Provisional Application 60613361 · Sep 27, 2004
Provisional Application 60613341 · Sep 27, 2004
Provisional Application 60613456 · Sep 27, 2004
Provisional Application 60613400 · Sep 27, 2004
Provisional Application 60613460 · Sep 27, 2004
Provisional Application 60613455 · Sep 27, 2004
Provisional Application 60613461 · Sep 27, 2004
Provisional Application 60613634 · Sep 27, 2004
Provisional Application 60613340 · Sep 27, 2004
Provisional Application 60613602 · Sep 27, 2004
Provisional Application 60613242 · Sep 27, 2004
Provisional Application 60613589 · Sep 27, 2004
Provisional Application 60613632 · Sep 27, 2004
Provisional Application 60613628 · Sep 27, 2004
Provisional Application 60613243 · Sep 27, 2004
Provisional Application 60605105 · Aug 27, 2004
Provisional Application 60605229 · Aug 27, 2004
Provisional Application 60604102 · Aug 23, 2004
Provisional Application 60604100 · Aug 23, 2004
Provisional Application 60604098 · Aug 23, 2004
Provisional Application 60604103 · Aug 23, 2004
Provisional Application 60603358 · Aug 20, 2004
Provisional Application 60603498 · Aug 20, 2004
Provisional Application 60603081 · Aug 19, 2004
Provisional Application 60603082 · Aug 19, 2004
Provisional Application 60603466 · Aug 19, 2004
Provisional Application 60602898 · Aug 18, 2004
Provisional Application 60602930 · Aug 18, 2004
Provisional Application 60602896 · Aug 18, 2004
Provisional Application 60602897 · Aug 18, 2004
Provisional Application 60602947 · Aug 18, 2004
Provisional Application 60602925 · Aug 18, 2004
Provisional Application 60602956 · Aug 18, 2004
Provisional Application 60598821 · Aug 2, 2004
Provisional Application 60589202 · Jul 19, 2004
Provisional Application 60589201 · Jul 19, 2004
Provisional Application 60589203 · Jul 19, 2004
Provisional Application 60571715 · May 17, 2004
Provisional Application 60571560 · May 14, 2004
Provisional Application 60571381 · May 14, 2004
Provisional Application 60564846 · Apr 23, 2004
Provisional Application 60564688 · Apr 23, 2004
Provisional Application 60563485 · Apr 19, 2004
Provisional Application 60563520 · Apr 19, 2004
Provisional Application 60561768 · Apr 12, 2004
Provisional Application 60559766 · Apr 6, 2004
Provisional Application 60559131 · Apr 2, 2004
Provisional Application 60559087 · Apr 2, 2004
Provisional Application 60559127 · Apr 2, 2004
Provisional Application 60559033 · Apr 2, 2004
Provisional Application 60558909 · Apr 2, 2004
Provisional Application 60559125 · Apr 2, 2004
Provisional Application 60558527 · Apr 1, 2004
Provisional Application 60558791 · Apr 1, 2004
Provisional Application 60558789 · Apr 1, 2004
Provisional Application 60558370 · Apr 1, 2004
Provisional Application 60558499 · Apr 1, 2004
Provisional Application 60558717 · Apr 1, 2004
Provisional Application 60558760 · Apr 1, 2004
Provisional Application 60558892 · Apr 1, 2004
Provisional Application 60558969 · Apr 1, 2004
Provisional Application 60559277 · Apr 1, 2004
Provisional Application 60559265 · Apr 1, 2004
Provisional Application 60559279 · Apr 1, 2004
Provisional Application 60559278 · Apr 1, 2004
Provisional Application 60558867 · Apr 1, 2004
Provisional Application 60558968 · Apr 1, 2004
Provisional Application 60558893 · Apr 1, 2004
Provisional Application 60559226 · Apr 1, 2004
Related Publication 20110026838A1 · Feb 3, 2011