IP Library Granted Patent US 8,447,111
Granted Patent B2
US 8,447,111 · App. 13/031,316 · Granted May 21, 2013

Triggering actions in response to optically or acoustically capturing keywords from a rendered document

Inventors: Martin T. King (Vashon Island, WA); Dale L. Grover (Ann Arbor, MI); Clifford A. Kushler (Lynnwood, WA); James Q. Stafford-Fraser (CambridgeShire, GB)
Assignee: Google Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,447,111
App. No.
13/031,316
Granted
May 21, 2013
Kind
B2
Abstract

A system for processing text captured from rendered documents is described. The system receives a sequence of one or more words optically or acoustically captured from a rendered document by a user. The system identifies among words of the sequence a word with which an action has been associated. The system then performs the associated action with respect to the user.

Claims (57)

1. A method comprising:

receiving, at a server device, a sequence of characters optically or acoustically captured from a rendered document by a capture device remote from the server device;

identifying, using the server device, a document that includes a sequence of characters that matches the captured sequence of characters;

identifying, using the server device, a position, within the identified document, of the sequence of characters that matches the captured sequence of characters; and

identifying, using the server device, a word, phrase or symbol that is within the sequence of characters at the identified position within the identified document and that is associated with an action.

2. The method of claim 1 ,

wherein identifying a word, phrase or symbol comprises identifying a word that is within the sequence of characters at the identified position within the identified document and that is associated with the action, and

wherein the identified word is associated with the action as a result of the identified word being a synonym of another word that is associated with the action.

3. The method of claim 1 , further comprising:

storing, at the server device, a keyword action table from which the server device identifies the word, phrase or symbol that is within the sequence of characters at the identified position within the identified document and that is associated with the action.

4. The method of claim 3 , wherein storing the keyword action table comprises storing a character range, an action verb, and an action object as being associated with the identified word, phrase, or symbol that is within the sequence of characters at the identified position within the identified document.

5. The method of claim 1 , further comprising:

using the server device to perform the action associated with the identified word, phrase or symbol,

wherein performing the action associated with the identified word, phrase or symbol comprises the server device translating the identified word, phrase or symbol from a first spoken language to a second spoken language.

6. The method of claim 1 , further comprising:

using the server device to perform the action associated with the identified word, phrase or symbol,

wherein performing the action associated with the identified word, phrase or symbol comprises the server device retrieving, from a web site of the World Wide Web, a web page associated with the identified word, phrase or symbol.

7. The method of claim 1 , wherein the rendered document comprises a printed document.

8. The method of claim 1 , wherein the rendered document comprises a document shown on a transitory display.

9. The method of claim 1 ,

identifying, using the server, the associated action specified in a digital counterpart of the rendered document.

10. The method of claim 1 , further comprising:

identifying, using the server, the associated action specified in a markup data document separate from the rendered document.

11. The method of claim 1 , further comprising:

identifying, using the server, a condition associated with the identified word, phrase or symbol; and

using the server device to determine that capture of the identified word, phrase or symbol occurred while the condition was met and then to perform the action associated with the identified word, phrase or symbol.

12. The method of claim 11 , wherein the condition is a particular time of day.

13. A server device, comprising:

a processor;

a computer-readable memory device including a document identification index and a document action map; and

a network connection that receives from a network a sequence of characters optically or acoustically captured from a rendered document by a capture device and transmitted to the network connection via the network,

wherein the processor identifies, from the document identification index, a document that that includes a sequence of characters that matches the captured sequence of characters,

wherein the processor identifies, from the document identification index, a position, within the identified document, of the sequence of characters that matches the captured sequence of characters, and

wherein the processor identifies, from the document action map, a word, phrase or symbol that is within the sequence of characters at the identified position within the identified document and that is associated with an action.

14. The server device of claim 13 ,

wherein the processor identifying the word, phrase or symbol comprises the processor identifying a word that is within the sequence of characters at the identified position within the identified document and that is associated with an action, and

wherein the identified word is associated with the action as a result of the identified word being a synonym of another word that is associated with the action.

15. The server device of claim 13 , further comprising:

a user profile stored in the computer-readable memory device,

wherein the user profile comprises data about a person,

wherein the processor uses the user profile to select between alternative actions that are available to be performed for the identified word, phrase or symbol, and

wherein the processor performs an alternative action selected by the processor.

16. The server device of claim 13 ,

wherein the processor performs the action identified from the document action map, and

wherein the action identified from the document action map comprises transmission of an e-mail including the identified word, phrase or symbol.

17. The server device of claim 13 ,

wherein the document action map comprises data that identifies multiple character ranges within the identified document,

wherein each identified character range is associated with data that identifies a keyword, an action object, and an action verb, and

wherein the action verb identifies an action to be taken on the action object associated with the identified character range.

18. The server device of claim 13 , further comprising:

a search engine that searches for a web page from a web site of the World Wide Web.

19. The server device of claim 13 ,

wherein the processor performs the action, and

wherein performance of the action comprises the processor translating the identified word, phrase or symbol from a first spoken language to a second spoken language.

20. The server device of claim 13 ,

wherein the processor performs the action, and

wherein performance of the action comprises the processor providing notice when the identified document becomes available online.

Assignments (4)
NUNC PRO TUNC ASSIGNMENT Recorded Aug 3, 2021
From: GOOGLE LLC
To: KYOCERA CORPORATION
Reel/Frame 057651/0445 →
CHANGE OF NAME Recorded Oct 6, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044141/0827 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2012
From: KING, MARTIN T.; GROVER, DALE L.; KUSHLER, CLIFFORD A.; STAFFORD-FRASER, JAMES Q.
To: EXBIBLIO B.V.
Reel/Frame 028476/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2012
From: EXBIBLIO B.V.
To: GOOGLE INC.
Reel/Frame 028476/0049 →
Continuity (106)
Continuation 12538731 · Aug 10, 2009
Continuation 11097103 · Apr 1, 2005
Continuation In Part 11004637 · Dec 3, 2004
Provisional Application 60657309 · Feb 28, 2005
Provisional Application 60655697 · Feb 22, 2005
Provisional Application 60655279 · Feb 22, 2005
Provisional Application 60655281 · Feb 22, 2005
Provisional Application 60655280 · Feb 22, 2005
Provisional Application 60655987 · Feb 22, 2005
Provisional Application 60654196 · Feb 18, 2005
Provisional Application 60654326 · Feb 18, 2005
Provisional Application 60654368 · Feb 18, 2005
Provisional Application 60654379 · Feb 17, 2005
Provisional Application 60653669 · Feb 16, 2005
Provisional Application 60653663 · Feb 16, 2005
Provisional Application 60653679 · Feb 16, 2005
Provisional Application 60653847 · Feb 16, 2005
Provisional Application 60653899 · Feb 16, 2005
Provisional Application 60653372 · Feb 15, 2005
Provisional Application 60648746 · Jan 31, 2005
Provisional Application 60647684 · Jan 26, 2005
Provisional Application 60634627 · Dec 9, 2004
Provisional Application 60634739 · Dec 9, 2004
Provisional Application 60633486 · Dec 6, 2004
Provisional Application 60633678 · Dec 6, 2004
Provisional Application 60633452 · Dec 6, 2004
Provisional Application 60633453 · Dec 6, 2004
Provisional Application 60622906 · Oct 28, 2004
Provisional Application 60617122 · Oct 7, 2004
Provisional Application 60615378 · Oct 1, 2004
Provisional Application 60615112 · Oct 1, 2004
Provisional Application 60615538 · Oct 1, 2004
Provisional Application 60613243 · Sep 27, 2004
Provisional Application 60613628 · Sep 27, 2004
Provisional Application 60613632 · Sep 27, 2004
Provisional Application 60613589 · Sep 27, 2004
Provisional Application 60613242 · Sep 27, 2004
Provisional Application 60613602 · Sep 27, 2004
Provisional Application 60613340 · Sep 27, 2004
Provisional Application 60613634 · Sep 27, 2004
Provisional Application 60613461 · Sep 27, 2004
Provisional Application 60613455 · Sep 27, 2004
Provisional Application 60613460 · Sep 27, 2004
Provisional Application 60613400 · Sep 27, 2004
Provisional Application 60613456 · Sep 27, 2004
Provisional Application 60613341 · Sep 27, 2004
Provisional Application 60613361 · Sep 27, 2004
Provisional Application 60613454 · Sep 27, 2004
Provisional Application 60613339 · Sep 27, 2004
Provisional Application 60613633 · Sep 27, 2004
Provisional Application 60605229 · Aug 27, 2004
Provisional Application 60605105 · Aug 27, 2004
Provisional Application 60604103 · Aug 23, 2004
Provisional Application 60604098 · Aug 23, 2004
Provisional Application 60604100 · Aug 23, 2004
Provisional Application 60604102 · Aug 23, 2004
Provisional Application 60603498 · Aug 20, 2004
Provisional Application 60603358 · Aug 20, 2004
Provisional Application 60603466 · Aug 19, 2004
Provisional Application 60603082 · Aug 19, 2004
Provisional Application 60603081 · Aug 19, 2004
Provisional Application 60603956 · Aug 18, 2004
Provisional Application 60602925 · Aug 18, 2004
Provisional Application 60602947 · Aug 18, 2004
Provisional Application 60602897 · Aug 18, 2004
Provisional Application 60602896 · Aug 18, 2004
Provisional Application 60602930 · Aug 18, 2004
Provisional Application 60602898 · Aug 18, 2004
Provisional Application 60598821 · Aug 2, 2004
Provisional Application 60589203 · Jul 19, 2004
Provisional Application 60589201 · Jul 19, 2004
Provisional Application 60589202 · Jul 19, 2004
Provisional Application 60571715 · May 17, 2004
Provisional Application 60571381 · May 14, 2004
Provisional Application 60571560 · May 14, 2004
Provisional Application 60566667 · Apr 30, 2004
Provisional Application 60564688 · Apr 23, 2004
Provisional Application 60564846 · Apr 23, 2004
Provisional Application 60563520 · Apr 19, 2004
Provisional Application 60563485 · Apr 19, 2004
Provisional Application 60561768 · Apr 12, 2004
Provisional Application 60559766 · Apr 6, 2004
Provisional Application 60559125 · Apr 2, 2004
Provisional Application 60558909 · Apr 2, 2004
Provisional Application 60559033 · Apr 2, 2004
Provisional Application 60559127 · Apr 2, 2004
Provisional Application 60559087 · Apr 2, 2004
Provisional Application 60559131 · Apr 2, 2004
Provisional Application 60559226 · Apr 1, 2004
Provisional Application 60558893 · Apr 1, 2004
Provisional Application 60558968 · Apr 1, 2004
Provisional Application 60558867 · Apr 1, 2004
Provisional Application 60559278 · Apr 1, 2004
Provisional Application 60559279 · Apr 1, 2004
Provisional Application 60559265 · Apr 1, 2004
Provisional Application 60559277 · Apr 1, 2004
Provisional Application 60558969 · Apr 1, 2004
Provisional Application 60558892 · Apr 1, 2004
Provisional Application 60558760 · Apr 1, 2004
Provisional Application 60558717 · Apr 1, 2004
Provisional Application 60558499 · Apr 1, 2004
Provisional Application 60558370 · Apr 1, 2004
Provisional Application 60558789 · Apr 1, 2004
Provisional Application 60558791 · Apr 1, 2004
Provisional Application 60558527 · Apr 1, 2004
Related Publication 20110150335A1 · Jun 23, 2011