IP Library Granted Patent US 9,633,013
Granted Patent B2
US 9,633,013 · App. 15/076,835 · Granted Apr 25, 2017

Triggering actions in response to optically or acoustically capturing keywords from a rendered document

Inventors: Martin T. King (Vashon Island, WA); Dale L. Grover (Ann Arbor, MA); Clifford A. Kushler (Nevada City, CA); James Q. Stafford-Fraser (Cambridge, GB)
Assignee: Google Inc.
G06F17/30011G06F17/2785G06F17/3002G06F17/30026G06F17/30029G06F17/30047G06K9/00442G06K9/00449G06K9/00483G06K9/344
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,633,013
App. No.
15/076,835
Filed
Mar 22, 2016
Granted
Apr 25, 2017
Kind
B2
Art Unit
2667
USPC
704/9
Abstract

A system for processing text captured from rendered documents is described. The system receives a sequence of one or more words optically or acoustically captured from a rendered document by a user. The system identifies among words of the sequence a word with which an action has been associated. The system then performs the associated action with respect to the user.

Claims (57)

1. A computer-implemented method comprising:

receiving a sequence of symbols that have been optically captured from a rendered document;

determining that the sequence of symbols includes a particular symbol, word, or phrase that has been mapped to one or more actions;

selecting an action from the one or more actions; and

transmitting an instruction to a document management system to perform the selected action.

2. The computer-implemented method of claim 1 , further comprising:

identifying the rendered document, based on the optically captured sequence of symbols; and

identifying, from a corpus of electronic documents, an electronic document that corresponds to the rendered document, wherein transmitting the instruction to the document management system includes specifying that the selected action is to be performed on the electronic document.

3. The computer-implemented method of claim 2 , wherein determining that the sequence of symbols includes a particular keyword that has been mapped to one or more actions comprises accessing a document action map that corresponds to the rendered document and identifies actions to be performed in response to capturing keywords in the identified rendered document.

4. The computer-implemented method of claim 1 , wherein determining that the sequence of symbols includes a particular keyword that has been mapped to one or more actions comprises accessing a global keyword action table that specifies actions to be performed in response to capturing keywords.

5. The computer-implemented method of claim 1 , wherein each of the one or more actions includes a verb that indicates the action to be performed and an object that identifies content on which the action is to be performed.

6. The computer-implemented method of claim 1 , further comprising:

receiving information that identifies a user of a capture device used to optically capture the sequence of symbols from the rendered document;

wherein selecting the action from the one or more actions is based at least in part on a profile of the user.

7. The computer-implemented method of claim 6 , wherein the profile of the user includes information related to interests of the user, wherein selecting the action from the one or more actions comprises selecting a particular action when the profile of the user indicates that the user has a particular interest.

8. The computer-implemented method of claim 1 , further comprising:

receiving information associated with a location of a capture device used to optically capture the sequence of symbols from the rendered document;

wherein selecting the action from the one or more actions is based at least in part on the location of the capture device.

9. The computer-implemented method of claim 1 , further comprising:

determining a time or date range in which the sequence of symbols were optically captured from the rendered document;

wherein selecting the action from the one or more actions is based at least in part on the time or date range.

10. The computer-implemented method of claim 1 , wherein the particular symbol, word, or phrase comprises a particular keyword.

11. The computer-implemented method of claim 1 , further comprising:

presenting a menu of the one or more actions; and

receiving a user selection of one of the one or more actions;

wherein selecting the action from the one or more actions is based on the user selection.

12. The computer-implemented method of claim 11 , wherein the menu of the one or more actions is presented at an integrated display of a capture device used to optically capture the sequence of symbols from the rendered document.

13. The computer-implemented method of claim 11 , wherein the menu of the one or more actions is presented at a display device associated with a capture device used to optically capture the sequence of symbols from the rendered document.

14. The computer-implemented method of claim 1 , further comprising:

presenting a menu of the one or more actions, wherein the menu includes a menu item that corresponds to a default action; and

not receiving a user selection of one of the one or more actions;

wherein selecting the action from the one or more actions comprises selecting the default action.

15. A system, comprising:

one or more data processing apparatus; and

one or more computer-readable storage devices including instructions executable by the data processing apparatus and upon such execution cause the data processing apparatus to perform operations comprising:

receiving a sequence of symbols that have been optically captured from a rendered document;

determining that the sequence of symbols includes a particular symbol, word, or phrase that has been mapped to one or more actions;

selecting an action from the one or more actions; and

transmitting an instruction to a document management system to perform the selected action.

16. The system of claim 15 , wherein the operations further comprise:

receiving information that identifies a user of a capture device used to optically capture the sequence of symbols from the rendered document;

wherein selecting the action from the one or more actions is based at least in part on a profile of the user.

17. The system of claim 15 , wherein the operations further comprise:

receiving information associated with a location of a capture device used to optically capture the sequence of symbols from the rendered document;

wherein selecting the action from the one or more actions is based at least in part on the location of the capture device.

18. The system of claim 15 , wherein the operations further comprise:

determining a time or date range in which the sequence of symbols were optically captured from the rendered document;

wherein selecting the action from the one or more actions is based at least in part on the time or date range.

19. The system of claim 15 , wherein the operations further comprise:

presenting a menu of the one or more actions; and

receiving a user selection of one of the one or more actions;

wherein selecting the action from the one or more actions is based on the user selection.

20. A computer-readable storage device storing software including instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:

receiving a sequence of symbols that have been optically captured from a rendered document;

determining that the sequence of symbols includes a particular symbol, word, or phrase that has been mapped to one or more actions;

selecting an action from the one or more actions; and

transmitting an instruction to a document management system to perform the selected.

Assignments (4)
NUNC PRO TUNC ASSIGNMENT Recorded Aug 3, 2021
From: GOOGLE LLC
To: KYOCERA CORPORATION
Reel/Frame 057651/0445 →
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2016
From: KING, MARTIN T.; GROVER, DALE L.; KUSHLER, CLIFFORD A.; STAFFORD-FRASER, JAMES Q.
To: EXBIBLIO B.V.
Reel/Frame 038283/0979 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2016
From: EXBIBLIO B.V.
To: GOOGLE INC.
Reel/Frame 038284/0119 →
Continuity (110)
Continuation 14800335 · Jul 15, 2015
Continuation 14302023 · Jun 11, 2014
Continuation 13614770 · Sep 13, 2012
Continuation 13031316 · Feb 21, 2011
Continuation 12538731 · Aug 10, 2009
Continuation 11097103 · Apr 1, 2005
Continuation In Part 11004637 · Dec 3, 2004
Provisional Application 60622906 · Oct 28, 2004
Provisional Application 60615378 · Oct 1, 2004
Provisional Application 60615112 · Oct 1, 2004
Provisional Application 61615538 · Oct 1, 2004
Provisional Application 60613243 · Sep 27, 2004
Provisional Application 60613628 · Sep 27, 2004
Provisional Application 60613632 · Sep 27, 2004
Provisional Application 60613589 · Sep 27, 2004
Provisional Application 60613242 · Sep 27, 2004
Provisional Application 60613602 · Sep 27, 2004
Provisional Application 60613340 · Sep 27, 2004
Provisional Application 60613634 · Sep 27, 2004
Provisional Application 60613461 · Sep 27, 2004
Provisional Application 60613455 · Sep 27, 2004
Provisional Application 60613460 · Sep 27, 2004
Provisional Application 60613400 · Sep 27, 2004
Provisional Application 60613456 · Sep 27, 2004
Provisional Application 60613341 · Sep 27, 2004
Provisional Application 60613361 · Sep 27, 2004
Provisional Application 60613454 · Sep 27, 2004
Provisional Application 60613339 · Sep 27, 2004
Provisional Application 60613633 · Sep 27, 2004
Provisional Application 60605229 · Aug 27, 2004
Provisional Application 60605105 · Aug 27, 2004
Provisional Application 60604103 · Aug 23, 2004
Provisional Application 60604098 · Aug 23, 2004
Provisional Application 60604100 · Aug 23, 2004
Provisional Application 60604102 · Aug 23, 2004
Provisional Application 60603498 · Aug 20, 2004
Provisional Application 60603358 · Aug 20, 2004
Provisional Application 60603466 · Aug 19, 2004
Provisional Application 60603082 · Aug 19, 2004
Provisional Application 60603081 · Aug 19, 2004
Provisional Application 60602956 · Aug 18, 2004
Provisional Application 60602925 · Aug 18, 2004
Provisional Application 60602947 · Aug 18, 2004
Provisional Application 60602897 · Aug 18, 2004
Provisional Application 60602896 · Aug 18, 2004
Provisional Application 60602930 · Aug 18, 2004
Provisional Application 60602898 · Aug 18, 2004
Provisional Application 60598821 · Aug 2, 2004
Provisional Application 60589203 · Jul 19, 2004
Provisional Application 60589201 · Jul 19, 2004
Provisional Application 60589202 · Jul 19, 2004
Provisional Application 60571715 · May 17, 2004
Provisional Application 60571381 · May 14, 2004
Provisional Application 60571560 · May 14, 2004
Provisional Application 60566667 · Apr 30, 2004
Provisional Application 60564688 · Apr 23, 2004
Provisional Application 60564846 · Apr 23, 2004
Provisional Application 60563520 · Apr 19, 2004
Provisional Application 60563485 · Apr 19, 2004
Provisional Application 60561768 · Apr 12, 2004
Provisional Application 60559766 · Apr 6, 2004
Provisional Application 60559125 · Apr 2, 2004
Provisional Application 60558909 · Apr 2, 2004
Provisional Application 60559033 · Apr 2, 2004
Provisional Application 60559127 · Apr 2, 2004
Provisional Application 60559087 · Apr 2, 2004
Provisional Application 60559131 · Apr 2, 2004
Provisional Application 60559226 · Apr 1, 2004
Provisional Application 60558893 · Apr 1, 2004
Provisional Application 60558968 · Apr 1, 2004
Provisional Application 60558867 · Apr 1, 2004
Provisional Application 60559278 · Apr 1, 2004
Provisional Application 60559279 · Apr 1, 2004
Provisional Application 60559265 · Apr 1, 2004
Provisional Application 60559277 · Apr 1, 2004
Provisional Application 60558969 · Apr 1, 2004
Provisional Application 60558892 · Apr 1, 2004
Provisional Application 60558760 · Apr 1, 2004
Provisional Application 60558717 · Apr 1, 2004
Provisional Application 60558499 · Apr 1, 2004
Provisional Application 60558370 · Apr 1, 2004
Provisional Application 60558789 · Apr 1, 2004
Provisional Application 60558791 · Apr 1, 2004
Provisional Application 60558527 · Apr 1, 2004
Provisional Application 60617122 · Oct 7, 2004
Provisional Application 60657309 · Feb 28, 2005
Provisional Application 60655287 · Feb 22, 2005
Provisional Application 60655280 · Feb 22, 2005
Provisional Application 60655987 · Feb 22, 2005
Provisional Application 60655279 · Feb 22, 2005
Provisional Application 60655697 · Feb 22, 2005
Provisional Application 60654368 · Feb 18, 2005
Provisional Application 60654326 · Feb 18, 2005
Provisional Application 60654196 · Feb 18, 2005
Provisional Application 60654379 · Feb 17, 2005
Provisional Application 60653669 · Feb 16, 2005
Provisional Application 60653679 · Feb 16, 2005
Provisional Application 60653899 · Feb 16, 2005
Provisional Application 60653847 · Feb 16, 2005
Provisional Application 60653663 · Feb 16, 2005
Provisional Application 60653372 · Feb 15, 2005
Provisional Application 60648746 · Jan 31, 2005
Provisional Application 60647684 · Jan 26, 2005
Provisional Application 60634739 · Dec 9, 2004
Provisional Application 60634627 · Dec 9, 2004
Provisional Application 60634486 · Dec 9, 2004
Provisional Application 60633678 · Dec 6, 2004
Provisional Application 60633452 · Dec 6, 2004
Provisional Application 60633453 · Dec 6, 2004
Related Publication 20160203132A1 · Jul 14, 2016