IP Library Granted Patent US 9,811,728
Granted Patent B2
US 9,811,728 · App. 13/966,236 · Granted Nov 7, 2017

Adding value to a rendered document

Inventors: Martin T. King (Vashon Island, WA); Dale L. Grover (Ann Arbor, MI); Clifford A. Kushler (Lynnwood, WA); James Q. Stafford-Fraser (Cambridge, GB)
Assignee: Google Inc.
G06K9/00483G06F17/21G06F17/2229G06F17/24G06F17/30G06F17/30011G06F17/30637G06F17/30675G06F17/30699
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,811,728
App. No.
13/966,236
Granted
Nov 7, 2017
Kind
B2
Abstract

A system for processing data captured from rendered documents is described. The system provides a way for authors and publishers to add value to printed documents using associated supplemental material. The system can use text scanned from a document and context to identify an electronic document that corresponds to the scanned document. A user can then access supplemental material associated with the digital document.

Claims (48)

1. A computer implemented method of identifying a document, the method comprising:

obtaining document context data for one or more documents, wherein the document context data includes supplemental information used to identify the document and includes temporal information for one or more previous scans of portions of the one or more documents, the temporal information specifying a time at which each previous scan occurred;

receiving data specifying a portion of the document captured using a handheld capture device;

identifying a digital document associated with the document using the document context data including the temporal information and the captured portion of the document;

identifying, using the captured portion of the document, a location of the captured portion within the digital document;

identifying a location-based action to be performed based on the identified location of the captured portion and data specifying one or more location-based actions associated with one or more locations within the digital document; and

performing the identified location-based action.

2. The method of claim 1 , wherein identifying the digital document associated with the document comprises receiving data specifying a second scan of a second portion of a second document and using the second portion to identify the digital document associated with the document.

3. The method of claim 2 , wherein the second document is the document.

4. The method of claim 3 , wherein the second portion of the second document is the same as the captured portion of the document.

5. The method of claim 1 , wherein identifying location of the captured portion within the digital document comprises identifying the location in a layout independent manner using features of the captured portion that are independent of a rendering format of the document.

6. The method of claim 1 , wherein the document context data comprises geographic data specifying a geographic location at which each previous scan occurred.

7. The method of claim 6 , wherein the geographic data specifies global positioning system coordinates.

8. The method of claim 1 , wherein identifying the digital document associated with the document comprises identifying the document in a layout independent manner using features of the captured portion that are independent of a rendering format of the document.

9. The method of claim 1 , wherein the captured portion comprises a plurality of line portions of the document.

10. The method of claim 1 , wherein a typographic change indicates a change in document context.

11. The method of claim 1 , wherein identifying the location-based action to be performed comprises determining similar actions from other captures of portions of documents.

12. The method of claim 1 , wherein identifying a digital document comprises:

identifying a plurality of digital documents; and

identifying the digital document from among the plurality of identified digital documents.

13. The method of claim 12 , wherein the plurality of identified digital documents are ranked according to similar captures of portions of documents.

14. The method of claim 1 , further comprising posting text related to the identified digital document to a computer accessible location.

15. A computing system having a processor coupled to a memory containing computer executable instructions for performing functions of:

obtaining document context data for one or more documents, wherein the document context data includes supplemental information used to identify the document and includes temporal information for one or more previous scans of portions of the one or more documents, the temporal information specifying a time at which each previous scan occurred;

receiving data specifying a portion of a document captured using a handheld capture device;

identifying a digital document associated with the document using the document context data including the temporal information and the captured portion of the document;

identifying, using the captured portion of the document, a location of the captured portion within the digital document; and

identifying a location-based action to be performed based on the identified location of the captured portion data specifying one or more location-based actions associated with one or more locations within the digital document; and

performing the identified location-based action.

16. The computing system of claim 15 :

wherein the document context data further comprises data specifying frequencies with which portions located within a plurality of digital documents are captured, and

wherein identifying the digital document associated with the document using the document context data and the captured portion comprises:

identifying a plurality of digital documents that include the captured portion;

ranking the plurality of digital documents based on the frequencies; and

selecting a digital document having a maximum frequency of the frequencies from among the plurality of digital documents.

17. The computing system of claim 15 :

wherein the document context data further comprises data specifying frequencies with which portions located within a plurality of digital documents are captured, and

identifying a location of the captured portion within the digital document comprises:

identifying a plurality of locations within the digital document;

ranking the plurality of locations based on the frequencies; and

selecting a location having a maximum frequency of the frequencies from among the plurality of locations.

18. A non-transitory computer readable storage medium having storied therein instructions executable by a computing device to cause the computing device to perform functions of:

obtaining document context data for one or more documents, wherein the document context data includes supplemental information used to identify the document and includes temporal information for one or more previous scans of portions of the one or more documents, the temporal information specifying a time at which each previous scan occurred;

receiving data specifying a portion of a document captured using a handheld capture device;

identifying a digital document associated with the document using the document context data including the temporal information and the captured portion of the document;

identifying, using the captured portion of the document, a location of the captured portion within the digital document;

identifying a location-based action to be performed based on the identified location of the captured portion and data specifying one or more location-based actions associated with one or more locations within the digital document; and

performing the identified location-based action.

Assignments (4)
NUNC PRO TUNC ASSIGNMENT Recorded Aug 3, 2021
From: GOOGLE LLC
To: KYOCERA CORPORATION
Reel/Frame 057651/0445 →
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2014
From: KING, MARTIN T.; GROVER, DALE L.; KUSHLER, CLIFFORD A.; STAFFORD-FRASER, JAMES Q.
To: EXBIBLIO B.V.
Reel/Frame 033063/0335 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2014
From: EXBIBLIO B.V.
To: GOOGLE INC.
Reel/Frame 033063/0372 →
Continuity (83)
Continuation 11547835
Continuation In Part 11004637 · Dec 3, 2004
Continuation In Part PCTUS2005011533 · Apr 1, 2005
Continuation In Part PCTUS2005013586 · Apr 6, 2005
Provisional Application 60561768 · Apr 12, 2004
Provisional Application 60563520 · Apr 19, 2004
Provisional Application 60563485 · Apr 19, 2004
Provisional Application 60564688 · Apr 23, 2004
Provisional Application 60564846 · Apr 23, 2004
Provisional Application 60566667 · Apr 30, 2004
Provisional Application 60571381 · May 14, 2004
Provisional Application 60571560 · May 14, 2004
Provisional Application 60571715 · May 17, 2004
Provisional Application 60589203 · Jul 19, 2004
Provisional Application 60589201 · Jul 19, 2004
Provisional Application 60589202 · Jul 19, 2004
Provisional Application 60598821 · Aug 2, 2004
Provisional Application 60602956 · Aug 18, 2004
Provisional Application 60602925 · Aug 18, 2004
Provisional Application 60602947 · Aug 18, 2004
Provisional Application 60602897 · Aug 18, 2004
Provisional Application 60602896 · Aug 18, 2004
Provisional Application 60602930 · Aug 18, 2004
Provisional Application 60602898 · Aug 18, 2004
Provisional Application 60603466 · Aug 19, 2004
Provisional Application 60603082 · Aug 19, 2004
Provisional Application 60603081 · Aug 19, 2004
Provisional Application 60603498 · Aug 20, 2004
Provisional Application 60603358 · Aug 20, 2004
Provisional Application 60604103 · Aug 23, 2004
Provisional Application 60604098 · Aug 23, 2004
Provisional Application 60604100 · Aug 23, 2004
Provisional Application 60604102 · Aug 23, 2004
Provisional Application 60605229 · Aug 27, 2004
Provisional Application 60605105 · Aug 27, 2004
Provisional Application 60613243 · Sep 27, 2004
Provisional Application 60613628 · Sep 27, 2004
Provisional Application 60613632 · Sep 27, 2004
Provisional Application 60613589 · Sep 27, 2004
Provisional Application 60613242 · Sep 27, 2004
Provisional Application 60613602 · Sep 27, 2004
Provisional Application 60613340 · Sep 27, 2004
Provisional Application 60613634 · Sep 27, 2004
Provisional Application 60613461 · Sep 27, 2004
Provisional Application 60613455 · Sep 27, 2004
Provisional Application 60613460 · Sep 27, 2004
Provisional Application 60613400 · Sep 27, 2004
Provisional Application 60613456 · Sep 27, 2004
Provisional Application 60613341 · Sep 27, 2004
Provisional Application 60613361 · Sep 27, 2004
Provisional Application 60613454 · Sep 27, 2004
Provisional Application 60613339 · Sep 27, 2004
Provisional Application 60613633 · Sep 27, 2004
Provisional Application 60615378 · Oct 1, 2004
Provisional Application 60615112 · Oct 1, 2004
Provisional Application 60615538 · Oct 1, 2004
Provisional Application 60617122 · Oct 7, 2004
Provisional Application 60622906 · Oct 28, 2004
Provisional Application 60633452 · Dec 6, 2004
Provisional Application 60633678 · Dec 6, 2004
Provisional Application 60633486 · Dec 6, 2004
Provisional Application 60633453 · Dec 6, 2004
Provisional Application 60634627 · Dec 9, 2004
Provisional Application 60634739 · Dec 9, 2004
Provisional Application 60647684 · Jan 26, 2005
Provisional Application 60648746 · Jan 31, 2005
Provisional Application 60653372 · Feb 15, 2005
Provisional Application 60653663 · Feb 16, 2005
Provisional Application 60653669 · Feb 16, 2005
Provisional Application 60653899 · Feb 16, 2005
Provisional Application 60653679 · Feb 16, 2005
Provisional Application 60653847 · Feb 16, 2005
Provisional Application 60654379 · Feb 17, 2005
Provisional Application 60654368 · Feb 18, 2005
Provisional Application 60654326 · Feb 18, 2005
Provisional Application 60654196 · Feb 18, 2005
Provisional Application 60655279 · Feb 22, 2005
Provisional Application 60655280 · Feb 22, 2005
Provisional Application 60655987 · Feb 22, 2005
Provisional Application 60655697 · Feb 22, 2005
Provisional Application 60655281 · Feb 22, 2005
Provisional Application 60657309 · Feb 28, 2005
Related Publication 20170140219A1 · May 18, 2017