IP Library Granted Patent US 9,113,076
Granted Patent B2
US 9,113,076 · App. 14/161,181 · Granted Aug 18, 2015

Automatically capturing information such as capturing information using a document-aware device

Inventors: Martin T. King (Vashon Island, WA); Redwood Stephens (Mountain View, CA); Claes-Fredrik Mannby (Mountain View, CA); Jesse Peterson (Mercer Island, WA); Mark Sanvitale (Mountain View, CA); Michael J. Smith (Seattle, WA)
Assignee: Google Inc.
H04N5/23222G06F17/211G06F17/241G06F17/243G06F17/30011G06F17/30047G06K9/00442H04N1/0036H04N1/00307H04N1/00355H04N1/00374H04N1/00408H04N1/00469H04N5/23203
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,113,076
App. No.
14/161,181
Granted
Aug 18, 2015
Kind
B2
Abstract

A system and method for automatically changing the operation of a mobile device in response to a presence of information is described. In some examples, the system determines an information capture device is proximate to text, automatically changes operation of the capture device to a certain mode, captures the text, and performs an action associated with the captured text.

Claims (32)

1. A mobile device comprising:

one or more data processors that execute instructions that cause the one or more data processors to perform operations comprising:

measuring a relative orientation between a document and the mobile device; and

comparing the measured relative orientation to a threshold relative orientation associated with a document capture mode of the mobile device; and

an action component that performs operations comprising:

automatically transitioning the mobile device to the document capture mode when the measured relative orientation is within the threshold relative orientation associated with the document capture mode, wherein the threshold relative orientation is based on an analysis that includes:

analyzing occurrences when a user of the mobile device rejected automatic launching of an application that performs actions in response to text captures; and

analyzing occurrences when a user of the mobile device manually launched the application that performs actions in response to text captures.

2. The mobile device of claim 1 , wherein the one or more data processors are programmed to determine that the mobile device is within a certain proximity to the document and capture an image of the document based on the determined proximity.

3. The mobile device of claim 2 , wherein the one or more data processors are programmed to identify a rendered document based on text in the image and present an electronic counterpart of the rendered document at the mobile device.

4. The mobile device of claim 1 , further comprising:

a display component that presents a view of a camera at the mobile device, wherein the action component is programmed to overlay text within the presented view of the camera with graphical elements that indicate the text is associated with additional information.

5. The mobile device of claim 1 , further comprising:

a display component that presents a view of a camera at the mobile device, wherein the action component is programmed to present one or more user-selectable options associated with the text or a display of text with the presented view of the camera.

6. A non-transitory computer-readable medium whose contents, when executed by a mobile device, cause the mobile device to perform a method for performing an action associated with a rendered document, the method comprising:

measuring a relative orientation between a rendered document and the mobile device;

comparing the measured relative orientation to a threshold relative orientation associated with a document capture mode of the mobile device; and

automatically transitioning the mobile device to the document capture mode when the measured relative orientation is within the threshold relative orientation associated with the document capture mode, wherein the threshold relative orientation is determined by performing an analysis of previous occurrences of the mobile device in document capture mode, wherein the analysis includes:

analyzing occurrences when a user of the mobile device rejected automatic launching of an application that performs actions in response to text captures; and

analyzing occurrences when a user of the mobile device manually launched the application that performs actions in response to text captures.

7. The non-transitory computer-readable medium of claim 6 , wherein measuring the relative orientation between the rendered document and the mobile device includes measuring a distance between an imaging component of the mobile device and the rendered document.

8. The non-transitory computer-readable medium of claim 6 , wherein measuring the relative orientation between the rendered document and the mobile device includes measuring a distance between a center point of a display associated with the mobile device and the rendered document.

9. The non-transitory computer-readable medium of claim 6 , wherein the threshold relative orientation is determined by a user of the mobile device.

10. A method comprising:

measuring a relative orientation between a rendered document and a mobile device;

comparing the measured relative orientation to a threshold relative orientation associated with a document capture mode of the mobile device; and

automatically transitioning the mobile device to the document capture mode when the measured relative orientation is within the threshold relative orientation associated with the document capture mode, wherein the threshold relative orientation is determined by performing an analysis of previous occurrences of the mobile device in document capture mode, wherein the threshold relative orientation is based on an analysis that includes:

analyzing occurrences when a user of the mobile device rejected automatic launching of an application that performs actions in response to text captures; and

analyzing occurrences when a user of the mobile device manually launched the application that performs actions in response to text captures.

11. The method of claim 10 , wherein measuring the relative orientation between the rendered document and the mobile device includes measuring a distance between an imaging component of the mobile device and the rendered document.

12. The method of claim 10 , wherein measuring the relative orientation between the rendered document and the mobile device includes measuring a distance between a center point of a display associated with the mobile device and the rendered document.

13. The method of claim 10 , wherein the threshold relative orientation is determined by a user of the mobile device.

Assignments (4)
NUNC PRO TUNC ASSIGNMENT Recorded Aug 3, 2021
From: GOOGLE LLC
To: KYOCERA CORPORATION
Reel/Frame 057651/0445 →
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2014
From: KING, MARTIN T.; STEPHENS, REDWOOD; MANNBY, CLAES-FREDRIK; PETERSON, JESSE; SANVITALE, MARK; SMITH, MICHAEL J.
To: EXBIBLIO B.V.
Reel/Frame 032673/0689 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2014
From: EXBIBLIO B.V.
To: GOOGLE INC.
Reel/Frame 032673/0764 →
Continuity (5)
Continuation 12660146 · Feb 18, 2010
Provisional Application 61184273 · Jun 4, 2009
Provisional Application 61159757 · Mar 12, 2009
Provisional Application 61153614 · Feb 18, 2009
Related Publication 20140232889A1 · Aug 21, 2014