IP Library Granted Patent US 10,013,766
Granted Patent B2
US 10,013,766 · App. 14/797,479 · Granted Jul 3, 2018

Automatically capturing information such as capturing information using a document-aware device

Inventors: Martin T. King (Vashon Island, WA); Redwood Stephens (Seattle, WA); Claes-Fredrik Mannby (Mercer Island, WA); Jesse Peterson (Mercer Island, WA); Mark Sanvitale (Beaverton, OR); Michael J. Smith (Seattle, WA)
Assignee: Google Inc.
G06T7/004G01B11/00G01B11/14G06F17/211G06F17/241G06F17/243G06F17/30011G06F17/30047G06K9/00442G06K9/18G06T7/70H04N1/0036H04N1/00307H04N1/00331H04N1/00355H04N1/00374H04N1/00408H04N1/00469H04N1/00689H04N1/00737H04N1/00758H04N1/00782H04N1/19594H04N1/32144H04N5/23203H04N5/23222G06T2207/30176H04N2201/0084H04N2201/0096H04N2201/3249H04N2201/3266
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,013,766
App. No.
14/797,479
Granted
Jul 3, 2018
Kind
B2
Abstract

A system and method for automatically changing the operation of a mobile device in response to a presence of information is described. In some examples, the system determines an information capture device is proximate to text, automatically changes operation of the capture device to a certain mode, captures the text, and performs an action associated with the captured text.

Claims (43)

1. A system for presenting information to a user via a mobile device, the system comprising:

a detection component, wherein the detection component is programmed to detect that a target object is within view of a camera associated with the mobile device;

a device operation component, wherein the device operation component is programmed to modify operation of the mobile device in response to receiving a signal from the detection component that indicates the target object is within view of the camera associated with the mobile device, the device operation component being further programmed to perform operations comprising:

determining a duration over which the camera is oriented in a direction of the target object viewed in the camera; and

determining, based on the duration, an intent of a user to obtain additional information about the target object;

a capture component, wherein the capture component is programmed to capture an image of the target object using the camera, in response to receiving a signal from the device operation component that indicates modified operation of the mobile device;

an identification component, wherein the identification component is programmed to identify the target object within the captured image; and

an action component, wherein the action component is programmed to perform an action associated with the identified target object based on the intent of the user.

2. The system of claim 1 , wherein the device operation component is further programmed to perform operations comprising determining that the mobile device is within a certain proximity to the target object, wherein determining an intent of the user to obtain additional information about the target object comprises determining the intent of the user based on the proximity and the duration.

3. The system of claim 1 , wherein the device operation component is further programmed to perform operations comprising obtaining, by the mobile device, an electronic document corresponding to the target object, wherein performing an action comprises presenting the electronic document at the mobile device.

4. The system of claim 3 , wherein obtaining an electronic document corresponding to the target object comprises:

identifying text from the image of the target object; and

identifying the electronic document based on the identified text.

5. The system of claim 1 , wherein determining an intent of the user to obtain additional information about the target object comprises determining an intent of the user to obtain additional information at a time of the capturing.

6. The system of claim 1 , wherein determining an intent of the user to obtain additional information about the target object comprises determining an intent of the user to obtain additional information about the target object at a future time.

7. A computer-implemented method, comprising:

detecting that a target object is within view of a camera associated with a mobile device;

determining a duration over which the camera is oriented in a direction of the target object viewed in the camera;

determining, based on the duration, an intent of a user to obtain additional information about the target object;

capturing an image of the target object using the camera;

identifying the target object within the captured image; and

performing an action associated with the identified target object based on the intent of the user.

8. The computer-implemented method of claim 7 , further comprising determining a proximity of the camera to the target object, wherein determining an intent of the user to obtain additional information about the target object comprises determining the intent of the user based on the proximity and the duration.

9. The computer-implemented method of claim 7 , further comprising obtaining, by the mobile device, an electronic document corresponding to the target object, wherein performing an action comprises presenting the electronic document at the mobile device.

10. The computer-implemented method of claim 9 , wherein obtaining an electronic document corresponding to the target object comprises:

identifying, by the mobile device, text from the image of the target object; and

identifying, by the mobile device, the electronic document based on the identified text.

11. The computer-implemented method of claim 7 , further comprising determining a proximity of the camera to the target object, wherein determining the proximity includes capturing the image of the target object using the camera of the mobile device.

12. The computer-implemented method of claim 7 , wherein determining an intent of the user to obtain additional information about the target object comprises determining an intent of the user to obtain additional information at a time of the capturing.

13. The computer-implemented method of claim 7 , wherein determining an intent of the user to obtain additional information about the target object comprises determining an intent of the user to obtain additional information about the target object at a future time.

14. The computer-implemented method of claim 13 , further comprising creating a timeline that includes the image of the target object.

15. A non-transitory computer-readable medium encoded with a computer program that when executed by a mobile device, causes the mobile device to perform operations comprising:

detecting that a target object is within view of a camera associated with a mobile device;

determining a duration over which the camera is oriented in a direction of the target object viewed in the camera;

determining, based on the duration, an intent of a user to obtain additional information about the target object;

capturing an image of the target object using the camera;

identifying the target object within the captured image; and

performing an action associated with the identified target object based on the intent of the user.

16. The computer-readable medium of claim 15 , the operations further comprising determining a proximity of the camera to the target object, wherein determining an intent of the user to obtain additional information comprises determining the intent of the user based on the proximity and the duration.

17. The computer-readable medium of claim 15 , the operations further comprising obtaining, by the mobile device, an electronic document corresponding to the target object, wherein performing an action comprises presenting the electronic document at the mobile device.

18. The computer-readable medium of claim 17 , wherein obtaining an electronic document corresponding to the image comprises:

identifying, by the mobile device, text from the image of the target object; and

identifying, by the mobile device, the electronic document based on the identified text.

Assignments (4)
NUNC PRO TUNC ASSIGNMENT Recorded Aug 3, 2021
From: GOOGLE LLC
To: KYOCERA CORPORATION
Reel/Frame 057651/0445 →
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2015
From: KING, MARTIN T.; STEPHENS, REDWOOD; MANNBY, CLAES-FREDRIK; PETERSON, JESSE; SANVITALE, MARK; SMITH, MICHAEL J.
To: EXBIBLIO B.V.
Reel/Frame 036194/0904 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2015
From: EXBIBLIO B.V.
To: GOOGLE INC.
Reel/Frame 036195/0135 →
Continuity (6)
Continuation 14161181 · Jan 22, 2014
Continuation 12660146 · Feb 18, 2010
Provisional Application 61184273 · Jun 4, 2009
Provisional Application 61159757 · Mar 12, 2009
Provisional Application 61153614 · Feb 18, 2009
Related Publication 20160035082A1 · Feb 4, 2016
Cited By (1)
US 12,501,225