IP Library › Granted Patent US 10,452,116
Granted Patent B1
US 10,452,116 · App. 15/620,782 · Granted Oct 22, 2019

Determining a device state based on user presence detection

Inventors: David William Devries (San Jose, CA); Stewart Robin Shearer (San Jose, CA); Amit Singh Chhetri (Santa Clara, CA); Serkan Hatipoglu (Santa Clara, CA); Omar Sze Leung (Palo Alto, CA); Michael Serge Devyver (Palo Alto, CA); Leo Benedict Baldwin (San Jose, CA); Noam Sorek (Zichron Yaccov, IL)
Assignee: Amazon Technologies, Inc.
G06F1/3231G01P15/097G06F1/3287G06F3/0416G06F3/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,452,116
App. No.
15/620,782
Granted
Oct 22, 2019
Kind
B1
Abstract

A decision engine executing on an electronic device may determine, using sensor data captured by multiple sensors of the device, whether a user is present in an environment that includes the device. If the user is determined to be present in the environment, the device may transition from a first state to a second state. The first state may be a first power state of the device in which the device is powered off or an idle or dormant state in which the device is powered on but a display of the device is powered off. Correspondingly, the second state may be a second power state of the device in which the device and the display are powered on and content is being rendered on the display. If the decision engine cannot make a determination based on the sensor data, a context engine may adjudicate the user presence determination.

Claims (68)

1. A method, comprising:

determining, by one or more computer processors of an electronic device, first sensor data captured by a first sensor of the electronic device during a first period of time;

determining, by the one or more computer processors, that the first sensor data indicates an occurrence of an event;

activating, by the one or more computer processors, a second sensor of the electronic device, wherein activating the second sensor includes providing power to the second sensor during a second period of time;

determining, by the one or more computer processors, second sensor data captured by the second sensor of the electronic device during the second period of time, wherein the second period of time starts subsequent to a beginning of the first period of time;

determining, by the one or more computer processors, a first sensor data signature comprising at least a portion of the first sensor data and at least a portion of the second sensor data;

determining, by the one or more computer processors, that the first sensor data signature is within a threshold tolerance of a second sensor data signature, wherein the second sensor data signature comprises data captured by at least one of the first sensor or the second sensor prior to the first period of time; and

causing, by the one or more computer processors, the electronic device to transition from a first state to a second state based at least in part on the determining that the first sensor data signature is within the threshold tolerance of the second sensor data signature.

2. The method of claim 1 , wherein in the first state the device receives data having a first resolution, and wherein in the second state the device receives data having a second resolution that is higher than the first resolution.

3. The method of claim 1 , wherein in the first state a display is powered off, and wherein in the second state a display is powered on.

4. The method of claim 1 , wherein the event comprises a detection of a user in proximity to the electronic device.

5. The method of claim 1 , wherein the second sensor consumes a greater amount of power than the first sensor.

6. The method of claim 1 , wherein determining the first sensor data signature further comprises:

removing, by the one or more computer processors, first noise from the first sensor data to generate first modified sensor data;

removing, by the one or more computer processors, second noise from the second sensor data to generate second modified sensor data;

determining, by the one or more computer processors, a presence of a user during the second period of time;

determining, by the one or more computer processors, a first set of sensor data values from the first modified sensor data and a second set of sensor data values from the second modified sensor data;

applying, by the one or more computer processors, a weight to the second set of sensor data values to generate a set of weighted sensor data values; and

generating, by the one or more computer processors, the first sensor data signature using the first set of sensor data values and the set of weighted sensor data values.

7. The method of claim 6 , further comprising:

determining, by the one or more computer processors, that a location of the electronic device has changed from a first location to a second location; and

modifying the weight based at least in part on one or more characteristics associated with the second location, wherein the one or more characteristics comprise at least one of a vibration characteristic of a physical material that is present at the location, an acoustic characteristic, or a wireless signal characteristic.

8. A method, comprising:

receiving, by a one or more computer processors of an electronic device, first sensor data captured by a first sensor of the electronic device during a first period of time;

determining, by the one or more computer processors, that the first sensor data indicates an occurrence of an event;

activating, by the one or more computer processors, a second sensor of the electronic device, wherein activating the second sensor includes providing power to the second sensor during a second period of time;

determining, by the one or more computer processors, second sensor data captured by the second sensor of the electronic device during the second period of time, wherein the second period of time starts subsequent to a beginning of the first period of time;

determining, by the one or more computer processors, a first sensor data signature comprising at least a portion of the first sensor data and at least a portion of the second sensor data;

determining, by the one or more computer processors, a second sensor data signature indicative of user presence in a detection region of the electronic device, wherein the second sensor data signature is based at least in part on data captured by at least one of the first sensor or the second sensor prior to the first period of time;

determining, by the one or more computer processors, that the first sensor data signature is within a threshold tolerance of the second sensor data signature; and

causing, by the one or more computer processors, the electronic device to transition from a first state to a second state based at least in part on the determining that the first sensor data signature is within the threshold tolerance of the second sensor data signature.

9. The method of claim 8 , further comprising:

determining a first matrix based at least in part on the first sensor data signature; and

determining a second matrix based at least in part on the second sensor data signature;

wherein the determining that the first sensor data signature is within the threshold tolerance of the second sensor data signature is based at least in part on determining that the first matrix of the first sensor data signature is within the threshold tolerance of the second matrix of the second sensor data signature.

10. The method of claim 8 , further comprising;

determining, by the one or more computer processors, third sensor data captured by the first sensor during a third period of time subsequent to the first period of time;

determining, by the one or more computer processors, fourth sensor data captured by the second sensor during the third period of time;

determining, by the one or more computer processors, fifth sensor data generated by at least one of the first sensor or the second sensor over a fourth period of time prior to the third period of time;

determining, by the one or more computer processors, that no user presence verification event occurred during the fourth period of time;

determining, by the one or more computer processors, a third sensor data signature comprising at least a portion of the third sensor data and at least a portion of the fourth sensor data;

determining, by the one or more computer processors, that the third sensor data signature is within the threshold tolerance of a fourth sensor data signature that comprises at least a portion of the fifth sensor data;

determining, by the one or more computer processors, that the fourth sensor data signature is stored in association with an indication of user absence from the detection region during the fourth period of time;

determining, by the one or more computer processors, user absence from a detection region of the electronic device during the third period of time; and

causing, by the one or more computer processors, the electronic device to transition from the second state to the first state.

11. The method of claim 8 , wherein the data captured by at least one of the first sensor or the second sensor prior to the first period of time comprises a baseline level of ambient noise.

12. The method of claim 8 , wherein the second sensor data signature indicates a presence of a user, and wherein the second sensor data comprises one of touch input data or audio data comprising representation of a predetermined word or phrase.

13. The method of claim 8 , further comprising:

determining, by the one or more computer processors, that the first sensor data satisfies a first threshold confidence value; and

activating, by the one or more computer processors, the second sensor based at least in part on the first sensor data satisfying the first threshold confidence value, wherein the second sensor captures the second sensor data subsequent to the first sensor capturing the first sensor data.

14. An electronic device, comprising:

at least one memory storing computer-executable instructions; and

at least one processor operatively coupled to the at least one memory, wherein the at least one processor is configured to execute the computer-executable instructions to:

determine first sensor data captured by a first sensor during a first period of time

determine that the first sensor data indicates occurrence of an event;

activate a second sensor, wherein activating the second sensor includes providing provide power to the second sensor during a second period of time;

determine second sensor data captured by the second sensor during the second period of time, wherein the second period of time starts subsequent to a beginning of the first period of time;

determine a first sensor data signature comprising at least a portion of the first sensor data and at least a portion of the second sensor data;

determine that the first sensor data signature is within a threshold tolerance of a second sensor data signature, wherein the second sensor data signature comprises data captured by at least one of the first sensor or the second sensor prior to the first period of time; and

cause the electronic device to transition from a first state to a second state that is different from the first state based at least in part on the determining that the first sensor data signature is within the threshold tolerance of the second sensor data signature.

15. The electronic device of claim 14 , wherein a display is powered off when the electronic device is in the first state, and wherein the display is powered on when the electronic device is in the second state.

16. The electronic device of claim 14 , wherein the at least one processor is further configured to:

apply a first weight, based at least in part on a first location of the electronic device, to the first sensor data and a second weight, based at least in part on a second, different location of the electronic device, to the second sensor data;

wherein the at least a portion of the first sensor data is weighted according to the first weight, and wherein the at least a portion of the second sensor data is weighted according to the second weight.

17. The electronic device of claim 16 , wherein the first weight is based on an assessment of the first sensor operating within a detection region in which the electronic device is located.

18. The electronic device of claim 17 , wherein the assessment is based at least in part on one or more of: a physical address associated with the electronic device, or a GPS location of the electronic device.

19. The electronic device of claim 16 , wherein at least one of the first weight or the second weight is based at least in part on an assessment of a structure within which the electronic device is located.

20. The electronic device of claim 16 , wherein at least one of the first weight or the second weight is based at least in part on historical sensor data captured by the first sensor and by the second sensor within a detection region in which the electronic device is located.

Continuity (1)
Continuation 14859008 · Sep 18, 2015
Cited By (17)
US 12,334,069 US 12,353,610 US 12,375,632 US 12,469,328 US 12,475,219 US 12,499,193 US 12,499,194 US 12,530,472 US 12,547,720 US 12,554,306 US 12,561,426 US 12,561,488 US 12,592,140 US 12,633,159 US 12,666,132 US 12,671,891 US 12,748,828