IP Library › Granted Patent US 11,551,684
Granted Patent B1
US 11,551,684 · App. 16/804,996 · Granted Jan 10, 2023

State detection and responses for electronic devices

Inventors: Vinay Kotikalapudi Sriram (Boyds, MD); William Evan Welbourne (Seattle, WA); Jay Patel (Seattle, WA); Sven Eberhardt (Seattle, WA)
Assignee: Amazon Technologies, Inc.
G10L15/22G10L15/30H04L12/12G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,551,684
App. No.
16/804,996
Granted
Jan 10, 2023
Kind
B1
Abstract

This disclosure describes, in part, techniques for utilizing global models to generate local models for electronic devices in an environment, and techniques for utilizing the global models and/or the local models to provide notifications that are based on anomalies detected within the environment. For instance, a remote system may receive an identifier associated with an electronic device and identify a global model using the identifier. The remote system may then receive data indicating state changes of the electronic device and use the data and the global model to generate a local model associated with the electronic device. Using the global model and/or local model, the remote system can identify anomalies associated with the electronic device and, in response to identifying an anomaly, notify the user. The remote system can further cause the electronic device to change states after receiving a request from the user.

Claims (62)

1. A method comprising:

receiving first data indicating a time that a first electronic device is expected to operate in a first state;

receiving second data indicating that the first electronic device is operating in a second state at the time based at least in part on detecting user activity within an environment of the first electronic device;

based at least in part on the first electronic device operating in the second state at the time, generating a notification indicating that the first electronic device is operating in the second state; and

sending the notification to a second electronic device.

2. The method as recited in claim 1 , wherein receiving the first data comprises receiving the first data indicating that the first electronic device is operating in the first state during an additional time, the additional time and the time corresponding to a same time of day.

3. The method as recited in claim 1 , wherein receiving the first data comprises receiving, prior to the time and from the second electronic device, the first data indicating the time that the first electronic device is expected to operate in the first state.

4. The method as recited in claim 1 , further comprising:

receiving third data indicating that a third electronic device switched to operating in a third state;

wherein the first data indicates that the first electronic device is to operate in the first state at the time that is after the third electronic device switches to operating in the third state.

5. The method as recited in claim 1 , wherein:

receiving the first data comprises receiving the first data indicating a location associated with the first electronic device; and

the method further comprises determining the time that the first electronic device is expected to operate in the first state based at least in part on the location.

6. The method as recited in claim 1 , further comprising:

receiving, from the second electronic device, third data associated with operating the first electronic device in the first state; and

sending an instruction that causes the first electronic device to switch from operating in the second state to operating in the first state.

7. The method as recited in claim 1 , further comprising:

generating a query regarding whether to cause the first electronic device to operate in the first state,

wherein the notification includes at least the query.

8. The method as recited in claim 1 , wherein:

generating the notification comprises generating audio data used to output the notification using at least one speaker; and

sending the notification to the second electronic device comprises sending the audio data to the second electronic device.

9. The method as recited in claim 1 , wherein:

generating the notification comprises generating image data used to display the notification using a display; and

sending the notification to the second electronic device comprise sending the image data to the second electronic device.

10. A system comprising:

one or more processors; and

one or more computer-readable media storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

storing first data associated with operating a first electronic device in a first state;

receiving second data associated with the first electronic device;

determining, based at least in part on the second data, that the first electronic device is operating in a second state at a time;

based at least in part on determining that the first electronic device is operating in the second state, generating third data used to present a query regarding whether to operate the first electronic device in the second state; and

sending the third data to a second electronic device.

11. The system as recited in claim 10 , the operations further comprising receiving fourth data indicating that the first electronic device is operating in the first state during an additional time, the additional time and the time corresponding to a same time of day.

12. The system as recited in claim 10 , the operations further comprising:

receiving fourth data indicating that a third electronic device detected motion at the time,

wherein the first data indicates that the first electronic device is to operate in the second state after the third electronic device detects the motion.

13. The system as recited in claim 10 , the operations further comprising:

receiving fourth data indicating that a third electronic device switched to operating in a third state at the time;

wherein the first data indicates that the first electronic device is to operate in the first state after the third electronic device switches to operating in the third state.

14. The system as recited in claim 10 , the operations further comprising:

receiving fourth data indicating a location associated with the first electronic device; and

determining the time that the first electronic device is to operate in the first state based at least in part on the location.

15. The system as recited in claim 10 , the operations further comprising:

receiving, from the second electronic device, fourth data associated with operating the first electronic device in the first state; and

sending an instruction that causes the first electronic device to operate in the first state.

16. The system as recited in claim 10 , wherein:

generating the third data comprises generating audio data used to output the query using at least one speaker; and

sending the third data to the second electronic device comprises sending the audio data to the second electronic device.

17. The system as recited in claim 10 , wherein:

generating the third data comprises generating image data used to display the query using a display; and

sending the third data to the second electronic device comprises sending the image data to the second electronic device.

18. The method as recited in claim 1 , further comprising receiving third data indicating that the user activity was detected within the environment of the first electronic device, wherein the third data is received from at least one of the first electronic device or a third electronic device.

19. The system as recited in claim 10 , the operations further comprising:

determining that a threshold amount of time has passed since the query being presented;

determining a type of device that is associated with the first electronic device; and

sending, after the threshold amount of time, and based at least in part on the type of device, an instruction that causes the first electronic device to switch from operating in the second state to operating in the first state.

20. The system as recited in claim 10 , the operations further comprising:

receiving audio data from the first electronic device, audio data representing an utterance; and

determining, based at least in part on the utterance, to cause the first electronic device to one of:

switch from operating in the second state to operating in the first state, or

remain operating in the second state.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 13, 2020
From: SRIRAM, VINAY KOTIKALAPUDI; WELBOURNE, WILLIAM EVAN; PATEL, JAY; EBERHARDT, SVEN
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 052649/0228 →
Continuity (1)
Continuation 15836414 · Dec 8, 2017
Cited By (1)
US 12,518,754