IP Library Granted Patent US 10,224,056
Granted Patent B1
US 10,224,056 · App. 14/109,319 · Granted Mar 5, 2019

Contingent device actions during loss of network connectivity

Inventors: Fred Torok (Seattle, WA); Rohan Mutagi (Redmond, WA); Vikram Kumar Gundeti (Seattle, WA); Frederic Johan Georges Deramat (Bellevue, WA)
Assignee: Amazon Technologies, Inc.
G10L21/06
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,224,056
App. No.
14/109,319
Granted
Mar 5, 2019
Kind
B1
Abstract

A speech-based system includes a local device in a user premises and a network-based control service that directs the local device to perform actions for a user. The control service may specify a first action that is to be performed upon detection by the local device of a stimulus. In some cases, performing the first action may rely on the availability of network communications with the control service or with another service. In these cases, the control service also specifies a second, fallback action that does not rely upon network communications. Upon detecting the stimulus, the local device performs the first action if network communications are available. If network communications are not available, the local device performs the second, fallback action.

Claims (58)

1. A device, comprising:

a network communications interface configured to connect to one or more network-based computing devices through a communications network;

a microphone to generate an audio signal based at least in part on audio, the audio signal representing speech;

a speaker;

a memory storing first audio data; and

control logic configured to perform acts comprising:

sending the audio signal to the one or more network-based computing devices for recognition of the speech;

receiving a command from the one or more network-based computing devices, the command indicating a notification time derived from the audio signal using speech recognition, wherein the notification time is a time for obtaining, via the communications network, second audio data from a network source; and

at the notification time:

determining that the communications network is unavailable; and

causing, based at least in part on determining that the communications network is unavailable, output of audio content represented by the first audio data using the speaker.

2. The device of claim 1 , wherein the command further indicates the first audio data.

3. The device of claim 1 , wherein the command contains the first audio data.

4. The device of claim 1 , wherein the second audio data comprises music or spoken word.

5. The device of claim 1 , wherein the network source comprises a network-accessible music repository.

6. A device, comprising:

one or more processors; and

one or more non-transitory computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform acts comprising:

transmitting, to one or more network-based computing devices, an audio signal;

receiving one or more commands from the one or more network-based computing devices, wherein the one or more commands specify a stimulus for obtaining, via a network communication, first audio data from a source, and wherein the one or more commands are derived from the audio signal using speech recognition;

storing second audio data;

determining that the stimulus has occurred; and

in response to determining that the stimulus has occurred:

determining that the first audio data is at least temporarily unobtainable from the source; and

causing output of audio content represented by the second audio data based at least in part on the first audio data being at least temporarily unobtainable from the source.

7. The device of claim 6 , the acts further comprising:

receiving an indication that a current time of day corresponds to a predefined time of day,

wherein determining that the stimulus has occurred is based at least in part on receiving the indication.

8. The device of claim 6 , the acts further comprising:

receiving an indication that a predefined amount of time has elapsed,

wherein determining that the stimulus has occurred is based at least in part on receiving the indication.

9. The device of claim 6 , the acts further comprising:

receiving an indication that a predefined environmental condition has occurred,

wherein determining that the stimulus has occurred is based at least in part on receiving the indication.

10. The device of claim 6 , wherein the first audio data comprises a first error message and the second audio data comprises a second error message, and wherein the first error message contains more information than the second error message.

11. The device of claim 6 , wherein the first audio data comprises an error message that is generated dynamically by the one or more network-based computing devices and the second audio data comprises a predefined error message.

12. The device of claim 6 , the acts further comprising receiving, prior to determining that the stimulus has occurred, the second audio data from the one or more network-based computing devices.

13. The device of claim 6 , wherein the one or more commands further specify that the device is to output the audio content represented by the second audio data based at least in part on the first audio data being unobtainable.

14. A method, comprising:

receiving, at a local device and from one or more remote network-based computing devices associated with a remote control service providing services to a plurality of devices, an identification of a stimulus, and an indication of a primary action that is to be initiated at the device in response to the stimulus occurring, wherein the primary action relies on access to the remote control service through a communications network;

receiving, at the local device and from the one or more remote network-based computing devices, an indication of a contingent action that is to be initiated at the device in response to the stimulus occurring, wherein the contingent action may be performed without access to the remote control service;

storing, by the local device, audio content;

determining, by the local device, that the stimulus has occurred; and

in response to determining that the stimulus has occurred:

determining, by the local device, that the remote control service is inaccessible; and

based at least in part on determining that the remote control service is inaccessible, performing, by the local device, the contingent action, wherein the contingent action includes at least outputting the audio content.

15. The method of claim 14 , wherein the primary action comprises controlling one or more devices within a home.

16. The method of claim 14 , wherein:

the primary action comprises obtaining and presenting a weather forecast; and

the audio content corresponds to a previously cached weather forecast.

17. The method of claim 14 , wherein the primary action comprises notifying, by the local device, a user using a first communications medium.

18. The method of claim 14 , wherein:

the primary action comprises receiving and outputting an error message that is generated dynamically by a network-accessible source; and

the audio content comprises a predefined error message.

19. The method of claim 14 , wherein the primary action comprises obtaining additional audio content using the communications network and outputting the additional audio content.

20. The method of claim 14 , further comprising:

receiving, from the one or more remote network-based computing devices, an indication of a predefined time of day,

wherein determining that the stimulus has occurred is based at least in part on receiving the indication of the predefined time of day.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2015
From: RAWLES LLC
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 037103/0084 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2014
From: TOROK, FRED; MUTAGI, ROHAN; GUNDETI, VIKRAM KUMAR; DERAMAT, FREDERIC JOHAN GEORGES
To: RAWLES LLC
Reel/Frame 032793/0615 →
Cited By (15)
US 12,211,490 US 12,217,748 US 12,230,291 US 12,236,932 US 12,283,269 US 12,327,549 US 12,327,556 US 12,360,734 US 12,387,716 US 12,424,220 US 12,505,832 US 12,513,479 US 12,518,756 US 12,699,543 US 12,711,962