IP Library Granted Patent US 11,423,899
Granted Patent B2
US 11,423,899 · App. 16/819,316 · Granted Aug 23, 2022

Controlling device output according to a determined condition of a user

Inventor: Tiruvilwamalai Raman (San Jose, CA)
Assignee: GOOGLE LLC
G10L15/22A61B5/0024A61M21/02H04N21/4852H04N21/4854H04N21/8456A61M2021/0027
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,423,899
App. No.
16/819,316
Granted
Aug 23, 2022
Kind
B2
Abstract

Dynamically controlling output from a device, such as an automated assistant device. Control of the output can be based on, for example, a condition and/or physiological attribute(s) of a user of the device. Various implementations dynamically control the output to improve sleep quality for the user and/or mitigate waste of computational and/or network resources.

Claims (52)

1. A method implemented by one or more processors, the method comprising:

receiving, at an automated assistant interface of an automated assistant, a spoken utterance provided by a user while the user is awake;

determining, based on processing the spoken utterance, that the spoken utterance includes a request to initialize playback of media in accordance with a desired condition of a dynamic condition of the user and further includes an indication from the user that the user has an intention to change the dynamic condition of the user from an initial condition to the desired condition;

determining an initial value of the initial condition of the dynamic condition of the user, where the initial value of the initial condition of the dynamic condition is detected at the time the user provided the spoken utterance while the user is awake;

determining a present value, of an adjustable characteristic of the playback of media, based on the initial value of the initial condition of the dynamic condition of the user in which the user provided the spoken utterance;

in response to determining that the spoken utterance includes the request to initialize the playback of media, causing a computing device to render the playback of media based on the present value of the adjustable characteristic of the playback of media;

after initializing the playback of the media: processing data that is based on one or more sensors in an environment to determine a current condition of the dynamic condition of the user;

determining, based on the processing of the data, whether the present value, of the adjustable characteristic of the playback of media which is based on the dynamic condition of the user, is unsuitable for the current condition of the user, wherein the current condition corresponds to the desired condition of the user;

wherein determining whether the present value is unsuitable for the current condition of the user is based on whether the present value will increase a probability that the user will regress away from the desired condition of the user and towards the initial condition; and

when the present value is determined to be unsuitable for the current condition of the user;

selecting an alternate value for the adjustable characteristic of the playback of media, wherein the selecting the alternate value is based on a change in the value of the dynamic condition of the user from the initial value to a current value indicative of the current condition of the user, wherein the alternate value is selected to decrease the probability of the user regressing away from the desired condition of the user and towards the initial condition, and

causing the computing device to transition the playback of media from exhibiting the present value to the alternate, value.

2. The method of claim 1 , wherein the present value of the playback of media corresponds to a volume of the playback of media being emitted into the environment, and wherein the alternate value of the playback of media corresponds to a lower volume of the playback of media, the lower volume of the playback of media being lower relative to the volume of the present value of the playback of media.

3. The method of claim 1 , further comprising: determining whether the present value of the playback of media will increase the probability that the user will regress away from the desired condition further based on a correspondence between the current condition of the user and the present value of the playback of media.

4. The method of claim 1 , wherein the one or more sensors in the environment, on which the data is based, comprise a sensor that is attached to a wearable computing device being worn by the user.

5. The method of claim 1 , wherein the one or more sensors are responsive to physiological attributes of the user, and wherein the dynamic condition of the user is based on the physiological attributes of the user and the desired condition of the user is a sleep state.

6. The method of claim 1 , wherein the data includes circumstantial data that is based on outputs from multiple different computing devices connected to a local area network with the computing device.

7. The method of claim 1 , wherein the initial condition is based on an amplitude of the spoken utterance.

8. A non-transitory computer readable storage medium configured to store instructions that, when executed by one or more processors, cause the one or more processors to perform operations that include:

receiving, at an automated assistant interface of an automated assistant, a spoken utterance provided by a user while the user is awake;

determining, based on processing the spoken utterance, that the spoken utterance includes a request to initialize playback of media in accordance with a desired condition of a dynamic condition of the user and further includes an indication from the user that the user has an intention to change the dynamic condition of the user from an initial condition to the desired condition;

determining an initial value of the initial condition of the dynamic condition of the user, where the initial value of the initial condition of the dynamic condition is detected at the time the user provided the spoken utterance while the user is awake;

determining a present value, of an adjustable characteristic of the playback of media, based on the initial value of the initial condition of the dynamic condition of the user in which the user provided the spoken utterance;

in response to determining that the spoken utterance includes the request to initialize the playback of media, causing a computing device, to render the playback of media based on the present value of the adjustable characteristic of the playback of media;

after initializing the playback of the media: processing data that is based on one or more sensors in an environment to determine a current condition of the dynamic condition of the user:

determining, based on the processing of the data, whether the present value, of the adjustable characteristic of the playback of media which is based on the dynamic condition of the user, is unsuitable for the current condition of the user, wherein the current condition corresponds to the desired condition of the user;

wherein determining whether the present value is unsuitable for the current condition of the user is based on whether the present value will increase a probability that the user will regress away from the desired condition of the user and towards the initial condition; and

when the present value is determined to be unsuitable for the current condition of the user:

selecting an alternate value for the adjustable characteristic of the playback of media, wherein the selecting the alternate value is based on a change in the value of the dynamic condition of the user from the initial value to a current value indicative of the current condition of the user, Wherein the alternate value is selected to decrease the probability of the user regressing away from the desired condition of the user and towards the initial condition, and

causing the computing device to transition the playback of media from exhibiting the present value to the alternate value.

9. The non-transitory computer readable storage medium of claim 8 , wherein the present value of the playback of media corresponds to a volume of the media being emitted into the environment, and wherein the alternate value of the playback of media corresponds to a lower volume of the playback of media, the lower volume of the playback of media being lower relative to the volume of the present value of the playback of media.

10. The non-transitory computer readable storage medium of claim 8 , wherein the operations further include: determining whether the present value of the playback of media will increase the probability that the user will regress away from the desired condition further based on a correspondence between the current condition of the user and the present value of the playback of media.

11. The non-transitory computer readable storage medium of claim 8 , wherein the one or more sensors in the environment, on which the data is based, comprise a sensor that is integral to a wearable computing device being worn by the user.

12. The non-transitory computer readable storage medium of claim 11 , wherein the one or more sensors are responsive to physiological attributes of the user, and wherein the dynamic condition of the user is based on the physiological attributes of the user and the desired condition of the user is a sleep state.

13. The non-transitory computer readable storage medium of claim 8 , wherein the data includes circumstantial data that is based on outputs from multiple different computing devices connected to a local area network with the computing device.

14. A computing device, comprising one or more processors, and memory configured to store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations that include:

receiving, at an automated assistant interface of an automated assistant, a spoken utterance provided by a user while the user is awake;

determining, based on processing the spoken utterance, that the spoken utterance includes a request to initialize playback of media in accordance with a desired condition of a dynamic condition of the user and further includes an indication from the user that the user has an intention to change the dynamic condition of the user from an initial condition to the desired condition;

determining an initial value of the initial condition of the dynamic condition of the user, where the initial value of the initial condition of the dynamic condition is detected at the time the user provided the spoken utterance while the user is awake

determining a present value, of an adjustable characteristic of the playback of media, based on the initial value of the initial condition of the dynamic condition of the user in Which the user provided the spoken utterance;

in response to determining that the spoken utterance includes the request to initialize, the playback of media, causing a computing device to render the playback of media based on the present value of the adjustable characteristic of the playback of media;

after initializing the playback of the media:

processing data that is based on one or more sensors in an environment to determine a current condition of the dynamic condition of the user:

determining, based on the processing of the data, whether the present value, of the adjustable characteristic of the playback of media which is based on the dynamic condition of the user, is unsuitable for the current condition of the user, wherein the current condition corresponds to the desired condition of the user;

wherein determining whether the present value is unsuitable for the current condition of the user is based on whether the present value will increase a probability that the user will regress away from the desired condition of the user and towards the initial condition; and

when the present value is determined to be unsuitable for the current condition of the user:

selecting an alternate value for the adjustable characteristic of the playback of media, wherein the selecting the alternate value is based on a change in the value of the dynamic condition of the user from the initial value to a current value indicative of the current condition of the user,

wherein the alternate value is selected to decrease the probability of the user regressing away from the desired condition of the user and towards the initial condition, and

causing the computing device to transition the playback of media from exhibiting the present value to the alternate value.

15. The computing device of claim 14 , wherein the operations further include: determining whether the present value of the playback of media will increase the probability that the user will regress away from the desired condition further based on a correspondence between the current condition of the user and the present value of the playback of media.

16. The computing device of claim 14 , wherein the one or more sensors in the environment, on which the data is based, comprise a sensor that is integral to a wearable computing device being worn by the user.

17. The computing device of claim 14 , wherein the one or more sensors are responsive to physiological attributes of the user, and wherein the dynamic condition of the user is based on the physiological attributes of the user and the desired condition of the user is a sleep state.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 6, 2020
From: RAMAN, TIRUVILWAMALAI
To: GOOGLE LLC
Reel/Frame 052316/0428 →
Continuity (3)
Continuation 16251943 · Jan 18, 2019
Provisional Application 62769200 · Nov 19, 2018
Related Publication 20200219509A1 · Jul 9, 2020