IP Library › Granted Patent US 11,567,726
Granted Patent B2
US 11,567,726 · App. 15/656,653 · Granted Jan 31, 2023

Methods, systems, and media for providing information relating to detected events

Inventor: Adam Champy (Palo Alto, CA)
Assignee: Google LLC
G06F3/165G06F3/162G06F16/24565G06F16/686G08B13/1672G08B21/0208G08B21/18G10L15/08G10L15/22G10L17/26G10L25/51H04N21/43635H04R29/00G06F3/04842G10L2015/088H04N7/181
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,567,726
App. No.
15/656,653
Granted
Jan 31, 2023
Kind
B2
Abstract

Methods, systems, and media for providing information are provided. In some implementations, a method for providing information is provided, the method comprising: associating a first recording device of a group of recording devices located in an environment of a user with a trigger term; receiving, from a user device, a query that includes the trigger term; in response to receiving the query, determining that audio data is to be transmitted from at least one recording device from the group of recording devices in the environment of the user; identifying the first recording device based on the inclusion of the trigger term in the received query; receiving the audio data from the first recording device; identifying a characteristic of an animate object in the environment of the user based on the received audio data; and presenting information indicating the characteristic of the animate object on the user device.

Claims (43)

1. A method for providing information, comprising:

associating a first recording device of a group of recording devices located in an environment of a user with a trigger term, wherein the trigger term indicates an animate object that is associated with the first recording device and a location of the first recording device within the environment of the user;

receiving, from a user device, a query that includes the trigger term;

determining, based on the received query, that audio data is to be transmitted from at least one recording device from the group of recording devices in the environment of the user;

identifying the first recording device from the group of recording devices in which the audio data is to be received based on the inclusion of the trigger term in the received query;

in response to detecting the trigger term and identifying the first recording device, activating the first recording device and receiving the audio data from the first recording device;

detecting, within the audio data that was received from the activated first recording device, an event related to the animate object indicated in the trigger term in the environment of the user;

determining a likelihood that the detected event is of interest to the user based on previous information that has been presented to the user on the user device, wherein a confidence value is assigned to the determined likelihood based on a number of times that the detected event was presented to the user on the user device; and

in response to determining that the likelihood that the detected event is of interest to the user is greater than a first predetermined threshold value and in response to determining that the confidence value is greater than a second predetermined threshold value, presenting information indicating the event related to the animate object on the user device.

2. The method of claim 1 , wherein associating the first recording device with the trigger term is based on audio data previously recorded by the first recording device.

3. The method of claim 1 , wherein associating the first recording device with the trigger term is based on a known location of the first recording device within the environment of the user.

4. The method of claim 1 , wherein associating the first recording device with the trigger term is based on an inferred location of the first recording device, wherein the inferred location is determined based on a previously received query from the user device.

5. The method of claim 1 , wherein the information is presented within a user interface that includes a selectable input that causes the received audio data to be presented by the user device.

6. The method of claim 1 , wherein the information is presented within a user interface that includes a selectable input that causes the first recording device to record additional audio data.

7. A system for providing information, the system comprising:

a hardware processor that is programmed to:

associate a first recording device of a group of recording devices located in an environment of a user with a trigger term, wherein the trigger term indicates an animate object that is associated with the first recording device and a location of the first recording device within the environment of the user;

receive, from a user device, a query that includes the trigger term;

determine, based on the received query, that audio data is to be transmitted from at least one recording device from the group of recording devices in the environment of the user;

identify the first recording device from the group of recording devices in which the audio data is to be received based on the inclusion of the trigger term in the received query;

in response to detecting the trigger term and identifying the first recording device, activate the first recording device and receive the audio data from the first recording device;

detect, within the audio data that was received from the activated first recording device, an event related to the animate object indicated in the trigger term in the environment of the user;

determine a likelihood that the detected event is of interest to the user based on previous information that has been presented to the user on the user device, wherein a confidence value is assigned to the determined likelihood based on a number of times that the detected event was presented to the user on the user device; and

in response to determining that the likelihood that the detected event is of interest to the user is greater than a first predetermined threshold value and in response to determining that the confidence value is greater than a second predetermined threshold value, present information indicating the event related to the animate object on the user device.

8. The system of claim 7 , wherein associating the first recording device with the trigger term is based on audio data previously recorded by the first recording device.

9. The system of claim 7 , wherein associating the first recording device with the trigger term is based on a known location of the first recording device within the environment of the user.

10. The system of claim 7 , wherein associating the first recording device with the trigger term is based on an inferred location of the first recording device, wherein the inferred location is determined based on a previously received query from the user device.

11. The system of claim 7 , wherein the information is presented within a user interface that includes a selectable input that causes the received audio data to be presented by the user device.

12. The system of claim 7 , wherein the information is presented within a user interface that includes a selectable input that causes the first recording device to record additional audio data.

13. A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for providing information, the method comprising:

associating a first recording device of a group of recording devices located in an environment of a user with a trigger term, wherein the trigger term indicates an animate object that is associated with the first recording device and a location of the first recording device within the environment of the user;

receiving, from a user device, a query that includes the trigger term;

determining, based on the received query, that audio data is to be transmitted from at least one recording device from the group of recording devices in the environment of the user;

identifying the first recording device from the group of recording devices in which the audio data is to be received based on the inclusion of the trigger term in the received query;

in response to detecting the trigger term and identifying the first recording device, activating the first recording device and receiving the audio data from the first recording device;

detecting, within the audio data that was received from the activated first recording device, an event related to the animate object indicated in the trigger term in the environment of the user;

determining a likelihood that the detected event is of interest to the user based on previous information that has been presented to the user on the user device, wherein a confidence value is assigned to the determined likelihood based on a number of times that the detected event was presented to the user on the user device; and

in response to determining that the likelihood that the detected event is of interest to the user is greater than a first predetermined threshold value and in response to determining that the confidence value is greater than a second predetermined threshold value, presenting information indicating the event related to the animate object on the user device.

14. The non-transitory computer-readable medium of claim 13 , wherein associating the first recording device with the trigger term is based on audio data previously recorded by the first recording device.

15. The non-transitory computer-readable medium of claim 13 , wherein associating the first recording device with the trigger term is based on a known location of the first recording device within the environment of the user.

16. The non-transitory computer-readable medium of claim 13 , wherein associating the first recording device with the trigger term is based on an inferred location of the first recording device, wherein the inferred location is determined based on a previously received query from the user device.

17. The non-transitory computer-readable medium of claim 13 , wherein the information is presented within a user interface that includes a selectable input that causes the received audio data to be presented by the user device.

18. The non-transitory computer-readable medium of claim 13 , wherein the information is presented within a user interface that includes a selectable input that causes the first recording device to record additional audio data.

Assignments (2)
CHANGE OF NAME Recorded Oct 20, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044567/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2017
From: CHAMPY, ADAM
To: GOOGLE INC.
Reel/Frame 043593/0375 →
Continuity (1)
Related Publication 20190026066A1 · Jan 24, 2019