IP Library Granted Patent US 11,227,600
Granted Patent B2
US 11,227,600 · App. 17/397,604 · Granted Jan 18, 2022

Virtual assistant identification of nearby computing devices

Inventor: Jian Wei Leong (Mountain View, CA)
Assignee: GOOGLE LLC
G10L15/30G06F3/165G10L15/22G10L2015/221G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,227,600
App. No.
17/397,604
Granted
Jan 18, 2022
Kind
B2
Abstract

In one example, a method includes method comprising: receiving audio data generated by a microphone of a current computing device; identifying, based on the audio data, one or more computing devices that each emitted a respective audio signal in response to speech reception being activated at the current computing device; and selecting either the current computing device or a particular computing device from the identified one or more computing devices to satisfy a spoken utterance determined based on the audio data.

Claims (100)

1. A battery powered device comprising:

one or more microphones,

one or more Wi-Fi network interfaces connected to a particular Wi-Fi network;

one or more processors; and

memory storing instructions that, when executed, cause one or more of the processors to:

detect actuation of a button of the battery powered device;

in response to detecting the actuation of the button:

transmit, via the one or more Wi-Fi network interfaces and over the particular Wi-Fi network, a request that:

causes a second computing device, that is located in a physical environment with the battery powered device and that is also connected to the particular Wi-Fi network, to emit a second device audio signal via a second device speaker component of the second computing device, and

causes a third computing device, that is also located in the physical environment and that is also connected to the particular Wi-Fi network, to emit a third device audio signal via a third device speaker component of the third computing device,

 wherein the second device audio signal and the third device audio signal are each above a range of human hearing;

detect, at the battery powered device and via one or more of the microphones of the battery powered device, the second device audio signal and the third device audio signal;

select, based on the detection of the second device audio signal and the third device audio signal, a particular computing device from among at least the second computing device and the third computing device; and

in response to selecting the particular computing device:

cause the particular computing device to provide audible output.

2. The battery powered device of claim 1 , wherein in selecting the particular computing device based on the detection of the second device audio signal and the third device audio signal, one or more of the processors are to:

determine, based on the second device audio signal as detected at the battery powered device, a second device proximity of the second computing device to the battery powered device;

determine, based on the third device audio signal as detected at the battery powered device, a third device proximity of the third computing device to the battery powered device; and

select the particular computing device from among at least the second computing device and the third computing device based on the second device proximity and the third device proximity.

3. The battery powered device of claim 2 , wherein in determining, based on the second device audio signal as detected at the battery powered device, the second device proximity of the second computing device to the battery powered device, one or more of the processors are to:

determine the second device audio signal based on a second device audio signal strength of the second device audio signal as detected at the battery powered device.

4. The battery powered device of claim 3 , wherein in determining, based on the third device audio signal as detected at the battery powered device, the third device proximity of the third computing device to the battery powered device, one or more of the processors are to:

determine the third device audio signal based on a third device audio signal strength of the third device audio signal as detected at the battery powered device.

5. The battery powered device of claim 1 , wherein the second device audio signal has a second device emission frequency, and wherein the third device audio signal has a third device emission frequency.

6. The battery powered device of claim 5 , wherein the second device emission frequency differs from the third device emission frequency.

7. The battery powered device of claim 1 , wherein in causing the particular computing device to provide the audible output, one or more of the processors are to:

cause the particular computing device to play music as the audible output.

8. The battery powered device of claim 1 , wherein the request further causes a fourth computing device, that is also located in the physical environment and that is also connected to the particular Wi-Fi network, to emit a fourth device audio signal via a fourth device speaker component of the fourth computing device, wherein the fourth device audio signal is also above the range of human hearing, and wherein one or more of the processors, in executing the instructions, are further to:

detect, at the battery powered device and via one or more of the microphones of the battery powered device, the fourth device audio signal;

wherein selecting the particular computing device is further based on the detection of the fourth device audio signal, and is from among at least the second computing device, the third computing device, and the fourth computing device.

9. The battery powered device of claim 8 , wherein the second device audio signal has a second device emission frequency, wherein the third device audio signal has a third device emission frequency, and wherein the fourth device audio signal has a fourth device emission frequency.

10. The battery powered device of claim 1 , wherein in transmitting the request, one or more of the processors are to:

transmit a second device request that causes the second computing device to emit the second device audio signal, and

transmit a third device request that causes the third computing device to emit the third device audio signal.

11. The battery powered device of claim 10 , wherein the second device request specifies one or more audio characteristics of the second device audio signal and wherein the third device request specifies one or more audio characteristics of the third device audio signal.

12. The battery powered device of claim 11 , wherein the one or more audio characteristics of the second device audio signal include a second device emission frequency for the second device audio signal, and wherein the one or more audio characteristics of the third device audio signal include a third device emission frequency for the third device audio signal.

13. The battery powered device of claim 12 , wherein the second device emission frequency differs from the third device emission frequency.

14. The battery powered device of claim 1 , wherein one or more of the processors, in executing the instructions, are further to:

determine that the second computing device is eligible for selection.

15. The battery powered device of claim 14 , wherein one or more of the processors, in executing the instructions, are further to:

determine that the third computing device is eligible for selection.

16. The battery powered device of claim 15 , wherein one or more of the processors, in executing the instructions, are further to:

determine that a fourth computing device connected to the particular Wi-Fi network is not eligible for selection.

17. A battery powered device comprising:

one or more microphones,

one or more Wi-Fi network interfaces connected to a particular Wi-Fi network;

one or more processors; and

memory storing instructions that, when executed, cause one or more of the processors to:

detect actuation of a button of the battery powered device; and

in response to detecting the actuation of the button:

transmit, by the battery powered device and over the particular Wi-Fi network:

a second device request that causes a second computing device, that is located in a physical environment with the battery powered device and that is also connected to the particular Wi-Fi network, to emit a second device audio signal via a second device speaker component of the second computing device, and

a third device request that causes a third computing device, that is also located in the physical environment and that is also connected to the particular Wi-Fi network, to emit a third device audio signal via a third device speaker component of the third computing device,

 wherein the second device audio signal and the third device audio signal are each above a range of human hearing; and

subsequent to transmitting the second device request and the third device request:

acoustically detect, at the battery powered device and via one or more of the microphones of the battery powered device, the second device audio signal emitted by the second computing device and the third device audio signal emitted by the third computing device;

select, based on the second device audio signal as detected at the battery powered device and the third device audio signal as detected at the battery powered device, a particular computing device from among at least the second computing device and the third computing device; and

in response to selecting the particular computing device:

cause the particular computing device to provide audible output.

18. The battery powered device of claim 17 , wherein the second device audio signal has a second device emission frequency, wherein the third device audio signal has a third device emission frequency, and wherein the second device emission frequency differs from the third device emission frequency.

19. The battery powered device of claim 17 , wherein one or more of the processors, in executing the instructions, are further to:

in response to detecting the actuation of the button of the battery powered device:

transmit, by the battery powered device and over the particular Wi-Fi network, a fourth device request that causes a fourth computing device, that is also located in the physical environment and that is also connected to the particular Wi-Fi network, to emit a fourth device audio signal via a fourth device speaker component of the fourth computing device, wherein the fourth device audio signal is also above the range of human hearing.

20. The battery powered device of claim 19 , wherein one or more of the processors, in executing the instructions, are further to:

subsequent to transmitting the fourth device request:

detect, at the battery powered device and via one or more of the microphones of the battery powered device, the fourth device audio signal;

wherein selecting the particular computing device is further based on the fourth device audio signal as detected at the battery powered device, and is from among at least the second computing device, the third computing device, and the fourth computing device.

21. The battery powered device of claim 17 , wherein the second device request specifies one or more audio characteristics of the second device audio signal, and wherein the third device request specifies one or more audio characteristics of the third device audio signal.

22. The battery powered device of claim 21 , wherein the one or more audio characteristics of the second device audio signal include a second device emission frequency for the second device audio signal, wherein the one or more audio characteristics of the third device audio signal include a third device emission frequency for the third device audio signal, and wherein the second device emission frequency differs from the third device emission frequency.

23. The battery powered device of claim 21 , wherein one or more of the processors, in executing the instructions, are further to:

determine that the second computing device is eligible for selection; and

determine that the third computing device is eligible for selection.

24. The battery powered device of claim 23 , wherein one or more of the processors, in executing the instructions, are further to:

determine that a fourth computing device connected to the particular Wi-Fi network is not eligible for selection.

25. The battery powered device of claim 17 , wherein one or more of the processors, in executing the instructions, are further to:

determine that the second computing device is eligible for selection;

determine that the third computing device is eligible for selection; and

determine that a fourth computing device connected to the particular Wi-Fi network is not eligible for selection.

26. A method implemented by one or more processors of a first computing device connected to a particular Wi-Fi network, the method comprising:

detecting actuation of a button of the first computing device; and

in response to detecting the actuation of the button:

transmitting, by the first computing device and over the particular Wi-Fi network:

a second device request that causes a second computing device, that is located in a physical environment with the first computing device and that is also connected to the particular Wi-Fi network, to emit a second device audio signal via a second device speaker component of the second computing device, and

a third device request that causes a third computing device, that is also located in the physical environment and that is also connected to the particular Wi-Fi network, to emit a third device audio signal via a third device speaker component of the third computing device,

wherein the second device audio signal and the third device audio signal are each above a range of human hearing; and

subsequent to transmitting the second device request and the third device request:

acoustically detecting, at the first computing device and via one or more microphones of the first computing device, the second device audio signal emitted by the second computing device and the third device audio signal emitted by the third computing device;

selecting, based on the second device audio signal as detected at the first computing device and the third device audio signal as detected at the first computing device, a particular computing device from among at least the second computing device and the third computing device; and

in response to selecting the particular computing device:

cause the particular computing device to provide audible output.

27. The method of claim 26 ,

wherein the second device request specifies one or more audio characteristics of the second device audio signal,

wherein the third device request specifies one or more audio characteristics of the third device audio signal,

wherein the one or more audio characteristics of the second device audio signal include a second device emission frequency for the second device audio signal,

wherein the one or more audio characteristics of the third device audio signal include a third device emission frequency for the third device audio signal, and

wherein the second device emission frequency differs from the third device emission frequency.

28. The method of claim 26 , further comprising

determining that the second computing device is eligible for selection;

determining that the third computing device is eligible for selection; and

determining that a fourth computing device connected to the particular Wi-Fi network is not eligible for selection.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2021
From: LEONG, JIAN WEI
To: GOOGLE INC.
Reel/Frame 057531/0884 →
CHANGE OF NAME Recorded Sep 20, 2021
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 057544/0239 →
Continuity (4)
Continuation 17201808 · Mar 15, 2021
Continuation 16409389 · May 10, 2019
Continuation 15355336 · Nov 18, 2016
Related Publication 20210366487A1 · Nov 25, 2021
Cited By (2)
US 12,315,512 US 12,664,969