IP Library Granted Patent US 11,908,479
Granted Patent B2
US 11,908,479 · App. 17/856,536 · Granted Feb 20, 2024

Virtual assistant identification of nearby computing devices

Inventor: Jian Wei Leong (San Francisco, CA)
Assignee: GOOGLE LLC
G10L15/30G06F3/165G10L15/22G10L2015/221G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,908,479
App. No.
17/856,536
Granted
Feb 20, 2024
Kind
B2
Abstract

In one example, a method includes method comprising: receiving audio data generated by a microphone of a current computing device; identifying, based on the audio data, one or more computing devices that each emitted a respective audio signal in response to speech reception being activated at the current computing device; and selecting either the current computing device or a particular computing device from the identified one or more computing devices to satisfy a spoken utterance determined based on the audio data.

Claims (75)

1. A battery powered device comprising:

one or more microphones,

one or more Wi-Fi network interfaces;

one or more processors; and

memory storing instructions that, when executed, cause one or more of the processors to:

recognize speaking of a predetermined phrase in audio data received via one or more of the microphones;

in response to recognizing the speaking of the predetermined phrase:

transmit a request that:

causes a second computing device, that is located in a physical environment with the battery powered device, to emit a second device audio signal via a second device speaker component of the second computing device, and

causes a third computing device, that is also located in the physical environment, to emit a third device audio signal via a third device speaker component of the third computing device,

 wherein the second device audio signal and the third device audio signal are each above a range of human hearing;

detect, at the battery powered device and via one or more of the microphones of the battery powered device, the second device audio signal and the third device audio signal;

determine, based on at least (i) the second device audio signal as detected at the battery powered device and (ii) the third device audio signal as detected at the battery powered device, that the second computing device is most proximal to the battery powered device; and

in response to determining that the second computing device is most proximal to the battery powered device:

cause the second computing device to provide audible output.

2. The battery powered device of claim 1 , wherein in determining, based on at least (i) the second device audio signal as detected at the battery powered device and (ii) the third device audio signal as detected at the battery powered device, that the second computing device is most proximal to the battery powered device, one or more of the processors are to:

determine that the second computing device is most proximal to the battery powered device based on a second device audio signal strength of the second device audio signal as detected at the battery powered device and a third device audio signal strength of the third device audio signal as detected at the battery powered device.

3. The battery powered device of claim 1 , wherein the second device audio signal has a second device emission frequency, and wherein the third device audio signal has a third device emission frequency.

4. The battery powered device of claim 3 , wherein the second device emission frequency differs from the third device emission frequency.

5. The battery powered device of claim 4 , wherein in causing the particular computing device to provide the audible output, one or more of the processors are to:

cause the particular computing device to play music as the audible output.

6. The battery powered device of claim 1 , wherein the request further causes a fourth computing device, that is also located in the physical environment, to emit a fourth device audio signal via a fourth device speaker component of the fourth computing device, wherein the fourth device audio signal is also above the range of human hearing, and wherein one or more of the processors, in executing the instructions, are further to:

detect, at the battery powered device and via one or more of the microphones of the battery powered device, the fourth device audio signal;

wherein determining that the second computing device is most proximal to the battery powered device is further based on (iii) the fourth device audio signal as detected at the battery powered device.

7. The battery powered device of claim 1 , wherein in transmitting the request, one or more of the processors are to:

transmit a second device request that causes the second computing device to emit the second device audio signal, and

transmit a third device request that causes the third computing device to emit the third device audio signal.

8. The battery powered device of claim 7 , wherein the second device request specifies one or more audio characteristics of the second device audio signal and wherein the third device request specifies one or more audio characteristics of the third device audio signal.

9. The battery powered device of claim 8 , wherein the one or more audio characteristics of the second device audio signal include a second device emission frequency for the second device audio signal, and wherein the one or more audio characteristics of the third device audio signal include a third device emission frequency for the third device audio signal.

10. The battery powered device of claim 9 , wherein the second device emission frequency differs from the third device emission frequency.

11. The battery powered device of claim 1 , wherein one or more of the processors, in executing the instructions, are further to:

determine that the second computing device is eligible for selection.

12. The battery powered device of claim 11 , wherein one or more of the processors, in executing the instructions, are further to:

determine that the third computing device is eligible for selection.

13. The battery powered device of claim 12 , wherein one or more of the processors, in executing the instructions, are further to:

determine that a fourth computing device is not eligible for selection.

14. A battery powered device comprising:

one or more microphones,

one or more Wi-Fi network interfaces;

one or more processors; and

memory storing instructions that, when executed, cause one or more of the processors to:

recognize speaking of a predetermined phrase in audio data received via one or more of the microphones; and

in response to recognizing the speaking of the predetermined phrase:

transmit, by the battery powered device:

a second device request that causes a second computing device, that is located in a physical environment with the battery powered device, to emit a second device audio signal via a second device speaker component of the second computing device, and

a third device request that causes a third computing device, that is also located in the physical environment, to emit a third device audio signal via a third device speaker component of the third computing device,

 wherein the second device audio signal and the third device audio signal are each above a range of human hearing; and

subsequent to transmitting the second device request and the third device request:

acoustically detect, at the battery powered device and via one or more of the microphones of the battery powered device, the second device audio signal emitted by the second computing device and the third device audio signal emitted by the third computing device;

determine, based on at least (i) the second device audio signal as detected at the battery powered device and (ii) the third device audio signal as detected at the battery powered device, that the second computing device is most proximal to the battery powered device; and

in response to determining that the second computing device is most proximal to the battery powered device:

cause the second computing device to provide audible output.

15. The battery powered device of claim 14 , wherein the second device audio signal has a second device emission frequency, wherein the third device audio signal has a third device emission frequency, and wherein the second device emission frequency differs from the third device emission frequency.

16. The battery powered device of claim 14 , wherein the second device request specifies one or more audio characteristics of the second device audio signal, and wherein the third device request specifies one or more audio characteristics of the third device audio signal.

17. The battery powered device of claim 16 , wherein the one or more audio characteristics of the second device audio signal include a second device emission frequency for the second device audio signal, wherein the one or more audio characteristics of the third device audio signal include a third device emission frequency for the third device audio signal, and wherein the second device emission frequency differs from the third device emission frequency.

18. The battery powered device of claim 17 , wherein one or more of the processors, in executing the instructions, are further to:

determine that the second computing device is eligible for selection; and

determine that the third computing device is eligible for selection.

19. The battery powered device of claim 18 , wherein one or more of the processors, in executing the instructions, are further to:

determine that a fourth computing device is not eligible for selection.

20. The battery powered device of claim 14 , wherein one or more of the processors, in executing the instructions, are further to:

determine that the second computing device is eligible for selection;

determine that the third computing device is eligible for selection; and

determine that a fourth computing device is not eligible for selection.

21. A method implemented by one or more processors of a first computing device, the method comprising:

recognizing speaking of a predetermined phrase in audio data received via one or more microphones of the first computing device;

in response to recognizing the speaking of the predetermined phrase:

transmitting a request that:

causes a second computing device, that is located in a physical environment with the first computing device, to emit a second device audio signal via a second device speaker component of the second computing device, and

causes a third computing device, that is also located in the physical environment, to emit a third device audio signal via a third device speaker component of the third computing device,

wherein the second device audio signal and the third device audio signal are each above a range of human hearing;

detecting, via one or more of the microphones of the battery powered device, the second device audio signal and the third device audio signal;

determining, based on at least (i) the second device audio signal as detected via one or more of the microphones and (ii) the third device audio signal as detected via one or more of the microphones, that the second computing device is most proximal to the first computing device; and

in response to determining that the second computing device is most proximal to the first computing device:

cause the second computing device to provide audible output.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 6, 2022
From: LEONG, JIAN WEI
To: GOOGLE INC.
Reel/Frame 060412/0831 →
CHANGE OF NAME Recorded Jul 6, 2022
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 060613/0001 →
Continuity (7)
Continuation 17688493 · Mar 7, 2022
Continuation 17506323 · Oct 20, 2021
Continuation 17397604 · Aug 9, 2021
Continuation 17201808 · Mar 15, 2021
Continuation 16409389 · May 10, 2019
Continuation 15355336 · Nov 18, 2016
Related Publication 20220335948A1 · Oct 20, 2022