IP Library Granted Patent US 11,024,311
Granted Patent B2
US 11,024,311 · App. 16/786,943 · Granted Jun 1, 2021

Device leadership negotiation among voice interface devices

Inventors: Kenneth Mixter (Los Altos Hills, CA); Diego Melendo Casado (Mountain View, CA); Alexander Houston Gruenstein (Mountain View, CA); Terry Tai (New York, NY); Christopher Thaddeus Hughes (Redwood City, CA); Matthew Nirvan Sharifi (Kilchberg, CH)
Assignee: GOOGLE LLC
G10L15/22G10L15/32G10L25/60G10L2015/088G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,024,311
App. No.
16/786,943
Filed
Feb 10, 2020
Granted
Jun 1, 2021
Kind
B2
Art Unit
2656
USPC
704/233
Abstract

The various implementations described herein include methods and systems for determining device leadership among voice interface devices. In one aspect, a method is performed at a first electronic device of a plurality of electronic devices, each having microphones, a speaker, processors, and memory storing programs for execution by the processors. The first device detects a voice input. It determines a device state and a relevance of the voice input. It identifies a subset of electronic devices from the plurality to which the voice input is relevant. In accordance with a determination that the subset includes the first device, the first device determines a first score of a criterion associated with the voice input and receives second scores of the criterion from other devices in the subset. In accordance with a determination that the first score is higher than the second scores, the first device responds to the detected input.

Claims (52)

1. A method performed at a first electronic device of a plurality of electronic devices, each of the plurality of electronic devices comprising one or more microphones, one or more processors, and memory storing one or more programs for execution by the one or more processors, the method comprising:

detecting a voice input from a user;

determining a first value associated with the voice input;

receiving second values associated with the voice input from other electronic devices of the plurality of electronic devices; and

in accordance with a determination that the first value is higher than the second values, responding to the detected input.

2. The method of claim 1 , further comprising:

in accordance with a determination that the first value is not higher than the second scores, forgoing responding to the detected input.

3. The method of claim 2 , wherein forgoing responding to the detected input further comprises changing a state of operation of the first electronic device.

4. The method of claim 1 , further comprising:

in accordance with a determination that the first value is not higher than the second values, identifying a criterion associated with the voice input; and

in accordance with a determination that the criterion is the most relevant to the first electronic device, responding to the detected input.

5. The method of claim 4 , further comprising:

determining a state of the first electronic device;

wherein the determination that the criterion is the most relevant to the first electronic device is based on the state of the electronic device.

6. The method of claim 4 , wherein the criterion comprises one or more of: a type of request, a command in the voice input, and a state of each electronic device of the plurality of electronic devices.

7. The method of claim 1 , further comprising:

at the first electronic device:

detecting subsequent voice inputs from the user;

pre-processing the subsequent voice inputs; and

transmitting the pre-processed voice inputs to a server system;

wherein the other electronic devices forgo the detecting, pre-processing, and transmitting.

8. The method of claim 1 , wherein responding to the detected input comprises outputting an audible and/or a visual response to the detected voice input.

9. The method of claim 1 , wherein the first electronic device further comprises a speaker, and responding to the detected input further comprises outputting an audible response.

10. A first electronic device of a plurality of electronic devices, the first electronic device comprising:

one or more microphones;

one or more processors; and

memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for:

detecting a voice input from a user;

determining a first value associated with the voice input;

receiving second values associated with the voice input from other electronic devices of the plurality of electronic devices; and

in accordance with a determination that the first value is higher than the second values, responding to the detected input.

11. The first electronic device of claim 10 , the one or more programs further comprising instructions for:

recognizing a command in the voice input; and

in accordance with a determination that a type of the command is related to the first electronic device, responding to the detected voice input.

12. The first electronic device of claim 10 , the one or more programs further comprising instructions for:

communicating to the other devices of the plurality of electronic devices to forgo responding to the detected output.

13. The first electronic device of claim 10 , wherein the instruction for detecting the voice input is performed at intervals of a predefined number of voice inputs.

14. The first electronic device of claim 10 , wherein:

the plurality of electronic devices is communicatively coupled through a local network; and

the receiving is performed through the local network.

15. The first electronic device of claim 10 , wherein the first electronic device is configured to be awakened by a plurality of affordances including a voice-based affordance; and

wherein detecting the voice input is in response to the awakening of the first electronic device.

16. A system comprising a plurality of electronic devices, each of the electronic devices including one or more microphones, one or more processors, and memory storing one or more programs for execution by the one or more processors, each of the electronic devices programmed to:

detect a voice input;

determine a first value associated with the detected voice input;

receive respective second values from other electronic devices of the plurality of electronic devices;

compare the first value and the respective second values; and

in accordance with a determination that the first value is higher than the respective second values, respond to the voice input.

17. The system of claim 16 , wherein the first value comprises a first quality score of the voice input.

18. The system of claim 17 , wherein the first quality score comprises a confidence level of detection of the voice input.

19. The system of claim 17 , wherein the first quality score comprises a signal-to-noise rating of detection of the voice input.

20. The system of claim 16 , wherein each of the respective second values is indicative of a quality of the voice input detected by a respective one of the other electronic devices.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2021
From: MIXTER, KENNETH; CASADO, DIEGO MELENDO; GRUENSTEIN, ALEXANDER HOUSTON; TAI, TERRY; HUGHES, CHRISTOPHER THADDEUS; SHARIFI, MATTHEW NIRVAN
To: GOOGLE INC.
Reel/Frame 056079/0109 →
CHANGE OF NAME Recorded Apr 29, 2021
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 056084/0855 →
Continuity (7)
Continuation 16159339 · Oct 12, 2018
Continuation 15788658 · Oct 19, 2017
Continuation 15284483 · Oct 3, 2016
Continuation In Part 15088477 · Apr 1, 2016
Continuation 14675932 · Apr 1, 2015
Provisional Application 62061830 · Oct 9, 2014
Related Publication 20200211556A1 · Jul 2, 2020
Cited By (31)
US 12,192,713 US 12,211,490 US 12,212,945 US 12,217,748 US 12,230,291 US 12,236,932 US 12,277,368 US 12,279,096 US 12,283,269 US 12,288,558 US 12,322,390 US 12,327,549 US 12,327,556 US 12,360,734 US 12,375,052 US 12,387,716 US 12,424,220 US 12,438,977 US 12,505,832 US 12,513,466 US 12,513,479 US 12,518,755 US 12,518,756 US 12,538,072 US 12,573,404 US 12,579,978 US 12,626,717 US 12,640,148 US 12,685,494 US 12,699,543 US 12,711,962