Granted Patent B2

US 10,783,883 · App. 15/801,307 · Granted Sep 22, 2020

Inventors: Kenneth Mixter (Los Altos Hills, CA); Tomer Shekel (San Francisco, CA); Tuan Anh Nguyen (Mountain View, CA)

Assignee: GOOGLE LLC

G10L15/22G06F3/167H04L12/282H04L67/306H04N21/47217G10L2015/223G10L2015/228

Abstract

Claims (109)

1. A method, comprising:

at a first electronic device with one or more microphones, a speaker, one or more processors, and memory storing one or more programs for execution by the one or more processors, the first electronic device being a member of a local group of connected electronic devices communicatively coupled to a server-implemented common network service:

receiving a first voice command including a request for a first operation;

determining a first target device for the first operation from among the local group of connected electronic devices based on content of the first voice command;

establishing a focus session with respect to the first target device, wherein establishing a focus session with respect to the first target device includes assigning the first target device as an in-focus device for performing the first operation;

in accordance with the assigning of the first target device as the in-focus device for performing the first operation, causing the first operation to be performed by the first target device via operation of the server-implemented common network service;

during pendency of the focus session with respect to the first target device:

receiving a second voice command including a request for a second operation;

determining that the second voice command does not include an explicit designation of a second target device;

determining that the second operation can be performed by the first target device;

determining whether the second voice command satisfies one or more focus session maintenance criteria; and

in accordance with (i) a determination that the second voice command satisfies the focus session maintenance criteria, (ii) the determination that the second voice command does not include an explicit designation of a second target device, and (iii) the determination that the second operation can be performed by the first target device, maintaining the focus session with respect to the first target device, including:

assigning the first target device as the in-focus device for performing the second operation; and

in accordance with the assigning of the first target device as the in-focus device for performing the second operation, causing the second operation to be performed by the first target device via operation of the server-implemented common network service.

2. The method of claim 1 , wherein determining a first target device for the first operation from among the local group of connected electronic devices comprises:

obtaining an explicit designation of the first target device from the first voice command.

3. The method of claim 1 , wherein determining a first target device for the first operation from among the local group of connected electronic devices comprises:

determining that the first voice command does not include an explicit designation of the first target device;

determining that the first operation can be performed by a second electronic device among the local group of connected electronic devices; and

selecting the second electronic device as the first target device.

4. The method of claim 1 , further comprising:

in accordance with a determination that the second voice command satisfies focus session maintenance criteria, extending the focus session with respect to the first target device.

5. The method of claim 1 , wherein establishing the focus session with respect to the first target device comprises:

storing a timestamp of the first voice command; and

storing an identifier of the first target device.

6. The method of claim 1 , further comprising:

receiving a third voice command including a request for a third operation and an explicit designation of a third target device among the local group of connected electronic devices;

ending the focus session with respect to the first target device;

establishing a focus session with respect to the third target device; and

causing the third operation to be performed by the third target device via operation of the server-implemented common network service.

7. The method of claim 1 , wherein the first target device is the first electronic device; further comprising:

receiving a fourth voice command including a request for a fourth operation and an explicit designation of a fourth target device among the local group of connected electronic devices, wherein the fourth target device is a third electronic device among the local group of connected electronic devices, the third electronic device different from the first electronic device;

maintaining the focus session with respect to the first target device;

causing the fourth operation to be performed by the fourth target device via operation of the server-implemented common network service.

8. The method of claim 7 , wherein:

the second voice command is received after the fourth operation is caused to be performed by the fourth target device;

the first operation is a media playback operation; and

the second operation is a media stoppage operation; and

the method further comprising:

receiving a fifth voice command including a request for a fifth operation and an explicit designation of a fifth target device among the local group of connected electronic devices, wherein the fifth target device is the third electronic device;

ending the focus session with respect to the first target device;

establishing a focus session with respect to the fifth target device; and

causing the fifth operation to be performed by the fifth target device via operation of the server-implemented common network service.

9. An electronic device, comprising:

one or more microphones;

a speaker;

one or more processors; and

memory storing one or more programs to be executed by the one or more processors, wherein the electronic device is a member of a local group of connected electronic devices communicatively coupled to a server-implemented common network service, and the one or more programs comprising instructions for performing:

receiving a first voice command including a request for a first operation;

determining a first target device for the first operation from among a local group of connected electronic devices based on content of the first voice command;

establishing a focus session with respect to the first target device, wherein establishing a focus session with respect to the first target device includes assigning the first target device as an in-focus device for performing the first operation;

in accordance with the assigning of the first target device as the in-focus device for performing the first operation, causing the first operation to be performed by the first target device via operation of the server-implemented a common network service;

during pendancy of the focus session with respect to the first target device:

receiving a second voice command including a request for a second operation;

determining that the second voice command does not include an explicit designation of a second target device;

determining that the second operation can be performed by the first target device;

determining whether the second voice command satisfies one or more focus session maintenance criteria; and

in accordance with (i) a determination that the second voice command satisfies the focus session maintenance criteria, (ii) the determination that the second voice command does not include an explicit designation of a second target device, and (iii) the determination that the second operation can be performed by the first target device, maintaining the focus session with respect to the first target device, including:

assigning the first target device as the in-focus device for performing the second operation; and

in accordance with the assigning of the first target device as the in-focus device for performing the second operation, causing the second operation to be performed by the first target device via operation of the server-implemented common network service.

10. The electronic device of claim 9 , further comprising:

receiving a fifth voice command including a predefined operation termination request;

in accordance with receiving the fifth voice command:

causing the first operation to cease to be performed by the first target device; and

ending the focus session with respect to the first target device.

11. The electronic device of claim 9 , wherein:

the first operation is a media playback operation; and

the second operation is one of: a media stoppage operation, a media rewind operation, a media fast forward operation, a volume up operation, and a volume down operation.

12. The electronic device of claim 9 , wherein:

the first operation is a device state change operation to a first state of a plurality of device states; and

the second operation is a device state change operation to a second state of the plurality of device states.

13. The electronic device of claim 9 , wherein:

the first operation is a magnitude change operation in a first direction in a magnitude scale; and

the second operation is a magnitude change operation in a second direction, opposite of the first direction, in the magnitude scale.

14. The electronic device of claim 9 , further comprising an array of one or more LEDs; and

the one or more programs further comprising instructions for:

indicating a status of the focus session by illuminating one or more of the LEDs in the array of LEDs.

15. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by a first electronic device with one or more microphones, a speaker, and one or more processors, the electronic device being a member of a local group of connected electronic devices communicatively coupled to a server-implemented common network service, cause the first electronic device to perform operations of a method including:

receiving a first voice command including a request for a first operation;

determining a first target device for the first operation from among a local group of connected electronic devices based on content of the first voice command;

establishing a focus session with respect to the first target device, wherein establishing a focus session with respect to the first target device includes assigning the first target device as an in-focus device for performing the first operation;

in accordance with the assigning of the first target device as the in-focus device for performing the first operation, causing the first operation to be performed by the first target device via operation of the server-implemented a common network service;

during pendancy of the focus session with respect to the first target device:

receiving a second voice command including a request for a second operation;

determining that the second voice command does not include an explicit designation of a second target device;

determining that the second operation can be performed by the first target device;

determining whether the second voice command satisfies one or more focus session maintenance criteria; and

in accordance with (i) a determination that the second voice command satisfies the focus session maintenance criteria, (ii) the determination that the second voice command does not include an explicit designation of a second target device, and (iii) the determination that the second operation can be performed by the first target device, maintaining the focus session with respect to the first target device, including:

assigning the first target device as the in-focus device for performing the second operation; and

in accordance with the assigning of the first target device as the in-focus device for performing the second operation, causing the second operation to be performed by the first target device via operation of the server-implemented common network service.

16. The computer-readable storage medium of claim 15 , wherein:

the focus session maintenance criteria include a criterion that the second voice command is received by the first electronic device within a first predefined time interval with respect to receiving the first voice command or with a second predefined time interval with respect to receiving the first voice command, the second predefined time interval succeeding the first predefined time interval; and

determining whether the second voice command satisfies the one or more focus session maintenance criteria comprises determining whether the second voice command is received within any of the first predefined time interval or the predefined second time interval.

17. The computer-readable storage medium of claim 16 , further comprising: in accordance with a determination that the second voice command is received within the first predefined time interval, selecting the first target device as a target device for the second voice command.

18. The computer-readable storage medium of claim 16 , further comprising: in accordance with a determination that the second voice command is received within the second predefined time interval, outputting a request to confirm the first target device as a target device for the second voice command; and

in accordance with a positive confirmation of the first target device in response to request to confirm, selecting the first target device as a target device for the second voice command.

19. The computer-readable storage medium of claim 15 , wherein the first target device is the first electronic device; further comprising:

receiving a fourth voice command including a request for a fourth operation and an explicit designation of a fourth target device among the local group of connected electronic devices, wherein the fourth target device is a third electronic device member of the local group of connected electronic devices, the third electronic device different from the first electronic device;

maintaining the focus session with respect to the first target device;

causing the fourth operation to be performed by the fourth target device via operation of the server-implemented common network service.

20. The computer-readable storage medium of claim 19 , wherein:

the second voice command is received after the fourth operation is caused to be performed by the fourth target device;

the first operation is a media playback operation; and

the second operation is a media stoppage operation; and

the method further comprising:

receiving a fifth voice command including a request for a fifth operation and an explicit designation of a fifth target device among the local group of connected electronic devices, wherein the fifth target device is the third electronic device;

ending the focus session with respect to the first target device;

establishing a focus session with respect to the fifth target device; and

causing the fifth operation to be performed by the fifth target device via operation of the server-implemented common network service.

Assignments (1)

Continuity (2)

Cited By (60)

US 12,197,699 US 12,197,712 US 12,197,817 US 12,200,297 US 12,204,932 US 12,210,730 US 12,211,502 US 12,216,894 US 12,219,314 US 12,223,228 US 12,223,282 US 12,236,952 US 12,242,702 US 12,244,755 US 12,254,887 US 12,256,128 US 12,260,059 US 12,260,234 US 12,262,089 US 12,265,364 US 12,265,696 US 12,267,622 US 12,277,954 US 12,284,417 US 12,293,763 US 12,301,635 US 12,301,979 US 12,302,035 US 12,333,404 US 12,348,663 US 12,361,943 US 12,362,959 US 12,367,879 US 12,368,946 US 12,379,827 US 12,381,924 US 12,386,434 US 12,386,491 US 12,422,976 US 12,431,128 US 12,444,418 US 12,449,961 US 12,452,389 US 12,477,470 US 12,504,944 US 12,526,361 US 12,537,000 US 12,541,338 US 12,556,890 US 12,563,299 US 12,578,837 US 12,608,171 US 12,613,730 US 12,615,491 US 12,619,452 US 12,620,155 US 12,664,984 US 12,732,665 US 12,737,049 US 12,748,568