IP Library › Granted Patent US 11,521,469
Granted Patent B2
US 11,521,469 · App. 17/105,081 · Granted Dec 6, 2022

Server-provided visual output at a voice interface device

Inventors: Kenneth Mixter (Los Altos Hills, CA); Yuan Yuan (Redwood City, CA)
Assignee: Google LLC
G08B5/36G06F3/167G08B3/10G09G3/14G10L15/22H04L12/282H04L12/2825G10L2015/225
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,521,469
App. No.
17/105,081
Granted
Dec 6, 2022
Kind
B2
Abstract

A method at an electronic device with an array of indicator lights includes: obtaining first visual output instructions stored at the electronic device, where the first visual output instructions control operation of the array of indicator lights based on operating state of the electronic device; receiving a voice input; obtaining from a remote system a response to the voice input and second visual output instructions, where the second visual output instructions are provided by the remote system along with the response in accordance with a determination that the voice input satisfies one or more criteria; executing the response; and displaying visual output on the array of indicator lights in accordance with the second visual output instructions, where otherwise in absence of the second visual output instructions the electronic device displays visual output on the array of indicator lights in accordance with the first visual output instructions.

Claims (55)

1. A method, comprising:

at an electronic device with one or more microphones, a speaker, one or more processors, and memory storing one or more programs for execution by the one or more processors:

receiving from the one or more microphones a voice input;

transmitting information of the voice input to a server system;

receiving visual output instructions associated with a predefined holiday from the server system, wherein the visual output instructions are provided by the server system in accordance with a determination that the voice input satisfies one or more criteria associated with the predefined holiday; and

in response to receiving the visual output instructions, displaying visual output on an array of indicator lights in accordance with the visual output instructions associated with the predefined holiday.

2. The method of claim 1 , wherein in accordance with the one or more criteria, a date on which the voice input is received corresponds to the predefined holiday.

3. The method of claim 1 , wherein in accordance with the one or more criteria, the voice input specifies the predefined holiday and includes a request associated with the predefined holiday.

4. The method of claim 1 , wherein the electronic device includes the array of indicator lights.

5. The method of claim 1 , further comprising:

obtaining, from the server system, a response to the voice input along with the visual output instructions; and

executing the response while displaying the visual output on the array of indicator lights.

6. The method of claim 1 , wherein the visual output is displayed according to the visual output instructions in lieu of default or standardized visual output.

7. The method of claim 1 , further comprising:

controlling operation of the array of indicator lights according to first visual output instructions to indicate an operating state of the electronic device, the operating state including operating states of applications executed on the electronic device;

wherein the visual output instructions provided by the server system include second visual output instructions; and

wherein displaying visual output on an array of indicator lights further includes: in response to receiving the second visual output instructions, changing operation of the array of indicator lights to respond to the second visual output instructions instead of the first visual output instructions.

8. The method of claim 1 , further comprising:

obtaining, from the server system, audible output instructions associated with the visual output instructions; and

outputting an audible output on the speaker in accordance with the audible output instructions;

wherein the audible output instructions are supplemental to the audible output associated with a response to the voice input.

9. The method of claim 1 , wherein the voice input is associated with an on-going game session at the electronic device.

10. The method of claim 1 , wherein the electronic device is one of a group of communicatively coupled devices, further comprising:

performing an operation;

determining that the operation is directed to the group of devices; and

causing each of the group of devices to perform the operation and display light patterns in accordance with the visual output instructions.

11. The method of claim 1 , further comprising:

determining that the electronic device is communicatively coupled to a group of devices; and

causing each of the group of devices to display light patterns in accordance with the visual output instructions.

12. A method, comprising:

at a server system communicatively coupled to an electronic device having one or more microphones and a speaker:

receiving a voice input from the electronic device;

determining whether the voice input satisfies one or more criteria associated with a predefined holiday;

in accordance with a determination that the voice input satisfies the one or more criteria, determining visual output instructions associated with the predefined holiday; and

transmitting the visual output instructions to the electronic device, thereby enabling an array of indicator lights associated with the electronic device to display visual output in accordance with the visual output instructions associated with the predefined holiday.

13. The method of claim 12 , the voice input including a first voice input, further comprising:

obtaining a second voice input from the electronic device while operation of the array of indicator lights is being controlled by first visual output instructions based on an operating state of the electronic device, the operating state of the electronic device including operating states of applications executing thereon, wherein the first visual output instructions are stored at the electronic device and are configured to control operation of the array of indicator lights based on the operating state of the electronic device.

14. The method of claim 12 , wherein the one or more criteria includes at least one of (1) a first criterion that a date on which the voice input is received corresponds to the predefined holiday and (2) a second criterion that the voice input specifies the predefined holiday and includes a request associated with the predefined holiday.

15. The method of claim 12 , further comprising:

providing audible output instructions associated with the visual output instructions to the electronic device, wherein the electronic device is configured to output an audible output on the speaker in accordance with the audible output instructions, and the audible output instructions are supplemental to the audible output associated with a response to the voice input.

16. An electronic device, comprising:

one or more microphones;

a speaker;

one or more processors; and

memory storing one or more programs to be executed by the one or more processors, the one or more programs including instructions for performing:

receiving a voice input from the one or more microphones;

transmitting information of the voice input to a server system;

receiving visual output instructions associated with a predefined holiday from the server system, wherein the visual output instructions are provided by the server system in accordance with a determination that the voice input satisfies one or more criteria associated with the predefined holiday; and

in response to receiving the visual output instructions, displaying visual output on an array of indicator lights in accordance with the visual output instructions associated with the predefined holiday.

17. The electronic device of claim 16 , further comprising the array of indicator lights.

18. The electronic device of claim 16 , wherein the array of indicator lights comprises an array of LED lights.

19. The electronic device of claim 16 , wherein the array of indicator lights comprises full-color lights.

20. The electronic device of claim 16 , the one or more programs further comprising instructions for:

obtaining, from the server system, a response to the voice input along with the visual output instructions; and

executing the response while displaying the visual output on the array of indicator lights.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2021
From: MIXTER, KENNETH; YUAN, YUAN
To: GOOGLE LLC
Reel/Frame 054861/0591 →
Continuity (4)
Continuation 16460648 · Jul 2, 2019
Continuation 15815646 · Nov 16, 2017
Provisional Application 62424354 · Nov 18, 2016
Related Publication 20210082258A1 · Mar 18, 2021