IP Library › Granted Patent US 11,126,389
Granted Patent B2
US 11,126,389 · App. 16/828,048 · Granted Sep 21, 2021

Controlling visual indicators in an audio responsive electronic device, and capturing and providing audio using an API, by native and non-native computing devices and services

Inventors: Ali Vassigh (San Jose, CA); Soren Riise (San Jose, CA); Robert Burdick (Los Altos, CA); Kevin Cooper (San Jose, CA)
Assignee: Roku, Inc.
G06F3/14G06F3/167G10L15/22G08C2201/31G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,126,389
App. No.
16/828,048
Granted
Sep 21, 2021
Kind
B2
Abstract

Disclosed herein are embodiments for controlling visual indicators of an audio responsive electronic device. In some embodiments, an audio responsive electronic device operates by receiving audio input, and then analyzing the audio input to identify an intended target of the audio input. The intended target may be one of a plurality of electronic devices or services which are native or non-native to the audio responsive electronic device. The audio responsive electronic device transmits the audio input to the identified intended target. A reply message is received from the intended target. Then, the audio responsive electronic device controls its visual indicators using information in the reply message, to thereby provide visual feedback to a user. Also disclosed herein are embodiments for capturing and providing audio to an application according to an application programming interface of a media device.

Claims (73)

1. An audio responsive remote control, comprising:

a library stored in a data storage module;

a microphone array;

a plurality of visual indicators; and

a processor configured to:

receive an audio input by the microphone array;

indicate, based on the audio input and the library, that the audio input was received by the microphone array;

analyze the audio input to identify an intended target device of the audio input, wherein the intended target device is identified from a plurality of target devices and wherein the plurality of target devices includes at least one target device that is native to the audio responsive remote control and at least one target device that is non-native to the audio responsive remote control;

transmit the audio input to the identified target device, wherein the identified target device is the at least one non-native target device;

receive, from the identified target device, a reply message;

retrieve, based on the reply message, information from the library; and

configure the plurality of visual indicators based on the information from the library.

2. The audio responsive remote control of claim 1 , wherein the reply message includes a response and the processor is further configured to:

audibly play back the response simultaneous with configuring the plurality of visual indicators.

3. The audio responsive remote control of claim 1 , wherein the microphone array comprises a first microphone and a second microphone and wherein, to receive the audio input by the microphone array, the processor is further configured to:

determine a position of a source of noise;

deactivate, based on the position of the source of noise, the first microphone of the audio responsive electronic device; and

receive, using the second microphone, the audio input.

4. The audio responsive remote control of claim 1 , wherein the library comprises a plurality of commands for controlling the plurality of visual indicators.

5. The audio responsive remote control of claim 1 , wherein the reply message is configured to indicate at least one of: an on/off setting, a brightness setting, a movement setting, and a color setting.

6. The audio responsive remote control of claim 1 , wherein the reply message includes an index and wherein in controlling the visual indicators, the processor is further configured to:

retrieve the information from the library using the index, wherein the retrieved information specifies attributes of the visual indicators; and

control the visual indicators using the retrieved information.

7. The audio responsive remote control of claim 1 , wherein the processor is further configured to:

receive a configuration setting specifying a position of a display device in relation to the microphone array; and

deactivate a microphone in the microphone array based on the configuration setting.

8. The audio responsive remote control of claim 1 , wherein the processor is further configured to:

receive a configuration setting specifying a position of a user in relation to the microphone array; and

enhance audio sensitivity of a microphone in the microphone array based on the configuration setting.

9. A method of controlling user feedback of an audio responsive remote control, comprising:

receiving an audio command by a microphone array;

configuring, based on the audio command, an audio setting of the microphone array;

receiving, subsequent to configuring the audio setting, an audio input by the microphone array;

indicating, based on the audio input and a library, that the audio input was received by the microphone array;

analyzing the audio input to identify an intended target device of the audio input, wherein the intended target device is identified from a plurality of target devices and wherein the plurality of target devices includes at least one target device that is native to the audio responsive remote control and at least one target device that is non-native to the audio responsive remote control;

transmitting the audio input to the identified target device, wherein the identified target device is the at least one non-native target device;

receiving, from the identified target device, a reply message;

retrieving, from the reply message, information from the library; and

configuring a plurality of visual indicators of the audio responsive remote control based on the information from the library.

10. The method of claim 9 , wherein the reply message includes a response, the method further comprising:

audibly playing back the response simultaneous with configuring the plurality of visual indicators.

11. The method of claim 9 , wherein the microphone array comprises a first microphone and a second microphone and wherein the configuring the audio setting of the microphone array comprises:

determining a position of a source of noise;

deactivating, based on the position of the source of noise, the first microphone; and

receiving, using the second microphone, the audio input.

12. The method of claim 9 , wherein the library comprises a plurality of commands for controlling the plurality of visual indicators.

13. The method of claim 9 , wherein the reply message is configured to indicate at least one of: an on/off setting, a brightness setting, a movement setting, and a color setting.

14. The method of claim 9 , wherein the reply message includes an index, and wherein the configuring the audio setting of the microphone array comprises:

retrieving information from the library using the index, wherein the retrieved information specifies attributes of the user feedback; and

controlling the user feedback using the retrieved information, to thereby provide the user feedback to a user.

15. The method of claim 9 , wherein configuring the audio setting of the microphone array comprises:

receiving a configuration setting specifying a position of a display device in relation to the microphone array; and

deactivating a microphone in the microphone array based on the configuration setting.

16. The method of claim 9 , wherein configuring the audio setting of the microphone array comprises:

receiving a configuration setting specifying a position of a user in relation to the microphone array; and

enhancing audio sensitivity of a microphone in the microphone array based on the configuration setting.

17. A non-transitory, tangible computer-readable medium having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations in an audio responsive remote control, the operations comprising:

receiving an audio input by a microphone array;

indicating, based on the audio input and a library stored in the audio responsive electronic device, that the audio input was received by the microphone array;

analyzing the audio input to identify an intended target device of the audio input, wherein the intended target device is identified from a plurality of target devices and wherein the plurality of target devices includes at least one target device that is native to the audio responsive remote control and at least one target device that is non-native to the audio responsive remote control;

transmitting the audio input to the identified target device, wherein the identified target device is the at least one non-native target device;

receiving, from the identified target device, a reply message;

retrieving, based on the reply message, information from the library; and

configuring a plurality of visual indicators of the audio responsive remote control based on the information from the library.

18. The non-transitory, tangible computer-readable medium of claim 17 , wherein the reply message includes a response, and the operations further comprise:

audibly playing back the response simultaneous with configuring the plurality of visual indicators.

19. The non-transitory, tangible computer-readable medium of claim 17 , wherein the microphone array comprises a first microphone and a second microphone and wherein the receiving the audio input by the microphone array comprises:

determining a position of a source of noise;

deactivating, based on the position of the source of noise, the first microphone; and

receiving, using the second microphone, the audio input.

20. The non-transitory, tangible computer-readable medium of claim 17 , the operations further comprising:

receiving a configuration setting specifying a position of a display device in relation to the microphone array; and

deactivating a microphone in the microphone array based on the configuration setting.

Assignments (2)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 13, 2022
From: VASSIGH, ALI; RIISE, SOREN; BURDICK, ROBERT; COOPER, KEVIN
To: ROKU, INC.
Reel/Frame 059899/0470 →
Continuity (2)
Continuation 15646379 · Jul 11, 2017
Related Publication 20200225896A1 · Jul 16, 2020
Cited By (4)
US 12,265,746 US 12,482,467 US 12,614,549 US 12,731,589