IP Library › Granted Patent US 12,112,096
Granted Patent B2
US 12,112,096 · App. 17/130,807 · Granted Oct 8, 2024

Audio command interface for a multimedia device

Inventor: Frank Llewellyn Maker, III (Livermore, CA)
Assignee: Roku, Inc.
G06F3/167H04N21/42203H04N21/42222H04N21/4394H04N21/6581H04N21/64322
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,112,096
App. No.
17/130,807
Granted
Oct 8, 2024
Kind
B2
Abstract

System, method, and computer product embodiments for processing audio commands are described. A multimedia device receives a digitized audio sequence from a control device. The digitized audio sequence is associated with a display command for controlling a display device. Then, the digitized audio sequence is converted into an audio signature that corresponds to the digitized audio sequence. The multimedia device sends the audio signature to a platform server configured to use the audio signature to process the display command. After, the multimedia device receives content information from the platform server resulting from processing the display command. Then, the multimedia device causes the display device to provide media content related to the content information.

Claims (50)

1. A method, comprising:

receiving, at a control device, an indication to activate an audio sensor;

activating, responsive to receiving the indication, the audio sensor;

detecting, by the audio sensor, a sound containing an audio command, wherein the audio command corresponds to a display command configured to control one of a multimedia device or a display device connected to the multimedia device, wherein the sound is detected from the multimedia device, and wherein the sound is associated with content currently displayed by the multimedia device;

digitizing, by an audio processing component of the control device, the audio command to form a digitized audio sequence; and

transmitting the digitized audio sequence to the multimedia device.

2. The method of claim 1 , wherein the digitized audio sequence is configured to instruct the multimedia device to determine the display command to be transmitted to the display device.

3. The method of claim 1 , wherein the audio command has a frequency below 20 kHz.

4. The method of claim 1 , wherein the audio command has a frequency at or above 20 kHz.

5. The method of claim 1 , wherein the indication is transmitted by an accelerometer of the control device.

6. The method of claim 1 , wherein the indication is based on detecting a mobile device within proximity to the control device.

7. The method of claim 1 , wherein the indication is a network packet received via a wake-on wireless network driver of the control device.

8. The method of claim 1 , wherein the control device is integrated as a component of the multimedia device, and wherein the control device transmits the digitized audio sequence to another component of the multimedia device.

9. The method of claim 1 , wherein detecting the sound containing the audio command further comprises:

detecting a certain start sequence of frequencies at a starting point of the sound; and

identifying the audio command in the sound based on the certain start sequence of frequencies.

10. The method of claim 1 , further comprising:

detecting an end point of the sound, wherein digitizing the audio command is based on detecting the end point of the sound.

11. The method of claim 10 , wherein detecting the end point of the sound further comprises:

detecting a certain end sequence of frequencies at the end point of the sound.

12. The method of claim 10 , wherein detecting the end point of the sound further comprises:

determining a predetermined period of time for the audio command.

13. The method of claim 12 , wherein the predetermined period of time is specified by a certain start sequence of frequencies at a start of the sound.

14. The method of claim 1 , wherein the display command is associated with requesting one of the multimedia device or the display device to provide additional content associated with the content currently displayed by the multimedia device.

15. A control device, comprising:

an audio sensor;

a wireless network interface; and

at least one processor processor configured to:

receive an indication to activate the audio sensor;

activate, responsive to receiving the indication, the audio sensor;

detect, by the audio sensor, a sound containing an audio command, wherein the audio command corresponds to a display command configured to control one of a multimedia device or a display device connected to the multimedia device, wherein the sound is detected from the multimedia device, and wherein the sound is associated with content currently displayed by the multimedia device;

digitize the audio command to form a digitized audio sequence; and

transmit, via the wireless network interface, the digitized audio sequence to the multimedia device.

16. The control device of claim 15 , wherein the digitized audio sequence is configured to instruct the multimedia device to determine the display command to be transmitted to the display device.

17. The control device of claim 15 , wherein the indication is based on detecting a mobile device within proximity to the control device.

18. The control device of claim 15 , wherein the indication is a network packet received via the wireless network interface.

19. A non-transitory computer-readable medium having instructions stored thereon that, when executed by a control device, cause the at least one computing device to perform operations comprising:

receiving, at the control device, an indication to activate an audio sensor;

activating, responsive to receiving the indication, the audio sensor;

detecting, by the audio sensor, a sound containing an audio command, wherein the audio command corresponds to a display command configured to control one of a multimedia device or a display device connected to the multimedia device, wherein the sound is detected from the multimedia device, and wherein the sound is associated with content currently displayed by the multimedia device;

digitizing, by an audio processing component of the control device, the audio command to form a digitized audio sequence; and

transmitting the digitized audio sequence to the multimedia device.

20. The non-transitory computer-readable medium of claim 19 , wherein the digitized audio sequence is configured to instruct the multimedia device to determine the display command to be transmitted to the display device.

21. The non-transitory computer-readable medium of claim 19 , wherein the indication is based on detecting a mobile device within proximity to the control device.

22. The non-transitory computer-readable medium of claim 19 , wherein the indication is a network packet received via the wireless network interface.

23. The non-transitory computer-readable medium of claim 19 , wherein detecting the sound containing the audio command further comprises:

detecting a certain start sequence of frequencies at a starting point of the sound; and

identifying the audio command in the sound based on the certain start sequence of frequencies.

24. The non-transitory computer-readable medium of claim 19 , the operations further comprising:

detecting an end point of the sound, wherein digitizing the audio command is based on detecting the end point of the sound.

Assignments (2)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2022
From: MAKER, III, FRANK LLEWELLYN
To: ROKU, INC.
Reel/Frame 059750/0029 →
Continuity (4)
Continuation 16103487 · Aug 14, 2018
Continuation 14857876 · Sep 18, 2015
Provisional Application 62212423 · Aug 31, 2015
Related Publication 20210141598A1 · May 13, 2021