IP Library › Granted Patent US 10,560,737
Granted Patent B2
US 10,560,737 · App. 15/919,096 · Granted Feb 11, 2020

Voice-controlled multimedia device

Inventors: Mark Lawrence (Bainbridge Island, WA); Balsa Laban (Mercer Island, WA); Anna Chen Santos (Mountain View, CA); Joseph Pedro Tavares (Kenmore, WA); Miroslav Ristic (Santa Clara, CA); Valere Joseph Vanderschaegen (Kalama, WA); Trausti Thor Kristjansson (San Jose, CA); Srivatsan Kandadai (San Jose, CA); Donald L. Cantrell, Jr. (Oakland, CA)
Assignee: Amazon Technologies, Inc.
H04N21/42203G10L15/22H04N21/4126H04N21/4222G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,560,737
App. No.
15/919,096
Granted
Feb 11, 2020
Kind
B2
Abstract

A computer-implemented method includes receiving, at a microphone of a voice-controlled device, a speech input from a user and determining, by the voice-controlled device, that a power state of an AV display device that is coupled to the voice-controlled device is an ON or OFF state. Based on the user intent determined from the speech input and the power state of the AV display, the voice-controlled device sends data to the AV display device to switch the AV display device ON or OFF. The method can further include receiving, by the voice-controlled device, content from a content source location and sending the content to the AV display device via an AV port.

Claims (30)

1. A computer-implemented method, comprising:

receiving, at a microphone of a voice-controlled device having an internal speaker, a first speech input from a user, wherein the voice-controlled device is operatively connected to a first audio video (AV) input port of an AV display device, the first speech input including a wakeword;

determining, by the voice-controlled device, that a power state of the AV display device indicates that the AV display device is an ON state;

determining, by the voice-controlled device, an active AV input port of the AV display device to be an AV input other than the first AV input port;

sending data from the voice-controlled device to the AV display device to mute the AV display device;

receiving, at the microphone of the voice-controlled device, a second speech input, the second speech input including a user command to play content;

sending, by the voice-controlled device, data associated with at least the user command and the power state to a remote server computer;

receiving, by the voice-controlled device, response data from the remote server computer, wherein the response data comprises:

an indication that requested content includes video content;

instructions to set the active AV input port of the AV display device to the first AV port; and

a content source location identifier indicating a content source location for the video content;

based on the instructions to set the active AV input port of the AV display device to the first AV port, sending data from the voice-controlled device to the AV display device to set the active AV input port of the AV display device to the first AV port; and

sending data from the voice-controlled device to the AV display device to unmute the AV display device.

2. The computer-implemented method of claim 1 , further comprising:

receiving, by the voice-controlled device, content from the content source location; and

sending the content to the AV display device via the first AV port.

3. The computer-implemented method of claim 1 , wherein sending data from the voice-controlled device to the AV display device to set the active AV input port of the AV display device to the first AV port comprises sending an IR signal from the voice-controlled device to an IR receiver that is operably connected to the AV display device.

4. The computer-implemented method of claim 1 , wherein sending data from the voice-controlled device to the AV display device to set the active AV input port of the AV display device to the first AV port comprises sending HDMI data over an HDMI connection between the voice-controlled device and the AV display device.

5. The computer-implemented method of claim 1 , further comprising:

after receiving the indication that requested content includes video content, playing a handover audio message on the internal speaker of the voice-controlled device, wherein the handover audio message indicates to the user that the video content is going to be played on the AV display device.

6. The computer-implemented method of claim 1 , wherein sending data to mute and unmute the AV display device include sending an IR signal from the voice-controlled device to an IR receiver that is operably connected to the AV display device.

7. The computer-implemented method of claim 1 , wherein the first AV port is an HDMI port and wherein sending data to mute and unmute the AV display device include sending HDMI data to the first AV port.

8. The computer-implemented method of claim 1 , wherein the first AV port comprises an HDMI port.

9. The computer-implemented method of claim 1 , wherein determining that the power state of the AV display device indicates that the AV display device is an ON state comprises:

generating, by the voice-controlled device and in response to receiving the first speech input from the user, an electrical signal representing a pseudo-random number sequence;

transmitting the electrical signal to the first AV port of the AV display device; and

detecting, by the microphone of the voice-controlled device, a microphone signal that includes ambient room noise and a pseudo-random audio signal generated by the AV display device based on the electrical signal.

10. The computer-implemented method of claim 1 , wherein determining that the power state of the AV display device indicates that the AV display device is an ON state comprises:

detecting, by the voice-controlled device, a first voltage value of a hot plug detect (HPD) signal from the first AV port of the AV display device; and

detecting, by the voice-controlled device, data associated with a High Bandwidth Digital Content Protection (HDCP) signal from the first AV port of the AV display device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2019
From: LAWRENCE, MARK; LABAN, BALSA; SANTOS, ANNA CHEN; TAVARES, JOSEPH PEDRO; RISTIC, MIROSLAV; VANDERSCHAEGEN, VALERE JOSEPH; KRISTJANSSON, TRAUSTI THOR; KANDADAI, SRIVATSAN; CANTRELL, DONALD L., JR.
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 048612/0834 →
Continuity (1)
Related Publication 20190281341A1 · Sep 12, 2019
Cited By (2)
US 12,197,815 US 12,230,270