IP Library Granted Patent US 11,798,544
Granted Patent B2
US 11,798,544 · App. 15/670,572 · Granted Oct 24, 2023

Replying to a spoken command

Inventors: Kwan Truong (Lilburn, GA); Yibo Liu (Reading, MA); Peter L. Chu (Lexington, MA); Zhemin Tu (Austin, TX); Jesse Coleman (Manchaca, TX); Cody Schnacker (Westminster, TX); Andrew Lochbaum (Cedar Park, TX)
Assignee: Polycom, LLC
G10L15/22G06F3/167G06F21/32G10L15/30G10L17/24H04L12/282H04L12/2829H04N21/00G06F2221/2111G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,798,544
App. No.
15/670,572
Granted
Oct 24, 2023
Kind
B2
Abstract

A method includes, during a teleconference between a first audio input/output device and a second audio input/output device, receiving, at an analysis and response device, a signal indicating a spoken command, the spoken command associated with a command mode. The method further includes, in response to receiving the signal, generating, at the device, a reply message based on the spoken command, the reply message to be output to one or more devices selected based on the command mode. The one or more devices includes the first audio input/output device, the second audio input/output device, or a combination thereof.

Claims (42)

1. A method comprising:

during a teleconference between a first audio input/output device and a second audio input/output device, receiving, at an analysis and response device, a signal indicating a wake up message, the wake up message having a wake up element and a command mode element, and selecting a command mode of a plurality of command modes based on the wake up message command mode element;

during the teleconference between the first audio input/output device and the second audio input/output device, receiving, at an analysis and response device, a signal indicating a spoken command, the spoken command associated with the selected command mode of the plurality of command modes; and

in response to receiving the signal, generating, at the analysis and response device, a reply message based on the spoken command, the reply message to be output to one or more devices selected based on the selected command mode of the plurality of command modes, wherein the one or more devices include the first audio input/output device, the second audio input/output device, or a combination thereof,

wherein the plurality of command modes includes a local mode and a broadcast mode.

2. The method of claim 1 , wherein the signal indicating the spoken command is received from the first audio input/output device, and in response to the command mode corresponding to the local mode, the one or more devices include the first audio input/output device but not the second audio input/output device.

3. The method of claim 1 , wherein the analysis and response device corresponds to a bridge device configured to facilitate the teleconference, the method further comprising transmitting the reply message from the analysis and response device to the first audio input/output device.

4. The method of claim 1 , wherein the analysis and response device corresponds to the first audio input/output device.

5. The method of claim 1 , wherein the signal indicating the spoken command is received from the first audio input/output device, and in response to the command mode corresponding to the broadcast mode, the one or more devices include the first audio input/output device and the second audio input/output device.

6. The method of claim 5 , wherein in response to the command mode corresponding to the broadcast mode, the method further includes transmitting data indicating the spoken command to the second audio input/output device.

7. The method of claim 1 , wherein the spoken command corresponds to a request for information, a request to generate a meeting summary, a request to control a function of a device, or a combination thereof.

8. The method of claim 1 , wherein the analysis and response device corresponds to an intermediate device configured to facilitate the teleconference between the first audio input/output device and the second audio input/output device.

9. The method of claim 8 , wherein the signal indicating the spoken command is received from the first audio input/output device, and wherein the wake up message is received from the first audio input/output device.

10. The method of claim 8 , wherein the signal indicating the spoken command is received from the first audio input/output device as part of a first audio stream that is distinct from a second audio stream associated with the teleconference.

11. The method of claim 8 , wherein the signal indicating the spoken command is received from the first audio input/output device as part of an audio stream associated with the teleconference.

12. The method of claim 1 ,

wherein the wake up message is a spoken wake up message.

13. The method of claim 1 , further comprising performing echo cancellation at each of the one or more devices to remove or reduce the spoken command in audio signals received at the one or more devices.

14. The method of claim 1 , wherein the wake up message corresponds to an indication of a selection of a button of a plurality of buttons of a remote control device, the selection of any button of the plurality of buttons corresponding to the wake up element and the selection of the particular button of the plurality of buttons corresponding to the command mode element.

15. An apparatus comprising:

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to perform operations including:

during a communication session between a first audio input/output device and a second audio input/output device, receiving a signal indicating a wake up message, the wake up message having a wake up element and a command mode element, and selecting a command mode of a plurality of command modes based on the wake up message command mode element;

during the communication session between the first audio input/output device and the second audio input/output device, receiving a signal indicating a spoken command, the spoken command associated with the selected command mode of the plurality of command modes; and

in response to receiving the signal, generating a reply message based on the spoken command, the reply message to be output to one or more devices selected based on the selected command mode of the plurality of command modes, wherein the one or more devices include the first audio input/output device, the second audio input/output device, or a combination thereof,

wherein the plurality of command modes includes a local mode and a broadcast mode.

16. The apparatus of claim 15 , wherein the spoken command is associated with a user and wherein the operations further include:

determining, based on a profile associated with the user, whether the user is authorized to initiate the spoken command; and

in response to determining that the user is unauthorized to initiate the spoken command, the reply message indicates that the user is unauthorized.

17. The apparatus of claim 15 , wherein the operation further include:

identifying a keyword spoken during the communication session; and

transmitting an indication of the keyword to the first device, wherein the spoken command corresponds to a request to access a media content item associated with the keyword and the reply message includes the media content item.

18. The apparatus of claim 17 , wherein the operations further include identifying that the media content item is associated with the keyword based on a tag applied to the media content item.

19. A computer-readable storage device storing instructions that, when executed by a processor, cause the processor to perform operations comprising:

during a communication session between a first audio input/output device and a second audio input/output device, receiving a signal indicating a wake up message, the wake up message having a wake up element and a command mode element, and selecting a command mode of a plurality of command modes based on the wake up message command mode element;

during the communication session between the first audio input/output device and the second audio input/output device, receiving a signal indicating a spoken command, the spoken command associated with the selected command mode of the plurality of command modes; and

in response to receiving the signal, generating a reply message based on the spoken command, the reply message to be output to one or more devices selected based on the selected command mode of the plurality of command modes, wherein the one or more devices include the first audio input/output device, the second audio input/output device, or a combination thereof,

wherein the plurality of command modes includes a local mode and a broadcast mode.

20. The computer-readable storage device of claim 19 , wherein the operations further include:

generating a user interface associated with the communication session based on first data associated with the communication session, second data associated with a previous communication session, or a combination thereof; and

transmitting the user interface to the first device and to the second device.

21. The computer-readable storage device of claim 20 , wherein the user interface identifies a list of supported spoken commands.

Assignments (8)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY ADDRESS PREVIOUSLY RECORDED AT REEL: 063115 FRAME: 0558. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 21, 2023
From: POLYCOM, LLC.
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 066175/0381 →
CORRECTIVE ASSIGNMENT TO CORRECT THE CONVEYING AND RECEIVING PARTY NAMES PREVIOUSLY RECORDED AT REEL: 062699 FRAME: 0203. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Mar 16, 2023
From: POLYCOM, INC.
To: POLYCOM, LLC
Reel/Frame 063115/0558 →
CHANGE OF NAME Recorded Feb 9, 2023
From: POLYCOMM, INC.
To: POLYCOMM, LLC
Reel/Frame 062699/0203 →
RELEASE OF PATENT SECURITY INTERESTS Recorded Aug 30, 2022
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: PLANTRONICS, INC.; POLYCOM, INC.
Reel/Frame 061356/0366 →
SECURITY AGREEMENT Recorded Jul 5, 2018
From: PLANTRONICS, INC.; POLYCOM, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 046491/0915 →
RELEASE OF SECURITY INTEREST Recorded Jul 3, 2018
From: MACQUARIE CAPITAL FUNDING LLC
To: POLYCOM, INC.
Reel/Frame 046472/0815 →
SECURITY INTEREST Recorded Oct 20, 2017
From: POLYCOM, INC.
To: MACQUIRE CAPITAL FUNDING LLC
Reel/Frame 043915/0115 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 7, 2017
From: CHU, PETER L; COLEMAN, JESSE; LIU, YIBO; LOCHBAUM, ANDREW; SCHNACKER, CODY; TRUONG, KWAN; TU, ZHEMIN
To: POLYCOM, INC.
Reel/Frame 043220/0296 →
Continuity (1)
Related Publication 20190042187A1 · Feb 7, 2019