IP Library › Granted Patent US 12,028,178
Granted Patent B2
US 12,028,178 · App. 17/655,280 · Granted Jul 2, 2024

Conferencing session facilitation systems and methods using virtual assistant systems and artificial intelligence algorithms

Inventors: Daniel Aaron Law (Glencoe, IL); Chad Wolf Reid (Chicago, IL); Kevin Othel Foy (Chicago, IL)
Assignee: Shure Acquisition Holdings, Inc.
H04L12/1822G10L15/22H04L12/1827G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,028,178
App. No.
17/655,280
Filed
Mar 17, 2022
Granted
Jul 2, 2024
Kind
B2
Art Unit
2454
USPC
709/204
Abstract

Conferencing system and methods for facilitating conferencing sessions in an environment using virtual assistant systems and artificial intelligence algorithms are disclosed. Virtual assistant systems may be integrated into devices of the conferencing system in order to enable higher quality experiences with the virtual assistant by providing improved audio and visual feedback. The conferencing system can provide improved control, configuration, and interaction with the devices of the conferencing system through use of artificial intelligence algorithm that processes voice commands and characteristics of the environment and conferencing sessions, which can result in better system performance and increased user satisfaction.

Claims (84)

1. A system, comprising:

at least one device comprising one or more of a microphone, a loudspeaker, a digital signal processor, or a visual indicator device; and

a processor in communication with the at least one device, a conferencing server configured to facilitate a conferencing session, and a virtual assistant system, the processor configured to:

detect a presence of the at least one device;

responsive to the detection of the presence of the at least one device:

route connections between the at least one device and the virtual assistant system; and

configure processing of audio between the at least one device and the virtual assistant system; and

responsive to receiving a setting to disallow interaction with the virtual assistant system by a remote participant of the conferencing session:

process and route audio of a local participant sensed by the at least one device to the virtual assistant system;

process and route audio of the remote participant from the conferencing server to the at least one device; and

block the audio of the remote participant from being routed from the conferencing server to the virtual assistant system;

wherein, based on the routed connections and the configured processing:

a voice command sensed by the at least one device is processed and routed to the virtual assistant system; and

the audio from the virtual assistant system is processed and routed to the at least one device.

2. The system of claim 1 , wherein the processor is configured to route the connections by performing one or more of:

connecting the microphone to an audio input of the virtual assistant system;

connecting the loudspeaker to an audio output of the virtual assistant system;

connecting the visual indicator device to the virtual assistant system; or

connecting the digital signal processor to one or more of the virtual assistant system, the microphone, or the loudspeaker.

3. The system of claim 1 , wherein the processor is further configured to transmit a signal to the visual indicator device to control the visual indicator device to indicate a state of the virtual assistant system.

4. The system of claim 1 , wherein the processor is further configured to transmit a signal to control a visual indicator of the at least one device, wherein the visual indicator of the at least one device is synchronized with the visual indicator device.

5. The system of claim 1 , wherein the processor is configured to receive the setting to allow or disallow the interaction with the virtual assistant system by the remote participant of the conferencing session.

6. The system of claim 5 , wherein the processor is configured to:

when the setting is to allow the interaction with the virtual assistant system by the remote participant, process and route the audio of the local participant and the audio of the remote participant to the virtual assistant system.

7. The system of claim 1 , wherein the processor is configured to receive a setting to allow or disallow the audio from the virtual assistant system to be routed to the remote participant of the conferencing session.

8. The system of claim 7 , wherein the processor is configured to:

when the setting is to allow the audio from the virtual assistant system to be heard by the remote participant, route the audio from the virtual assistant system to the local participant and the remote participant; and

when the setting is to disallow the audio from the virtual assistant system to be heard by the remote participant, route the audio from the virtual assistant system to the local participant.

9. The system of claim 1 , further comprising a virtual assistant activation switch in communication with the virtual assistant system, and wherein the processor is configured to route the voice command to the virtual assistant system when the virtual assistant activation switch is activated and to not route the voice command to the virtual assistant system when the virtual assistant activation switch is not activated.

10. The system of claim 1 ,

further comprising at least one sensor configured to detect one or more of a characteristic of an environment or a characteristic of the conferencing session;

wherein the processor is further in communication with the at least one sensor, and is further configured to:

receive a signal associated with the voice command from the virtual assistant system;

determine a parameter of the at least one device to control, based on an artificial intelligence algorithm that analyzes (1) the signal associated with the voice command and (2) one or more of the characteristic of the environment or the characteristic of the conferencing session; and

responsive to the determination, transmit a signal to control the parameter of the at least one device.

11. The system of claim 10 , wherein the processor is configured to determine the parameter, based on the artificial intelligence algorithm further analyzing one or more of the characteristic of the environment or the characteristic of the conferencing session over a period of time.

12. The system of claim 10 , wherein the parameter of the at least one device comprises one or more of a location of a beam of the microphone, a deployment of the beam of the microphone, a volume of the loudspeaker, a parameter of the digital signal processor, or a state of the visual indicator device.

13. The system of claim 10 , wherein the characteristic of the conferencing session comprises one or more of scheduling information, participant information, meeting topic information, location information, or a far-end audio signal.

14. A method, comprising:

detecting a presence of at least one device comprising one or more of a microphone, a loudspeaker, a digital signal processor, or a visual indicator device;

responsive to the detection of the presence of the at least one device:

routing connections between the at least one device and a virtual assistant system; and

configuring processing of audio between the at least one device and the virtual assistant system; and

responsive to receiving a setting to disallow interaction with the virtual assistant system by a remote participant of a conferencing session facilitated by a conferencing server:

processing and routing audio of a local participant sensed by the at least one device to the virtual assistant system;

processing and routing audio of the remote participant from the conferencing server to the at least one device; and

blocking the audio of the remote participant from being from the conferencing server to the virtual assistant system;

wherein, based on the routed connections and the configured processing:

a voice command sensed by the at least one device is processed and routed to the virtual assistant system; and

the audio from the virtual assistant system is processed and routed to the at least one device.

15. The method of claim 14 , wherein routing the connections comprises one or more of:

connecting the microphone to an audio input of the virtual assistant system;

connecting the loudspeaker to an audio output of the virtual assistant system;

connecting the visual indicator device to the virtual assistant system; or

connecting the digital signal processor to one or more of the virtual assistant system, the microphone, or the loudspeaker.

16. The method of claim 14 , further comprising transmitting a signal to the visual indicator device to control the visual indicator device to indicate a state of the virtual assistant system.

17. The method of claim 14 , further comprising:

receiving a setting to allow or disallow interaction with the virtual assistant system by the remote participant of the conferencing session;

when the setting is to allow the interaction with the virtual assistant system by the remote participant, processing and routing audio of the local participant and audio of the remote participant to the virtual assistant system; and

when the setting is to disallow the interaction with the virtual assistant system by the remote participant, processing and routing the audio of the local participant to the virtual assistant system.

18. The method of claim 14 , further comprising:

receiving the setting to allow or disallow the audio from the virtual assistant system to be routed to the remote participant of the conferencing session;

when the setting is to allow the audio from the virtual assistant system to be heard by the remote participant, routing the audio from the virtual assistant system to the local participant and the remote participant; and

when the setting is to disallow the audio from the virtual assistant system to be heard by the remote participant, routing the audio from the virtual assistant system to the local participant.

19. The method of claim 14 , further comprising:

receiving a signal from a virtual assistant activation switch;

when the virtual assistant activation switch is activated, routing the voice command to the virtual assistant system; and

when the virtual assistant activation switch is not activated, not routing the voice command to the virtual assistant system.

20. The method of claim 14 , further comprising:

receiving a signal associated with the voice command from the virtual assistant system;

determining a parameter of the at least one device to control, based on an artificial intelligence algorithm that analyzes (1) the signal associated with the voice command and (2) one or more of a characteristic of an environment or a characteristic of the conferencing session received from at least one sensor; and

responsive to the determination, transmitting a signal to control the parameter of the at least one device.

21. A non-transitory, computer-readable memory having instructions stored thereon that, when executed by a processor, cause the performance of a set of acts comprising:

detecting a presence of one or more devices comprising one or more of a microphone, a loudspeaker, a digital signal processor, or a visual indicator device;

responsive to the detection of the presence of the one or more devices:

routing connections between the one or more devices and a virtual assistant system; and

configuring processing of audio between the one or more devices and the virtual assistant system; and

responsive to a receiving a setting to disallow interaction with the virtual assistant system by a remote participant of a conferencing session facilitated by a conferencing server:

processing and routing audio of a local participant sensed by the at least one device to the virtual assistant system;

processing and routing audio of the remote participant from the conferencing server to the at least one device; and

blocking the audio of the remote participant from being routed from the conferencing server to the virtual assistant system;

wherein, based on the routed connections and the configured processing:

a voice command sensed by the one or more devices is processed and routed to the virtual assistant system; and

the audio from the virtual assistant system is processed and routed to the one or more devices.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2022
From: LAW, DANIEL AARON; REID, CHAD WOLF; FOY, KEVIN OTHEL
To: SHURE ACQUISITION HOLDINGS, INC.
Reel/Frame 059297/0260 →
Continuity (2)
Provisional Application 63163421 · Mar 19, 2021
Related Publication 20220303149A1 · Sep 22, 2022