IP Library Granted Patent US 11,563,660
Granted Patent B2
US 11,563,660 · App. 17/163,440 · Granted Jan 24, 2023

Intelligent configuration of conferencing devices

Inventor: Shane Springer (Manchester, MI)
Assignee: Zoom Video Communications, Inc.
H04L43/0823G06K9/6256H04L43/50H04L65/80H04N7/147H04N7/152
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,563,660
App. No.
17/163,440
Granted
Jan 24, 2023
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media provide for the intelligent configuration of endpoint devices for video conferencing. First, the system identifies a plurality of endpoint devices within a room which are communicatively connected. The system then determines a quantity of the endpoint devices. For each of the endpoint devices, the system performs one or more diagnostic operations to receive diagnostic output from the endpoint device, determines a location and an orientation of the endpoint device within the room using the received diagnostic output, and determines whether the diagnostic output meets or exceeds a threshold for output quality. Finally, the system processes the diagnostic outputs of the endpoint devices to determine an optimal settings configuration for each of the endpoint devices. The optimal settings configuration is dependent on at least the quantity, location, orientation, and output quality of the endpoint devices.

Claims (65)

1. A method for providing intelligent configuration of a device mesh for video conferencing, comprising:

identifying a plurality of endpoint devices within a room which are communicatively connected;

determining a quantity of the endpoint devices;

for each endpoint device:

performing one or more diagnostic operations to receive diagnostic output from the endpoint device,

determining a location and an orientation of the endpoint device within the room using the received diagnostic output, and

determining whether the diagnostic output meets or exceeds a threshold for output quality;

processing the diagnostic outputs of the endpoint devices to determine an optimal settings configuration for each of the endpoint devices, wherein the optimal settings configuration is dependent on at least the quantity, location, orientation, and output quality of the endpoint devices.

2. The method of claim 1 , further comprising:

training one or more artificial intelligence (AI) engines on a dataset comprising various configurations of endpoint devices in differing quantities,

wherein the processing of the diagnostic outputs to determine the optimal settings configuration of the endpoint devices is executed by the one or more AI engines.

3. The method of claim 1 , wherein each of the endpoint devices is configured to output an audio, visual, and/or audiovisual stream in real-time or substantially real-time.

4. The method of claim 1 , wherein the plurality of endpoint devices are communicatively connected via a mesh network of devices.

5. The method of claim 1 , wherein the diagnostic output from each endpoint device includes a number of detected participants.

6. The method of claim 1 , wherein the plurality of endpoint devices are configured to capture audio and/or visual content, and

wherein performing the one or more diagnostic operations comprises capturing audio and/or visual content.

7. The method of claim 1 , further comprising:

determining current room conditions of the room based on the received diagnostic outputs,

wherein the optimal settings configuration is further dependent on the current room conditions of the room.

8. The method of claim 1 , wherein processing the diagnostic outputs of the endpoints devices to determine a settings configuration of each of the endpoint devices comprises:

periodically determining a video conferencing context;

determining that the video conferencing context involves a subject that is currently off-screen;

determining the location and orientation of the off-screen subject; and

adaptively switching from a first endpoint device to a second endpoint device capable of better capturing the off-screen subject.

9. The method of claim 1 , wherein a plurality of the endpoint devices are configured to capture video content, and wherein the method further comprises:

determining the location and orientation of one or more presenters in the room based on at least the diagnostic output;

determining an optimal location and orientation for at least one of the endpoint devices based on the settings configuration and the location and orientation of the presenters; and

providing a notification to a user associated with the endpoint device of the determined optimal location and orientation for the device.

10. The method of claim 1 , further comprising:

sending one or more notifications to users associated with at least one of the endpoint devices with respect to the optimal settings configurations of the endpoint devices.

11. The method of claim 1 , further comprising:

automatically adjusting one or more output settings for at least one of the endpoint devices based on the optimal settings configurations of the endpoint devices.

12. The method of claim 1 , further comprising:

determining a video conferencing context with a plurality of presenters in the room;

determining approximate locations and orientations of the presenters in the room based on the received diagnostic outputs from the endpoint devices;

determining optimal locations and orientations of at least a subset of the endpoint devices, wherein the optimal locations and orientations correspond to the locations and orientations of the plurality of presenters in the room; and

sending notifications to users associated with the endpoint devices with respect to the optimal locations and orientations of the endpoint devices.

13. The method of claim 1 , further comprising:

determining a proximity and positioning of each of the endpoint devices relative to the other endpoint devices,

wherein the optimal settings configuration of each of the endpoint devices is further determined based on the proximity and positioning of each of the endpoint devices relative to the other endpoint devices.

14. The method of claim 1 , wherein the endpoint devices are configured to communicatively connect with one another via one or more signaling and/or beaconing technologies.

15. The method of claim 1 , wherein a central controller is configured to coordinate the endpoint devices with respect to one another.

16. The method of claim 15 , wherein one of the diagnostic operations comprises sending an instruction to the central controller to emit an ultrasonic tone in the room, and wherein the method further comprises:

capturing the ultrasonic tone via audio inputs of at least a subset of the endpoint devices; and

processing the captured ultrasonic tone to determine one or more optimization parameters for the room,

wherein the optimal settings configuration is further determined based on the optimization parameters for the room.

17. The method of claim 1 , further comprising:

detecting a new endpoint device in the room;

communicatively connecting the new endpoint device to the other endpoint devices in the room;

performing one or more diagnostic operations on the new endpoint device to receive diagnostic output from the new endpoint device, and

processing the diagnostic outputs of the endpoint devices to determine new optimal settings configurations for each of the endpoint devices, including the new endpoint device.

18. A communication system comprising:

a plurality of endpoint devices within a room which are communicatively connected; and

one or more processors configured to perform the operations of:

determining a quantity of the endpoint devices:

for each endpoint device:

performing one or more diagnostic operations to receive diagnostic output from the endpoint device,

determining a location and an orientation of the endpoint device within the room using the received diagnostic output, and

determining whether the diagnostic output meets or exceeds a threshold for output quality, and

processing the diagnostic outputs of the endpoint devices to determine an optimal settings configuration for each of the endpoint devices, wherein the optimal settings configuration is dependent on at least the quantity, location, orientation, and output quality of the endpoint devices.

19. The communication system of claim 18 , further comprising a central controller configured to coordinate the endpoint devices with respect to one another, wherein the one or more diagnostic operations are performed by the central controller.

20. The communication system of claim 18 , wherein the one or more processors are further configured to perform the operations of:

determining that at least two of the endpoint devices are configured to operate in coordination with each other,

wherein processing the diagnostic outputs of the at least two endpoint devices is performed in coordination with each other, and

wherein the optimal settings configuration of the at least two endpoint devices is determined in coordination with each other.

Assignments (5)
CHANGE OF NAME Recorded Jan 7, 2025
From: ZOOM VIDEO COMMUNICATIONS, INC.
To: ZOOM COMMUNICATIONS, INC.
Reel/Frame 069839/0593 →
CORRECTIVE ASSIGNMENT TO CORRECT THE TYOGRAPHICAL ERROR IN RECEIVING PARTY DATA NAME OF ZOOM VIDEO COMMUNCATIONS, LTD. TO ZOOM VIDEO COMMUNCATIONS, INC. PREVIOUSLY RECORDED AT REEL: 055343 FRAME: 0553. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 9, 2023
From: SPRINGER, SHANE
To: ZOOM VIDEO COMMUNICATIONS, INC.
Reel/Frame 065531/0846 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2023
From: SPRINGER, SHANE PAUL
To: ZOOM VIDEO COMMUNICATIONS, INC.
Reel/Frame 064660/0166 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2022
From: SPRINGER, PAUL SHANE
To: ZOOM VIDEO COMMUNICATIONS, INC.
Reel/Frame 061377/0310 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2021
From: SPRINGER, SHANE
To: ZOOM VIDEO COMMUNICATIONS, LTD.
Reel/Frame 055343/0553 →
Cited By (2)
US 12,418,466 US 12,425,317