IP Library Granted Patent US 11,863,306
Granted Patent B2
US 11,863,306 · App. 18/068,236 · Granted Jan 2, 2024

Conference participant spotlight management

Inventor: Samuel Lum (Sunnyvale, CA)
Assignee: Zoom Video Communications, Inc.
H04L12/1818G06F18/2431H04L12/1822
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,863,306
App. No.
18/068,236
Granted
Jan 2, 2024
Kind
B2
Abstract

Automatic spotlighting of participant video feeds in a video conference are based on one or more triggers detected in the participant video feeds. Participant video feeds are added to a spotlight video queue. The participant video feeds are elevated to an active spotlight status based on certain criteria. The participant video feeds that are elevated to the active spotlight status are displayed adjacent to a host video feed on a display.

Claims (58)

1. A non-transitory computer-readable medium configured to store machine-readable instructions that when executed by a processor, cause the processor to:

sample a participant video feed of a spotlight queue based on an activity of the participant video feed;

determine a relevance score of the participant video feed, wherein the relevance score corresponds to the activity and is based on a correlation of a participant activity in the participant video feed relative to a host activity in a host video feed;

update the participant video feed to an active spotlight status based on the relevance score; and

display the participant video feed adjacent to the host video feed.

2. The non-transitory computer-readable medium of claim 1 , wherein the instructions executed by the processor cause the processor to classify the activity.

3. The non-transitory computer-readable medium of claim 1 , wherein the instructions executed by the processor cause the processor to classify the activity based on a comparison of the activity to a stored database of activities.

4. The non-transitory computer-readable medium of claim 1 , wherein the the relevance score indicates how relevant the activity is to conference participants.

5. The non-transitory computer-readable medium of claim 1 , wherein the instructions executed by the processor cause the processor to detect a second activity in a second participant video feed.

6. The non-transitory computer-readable medium of claim 1 , wherein the instructions executed by the processor cause the processor to:

initiate a timer when the participant video feed is displayed adjacent to the host video feed.

7. The non-transitory computer-readable medium of claim 1 , wherein the instructions executed by the processor cause the processor to:

initiate a timer when the participant video feed is displayed adjacent to the host video feed; and

demote the participant video feed from the active spotlight status when the timer expires.

8. A method, comprising:

sampling a participant video feed of a spotlight queue based on an activity of the participant video feed;

determining a relevance score of the participant video feed, wherein the relevance score corresponds to the activity and is based on a correlation of a participant activity in the participant video feed relative to a host activity in a host video feed;

updating the participant video feed to an active spotlight status based on the relevance score; and

displaying the participant video feed adjacent to the host video feed.

9. The method of claim 8 , further comprising:

detecting a second activity in a second participant video feed; and

determining a second relevance score corresponding to the second detected activity.

10. The method of claim 8 , further comprising:

detecting a second activity in a second participant video feed;

determining a second relevance score corresponding to the second detected activity; and

adding the second participant video feed to the spotlight queue when the second relevance score is above a relevance threshold.

11. The method of claim 8 , further comprising:

detecting a second activity in a second participant video feed;

determining a second relevance score corresponding to the second detected activity;

adding the second participant video feed to the spotlight queue when the second relevance score is above a relevance threshold; and

updating the second participant video feed to the active spotlight status.

12. The method of claim 8 , further comprising:

detecting a second activity in a second participant video feed;

determining a second relevance score corresponding to the second detected activity; and

comparing the relevance score to the second relevance score.

13. The method of claim 8 , further comprising:

detecting a second activity in a second participant video feed;

determining a second relevance score corresponding to the second detected activity;

comparing the relevance score to the second relevance score, wherein the relevance score is above the second relevance score; and

adding the second participant video feed to the spotlight queue below the participant video feed.

14. The method of claim 8 , wherein the relevance score is based on a correlation of a first object activity in the participant video feed relative to a second object activity in the host video feed.

15. A video conference system, comprising:

a server comprising a processor;

a host device configured to transmit a host video feed to the server; and

a participant device configured to transmit a participant video feed to the server;

wherein the server is configured to:

sample the participant video feed based on an activity of the participant video feed, the participant video feed associated with a spotlight queue;

determine a relevance score of the participant video feed, wherein the relevance score corresponds to the activity and is based on a correlation of a participant activity in the participant video feed relative to a host activity in a host video feed;

update the participant video feed to an active spotlight status based on the relevance score; and

display the participant video feed adjacent to the host video feed.

16. The video conference system of claim 15 , wherein the relevance score is based on a correlation of a first object activity in the participant video feed relative to a second object activity in the host video feed.

17. The video conference system of claim 15 , wherein the server is further configured to:

determine whether the activity is valid based on a duration of the activity; and

update the participant video feed to the active spotlight status based on a determination that the activity is valid.

18. The video conference system of claim 15 , wherein the server is further configured to:

determine whether the activity is valid based on a dynamic threshold associated with a number of participant video feeds that have detected activity.

19. The video conference system of claim 15 , wherein the spotlight queue comprises multiple participant video feeds, and wherein two of the multiple participant video feeds that have been in the spotlight queue the longest are updated to the active spotlight status.

20. The video conference system of claim 15 , wherein the spotlight queue comprises multiple participant video feeds, and wherein two of the multiple participant video feeds that have the highest relevance scores are updated to the active spotlight status.

Assignments (2)
CHANGE OF NAME Recorded Jan 7, 2025
From: ZOOM VIDEO COMMUNICATIONS, INC.
To: ZOOM COMMUNICATIONS, INC.
Reel/Frame 069839/0593 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2022
From: LUM, SAMUEL
To: ZOOM VIDEO COMMUNICATIONS, INC.
Reel/Frame 062145/0736 →