Granted Patent B2

US 12,206,824 · App. 17/895,444 · Granted Jan 21, 2025

Inventor: Samuel Lum (Sunnyvale, CA)

Assignee: Zoom Communications, Inc.

H04M3/568G06F3/013G06V40/16G10L25/78H04N7/152G10L2025/783

Abstract

Claims (87)

1. A method, comprising:

obtaining a first video feed from a first camera at a location;

obtaining a second video feed from a second camera at the location, the second video feed including a first non-participant object;

displaying the first video feed from the first camera in a first area of a display;

detecting the first non-participant object in the second video feed;

determining a relevance score of the detected first non-participant object in the second video feed, the relevance score based on a correlation between the detected first non-participant object and a second non-participant object identified in a participant video feed associated with a remote location; and

automatically displaying the second video feed in the first area of the display when the relevance score meets a relevance threshold.

2. The method of claim 1 , comprising:

determining a conference type associated with a video conference that includes the first video feed and the second video feed;

detecting a third non-participant object associated with the conference type in the first video feed; and

adjusting the relevance score to account for the third non-participant object.

3. The method of claim 1 , comprising:

determining a conference type associated with a video conference that includes the first video feed and the second video feed;

detecting a third non-participant object associated with the conference type in the first video feed;

adjusting the relevance score to account for the third non-participant object; and

displaying the first video feed in a second area of the display when the second video feed is displayed in the first area of the display.

4. The method of claim 1 , comprising:

determining a conference type associated with a video conference that includes the first video feed and the second video feed;

detecting one or more non-participant objects associated with the conference type in the first video feed; and

adjusting the relevance score to account for the one or more non-participant objects, wherein each relevance score of respective detected non-participant objects is based on a motion duration of the respective detected non-participant objects in the corresponding video feed.

5. The method of claim 1 , comprising:

determining a conference type associated with a video conference that includes the first video feed and the second video feed;

detecting one or more non-participant objects associated with the conference type in the first video feed; and

adjusting the relevance score to account for the one or more non-participant objects, wherein each relevance score of respective detected non-participant objects is based on an object type in the corresponding video feed.

6. The method of claim 1 , wherein the first video feed and the second video feed are associated with a video conference host.

7. The method of claim 1 , comprising:

adjusting a zoom on the first video feed when the first video feed is displayed in the primary area of the display; and

adjusting a zoom on the second video feed when the second video feed is displayed in the primary area of the display.

8. A computing device, comprising:

a processor configured to:

obtain a first video feed from a first camera at a location;

obtain a second video feed from a second camera at the location, the second video feed including a first non-participant object;

display the first video feed from the first camera in a first area of a display;

detect the first non-participant object in the second video feed;

determine a relevance score of the detected first non-participant object in the second video feed, the relevance score based on a correlation between the detected first non-participant object and a second non-participant object identified in a participant video feed associated with a remote location; and

automatically display the second video feed in the first area of the display when the relevance score meets a relevance threshold.

9. The computing device of claim 8 , wherein the processor is further configured to:

determine a conference type associated with a video conference that includes the first video feed and the second video feed;

detect a third non-participant object associated with the conference type in the first video feed; and

adjust the relevance score based on the third non-participant object.

10. The computing device of claim 8 , wherein the processor is further configured to:

determine a conference type associated with a video conference that includes the first video feed and the second video feed;

detect a third non-participant object associated with the conference type in the first video feed;

adjust the relevance score based on the third non-participant object; and

display the first video feed in a second area of the display when the second video feed is displayed in the first area of the display.

11. The computing device of claim 8 , wherein the processor is further configured to:

determine a conference type associated with a video conference that includes the first video feed and the second video feed;

detect one or more non-participant objects associated with the conference type in the first video feed; and

adjust the relevance score based on the one or more non-participant objects, wherein each relevance score of respective detected non-participant objects is based on a motion duration of the respective detected non-participant objects in the corresponding video feed.

12. The computing device of claim 8 , wherein the processor is further configured to:

determine a conference type associated with a video conference that includes the first video feed and the second video feed;

detect one or more non-participant objects associated with the conference type in the first video feed; and

adjust the relevance score based on the one or more non-participant objects, wherein each relevance score of respective detected non-participant objects is based on an object type in the corresponding video feed.

13. The computing device of claim 8 , wherein the first video feed and the second video feed are associated with a video conference host.

14. The computing device of claim 8 , wherein the processor is further configured to:

adjust a zoom on the first video feed when the first video feed is displayed in the primary area of the display; and

adjust a zoom on the second video feed when the second video feed is displayed in the primary area of the display.

15. A video conference system, comprising:

a first camera at a location configured to capture a first video feed;

a second camera at the location configured to capture a second video feed, the second video feed including a first non-participant object; and

a computing device configured to:

obtain the first video feed from the first camera;

obtain the second video feed from the second camera;

display the first video feed from the first camera in a first area of a display;

detect the first non-participant object in the second video feed;

determine a relevance score of a detected first non-participant object in the second video feed, the relevance score based on a correlation between the detected first non-participant object and a second non-participant object identified in a participant video feed associated with a remote location; and

automatically display the second video feed in the first area of the display when the relevance score meets a relevance threshold.

16. The video conference system of claim 15 , wherein the computing device is further configured to:

determine a conference type associated with the video conference that includes the first video feed and the second video feed;

detect a third non-participant object associated with the conference type in the first video feed; and

adjust the relevance score based on the third non-participant object.

17. The video conference system of claim 15 , wherein the computing device is further configured to:

determine a conference type associated with the video conference that includes the first video feed and the second video feed;

detect a third non-participant object associated with the conference type in the first video feed; and

adjust the relevance score based on the third non-participant object; and

display the first video feed in a second area of the display when the second video feed is displayed in the first area of the display.

18. The video conference system of claim 15 , wherein the computing device is further configured to:

determine a conference type associated with a video conference that includes the first video feed and the second video feed;

detect one or more non-participant objects associated with the conference type in the first video feed; and

adjust the relevance score based on the one or more non-participant objects, wherein each relevance score of respective detected non-participant objects is based on a motion duration of the respective detected objects in the corresponding video feed.

19. The video conference system of claim 15 , wherein the computing device is further configured to:

determine a conference type associated with a video conference that includes the first video feed and the second video feed;

detect one or more non-participant objects associated with the conference type in the first video feed; and

adjust the relevance score based on the one or more non-participant objects, wherein each relevance score of respective detected non-participant objects is based on an object type in the corresponding video feed.

20. The video conference system of claim 15 , wherein the computing device is further configured to:

adjust a zoom on the first video feed when the first video feed is displayed in the primary area of the display; and

adjust a zoom on the second video feed when the second video feed is displayed in the primary area of the display.

Assignments (2)

Continuity (2)

References Cited (43)