IP Library Granted Patent US 10,728,194
Granted Patent B2
US 10,728,194 · App. 14/981,840 · Granted Jul 28, 2020

Systems and methods to selectively combine video streams

Inventor: Oliver Pell (London, GB)
Assignee: Facebook, Inc.
H04L51/10H04L12/1827H04L51/046H04L51/32H04L65/601H04L67/02H04L67/104H04L67/42
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,728,194
App. No.
14/981,840
Granted
Jul 28, 2020
Kind
B2
Abstract

Systems, methods, and non-transitory computer readable media are configured to determine that a first peer involved in a video communication is a primary peer based on satisfaction of a threshold. It is determined that a second peer involved in the video communication is a secondary peer based on non-satisfaction of the threshold. It is determined that a modified video stream of the second peer is to be superimposed onto a video stream of the first peer to create a composite video.

Claims (52)

1. A computer-implemented method comprising:

determining, by a computing system, that a first peer involved in a video conference is a primary peer, wherein the first peer is associated with a plurality of users;

determining, by the computing system, that a second peer involved in the video conference is a secondary peer, wherein the second peer is associated with a single user;

determining, by the computing system, affinity between the single user of the second peer and each user of the plurality of users of the first peer; and

superimposing, by the computing system, a modified video stream of the second peer onto a video stream of the first peer at a location adjacent to a user of the plurality of users having a greatest affinity with the single user of the second peer to create a composite video for the video conference.

2. The computer-implemented method of claim 1 , further comprising:

detecting a static area in the video stream of the first peer; and

superimposing the modified video stream of the second peer onto the static area in the video stream of the first peer.

3. The computer-implemented method of claim 2 , further comprising:

determining that the static area fails to satisfy a materiality threshold.

4. The computer-implemented method of claim 1 , further comprising:

determining a location associated with the first peer;

determining a location associated with the single user; and

superimposing the modified video stream of the second peer onto the video stream of the first peer based on a determination that a difference in location between the first peer and the single user satisfies a distance threshold.

5. The computer-implemented method of claim 1 , further comprising:

determining that a third peer involved in the video conference is a primary peer based on a satisfaction of a threshold; and

positioning the video stream of the first peer adjacent to a video stream of the third peer in the composite video.

6. The computer-implemented method of claim 1 , the method further comprising:

determining that a third peer involved in the video conference is a secondary peer based on a non-satisfaction of a threshold; and

superimposing the modified video stream of the second peer and a video stream of the third peer onto the video stream of the first peer.

7. A system comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, cause the system to perform:

determining that a first peer involved in a video conference is a primary peer, wherein the first peer is associated with a plurality of users;

determining that a second peer involved in the video conference is a secondary peer, wherein the second peer is associated with a single user;

determining affinity between the single user of the second peer and each user of the plurality of users of the first peer; and

superimposing, a modified video stream of the second peer onto a video stream of the first peer at a location adjacent to a user of the plurality of users having a greatest affinity with the single user of the second peer to create a composite video for the video conference.

8. The system of claim 7 , further comprising:

detecting a static area in the video stream of the first peer; and

superimposing the modified video stream of the second peer onto the static area in the video stream of the first peer.

9. The system of claim 8 , further comprising:

determining that the static area fails to satisfy a materiality threshold.

10. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform a method comprising:

determining that a first peer involved in a video conference is a primary peer, wherein the first peer is associated with the plurality of users;

determining that a second peer involved in the video conference is a secondary peer, wherein the second peer is associated with a single user;

determining affinity between the single user of the second peer and each user of the plurality of users of the first peer; and

superimposing, a modified video stream of the second peer onto a video stream of the first peer at a location adjacent to a user of the plurality of the users having a greatest affinity with the single user of the second peer to create a composite video or the video conference.

11. The system of claim 9 , wherein the first peer is associated with a plurality of users and the second peer is associated with a single user.

12. The non-transitory computer-readable storage medium of claim 11 , further comprising:

determining that the static area fails to satisfy a materiality threshold.

13. The system of claim 7 , further comprising:

determining a location associated with the first peer; determining a location associated with the single user; and superimposing the modified video stream of the second peer onto the video stream of the first peer based on a determination that a difference in location between the first peer and the single user satisfies a distance threshold.

14. The system of claim 7 , further comprising:

determining that a third peer involved in the video conference is a primary peer based on a satisfaction of a threshold; and positioning the video stream of the first peer adjacent to a video stream of the third peer in the composite video.

15. The system of claim 11 , further comprising:

determining that a third peer involved in the video conference is a secondary peer based on a non-satisfaction of a threshold; and superimposing the modified video stream of the second peer and a video stream of the third peer onto the video stream of the first peer.

16. The non-transitory computer-readable storage medium of claim 10 , further comprising:

determining a location associated with the first peer; determining a location associated with the single user; and superimposing the modified video stream of the second peer onto the video stream of the first peer based on a determination that a difference in location between the first peer and the single user satisfies a distance threshold.

17. The non-transitory computer-readable storage medium of claim 10 , further comprising:

determining that a third peer involved in the video conference is a primary peer based on a satisfaction of a threshold; and positioning the video stream of the first peer adjacent to a video stream of the third peer in the composite video.

18. The non-transitory computer-readable storage medium of claim 10 , further comprising:

determining that a third peer involved in the video conference is a secondary peer based on a non-satisfaction of a threshold; and superimposing the modified video stream of the second peer and a video stream of the third peer onto the video stream of the first peer.

Assignments (2)
CHANGE OF NAME Recorded Nov 24, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058957/0843 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2016
From: PELL, OLIVER
To: FACEBOOK, INC.
Reel/Frame 037730/0459 →