IP Library Granted Patent US 10,645,137
Granted Patent B2
US 10,645,137 · App. 14/981,813 · Granted May 5, 2020

Systems and methods to create composite videos

Inventor: Oliver Pell (London, GB)
Assignee: Facebook, Inc.
H04L65/604G06Q50/01H04L65/4053H04L65/605H04N7/147H04N7/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,645,137
App. No.
14/981,813
Granted
May 5, 2020
Kind
B2
Abstract

Systems, methods, and non-transitory computer readable media are configured to receive a video stream of a first peer involved in a video communication. A video stream of a second peer involved in the video communication is received. Image content of the video stream of the second peer is modified to create a modified video stream of the second peer. The video stream of the first peer and the modified video stream of the second peer are combined to create a composite video.

Claims (40)

1. A computer-implemented method comprising:

receiving, by a computing system, a video stream of a first peer involved in a video communication;

receiving, by the computing system, a video stream of a second peer involved in the video communication;

providing, by the computing system, one or more frames of the video stream of the second peer to a classifier trained to recognize one or more objects from the one or more frames;

determining, by the computing system, a number of participants reflected in one or more frames of the video stream of the second peer;

determining, by the computing system, the second peer to be a secondary peer based on the number of participants reflected in the one or more frames of the video stream of the second peer not satisfying a threshold number;

modifying, by the computing system, image content of the video stream of the second peer to create a modified video stream of the second peer; and

combining, by the computing system, the video stream of the first peer and the modified video stream of the second peer to create a composite video, wherein the combining the video stream and the modified video stream includes superimposing the modified video stream of the second peer onto the video stream of the first peer.

2. The computer-implemented method of claim 1 , wherein the modifying image content of the video stream of the second peer includes changing a display shape of the video stream of the second peer.

3. The computer-implemented method of claim 1 , wherein the modifying image content of the video stream of the second peer includes removing at least a portion of the image content reflected by the video stream of the second peer.

4. The computer-implemented method of claim 3 , wherein the at least a portion of the image content includes at least one of background, foreground, and objects other than a user of the second peer.

5. The computer-implemented method of claim 1 , wherein the modifying image content of the video stream of the second peer includes resizing a user depicted in the video stream of the second peer to be within a threshold difference value from a user depicted in the video stream of the first peer.

6. The computer-implemented method of claim 1 , further comprising:

receiving a video stream of a viewing peer involved in the video communication; and

presenting the composite video to the viewing peer, the composite video excluding the video stream of the viewing peer.

7. The computer-implemented method of claim 1 , wherein the first peer is a conference room in which a plurality of users are participating in the video communication.

8. The computer-implemented method of claim 1 , wherein the second peer is a location at which a user is positioned while participating in the video communication.

9. The computer-implemented method of claim 1 , wherein the computing system includes a client computing device.

10. A system comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, cause the system to perform:

receiving a video stream of a first peer involved in a video communication;

receiving a video stream of a second peer involved in the video communication;

determining a number of participants reflected in one or more frames of the video stream of the second peer;

determining the second peer to be a secondary peer based on the number of participants reflected in the one or more frames of the video stream of the second peer not satisfying a threshold number;

modifying image content of the video stream of the second peer to create a modified video stream of the second peer; and

combining the video stream of the first peer and the modified video stream of the second peer to create a composite video, wherein the combining the video stream and the modified video stream includes superimposing the modified video stream of the second peer onto the video stream of the first peer.

11. The system of claim 10 , wherein the modifying image content of the video stream of the second peer includes changing a display shape of the video stream of the second peer.

12. The system of claim 10 , wherein the modifying image content of the video stream of the second peer includes removing at least a portion of the image content reflected by the video stream of the second peer.

13. The system of claim 12 , wherein the at least a portion of the image content includes at least one of background, foreground, and objects other than a user of the second peer.

14. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform a method comprising:

receiving a video stream of a first peer involved in a video communication;

receiving a video stream of a second peer involved in the video communication;

determining a number of participants reflected in one or more frames of the video stream of the second peer;

determining the second peer to be a secondary peer based on the number of participants reflected in the one or more frames of the video stream of the second peer not satisfying a threshold number;

modifying image content of the video stream of the second peer to create a modified video stream of the second peer; and

combining the video stream of the first peer and the modified video stream of the second peer to create a composite video, wherein the combining the video stream and the modified video stream includes superimposing the modified video stream of the second peer onto the video stream of the first peer.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the modifying image content of the video stream of the second peer includes changing a display shape of the video stream of the second peer.

16. The non-transitory computer-readable storage medium of claim 14 , wherein the modifying image content of the video stream of the second peer includes removing at least a portion of the image content reflected by the video stream of the second peer.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the at least a portion of the image content includes at least one of background, foreground, and objects other than a user of the second peer.

Assignments (2)
CHANGE OF NAME Recorded Nov 24, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058957/0843 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2016
From: PELL, OLIVER
To: FACEBOOK, INC.
Reel/Frame 037727/0904 →