IP Library Granted Patent US 12,231,809
Granted Patent B2
US 12,231,809 · App. 18/069,092 · Granted Feb 18, 2025

Optimizing video conferencing using contextual information

Inventor: Oliver Pell (London, GB)
Assignee: Meta Platforms, Inc.
H04N7/147H04L65/1089H04L65/4015H04L65/403H04L65/80H04N7/15H04N19/85H04N19/115H04N19/167H04N19/174
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,231,809
App. No.
18/069,092
Granted
Feb 18, 2025
Kind
B2
Abstract

The present disclosure is directed toward systems and methods for optimizing video conferences. For instance, systems and methods described herein optimize both the transmission and display of one or more video conference data streams. Systems and methods described herein optimize the transmission and display of one or more video conference data streams by identifying a context associated with the one or more video conference data streams and optimizing the one or more video conference data streams based on the identified context.

Claims (38)

1. A method comprising:

conducting, by a client computing device associated with a user, a video call capturing a plurality of participants;

generating, for each participant of the plurality of participants, an importance score at least by determining a relative location of the participant compared to other participants of the plurality of participants; and

customizing the video call for the user based on importance scores by focusing in on a participant with a highest importance score.

2. The method as recited in claim 1 , further comprising generating affinity coefficients representing relationship strengths between the user and each participant of the plurality of participants based on networking system information.

3. The method as recited in claim 2 , wherein generating the affinity coefficients based on the networking system information comprises generating the affinity coefficients based on one or more of social networking profile information, social networking activity history, or interactions between the user and a given participant.

4. The method as recited in claim 1 , wherein focusing on the participant with the highest importance score comprises applying a higher compression rate to one or more other participants of the plurality of participants-.

5. The method as recited in claim 1 , wherein focusing on the participant with the highest importance score comprises generating a display layout by arranging one or more video streams captured by client devices participating in the video call so that a video stream of the participant with the highest importance score is larger than video streams of other participants.

6. The method as recited in claim 1 , wherein focusing on the participant with the highest importance score comprises:

generating a first presentation having a first quality for a first video stream captured by a first client device for the participant with the highest importance score; and

generating a second presentation having a second quality lower than the first quality for a second video stream captured by a second client device for a second participant in the video call.

7. The method as recited in claim 1 , wherein focusing on the participant with the highest importance score comprises zooming in on the participant with the highest importance score.

8. A system comprising:

at least one computer-readable storage medium; and

at least one processor coupled to the least one computer-readable storage medium, the at least one processor configured to cause the system to:

conduct a video call between a user and a plurality of participants;

generate, for each participant of the plurality of participants, an importance score at least by determining a relative location of the participant compared to other participants of the plurality of participants; and

customize the video call for the user based on importance scores to focus on a participant with a highest importance score.

9. The system as recited in claim 8 , wherein the at least one processor is configured to cause a camera of the system to focus on the participant with the highest importance score.

10. The system as recited in claim 9 , wherein the at least one processor is configured to cause the camera of the system to pan or tilt to focus on the participant with the highest importance score.

11. The system as recited in claim 9 , wherein the at least one processor is configured to cause the camera of the system to swivel to focus on the participant with the highest importance score.

12. The system as recited in claim 9 , wherein the at least one processor is configured to cause the camera of the system to zoom out to focus on the participant with the highest importance score by capturing movement of the participant with the highest importance score.

13. The system as recited in claim 9 , wherein:

the camera is located on a first client device associated with the participant with the highest importance score; and

a display of the video call for the user is provided on a second client device associated with the user.

14. The system as recited in claim 13 , wherein the first client device and the second client device are remote computer systems linked through a network.

15. A non-transitory computer readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:

conducting a video call between a user and a plurality of participants;

generating, for each participant of the plurality of participants, an importance score at least by determining a relative location of the participant compared to other participants of the plurality of participants; and

customizing the video call for the user based on importance scores by focusing in on a participant with a highest importance score.

16. The non-transitory computer readable medium as recited in claim 15 ,

wherein generating, for each participant of the plurality of participants, an importance score further comprises:

accessing networking system information corresponding to the user and each participant; and

assigning a value to each networking system information factor for each participant.

17. The non-transitory computer readable medium as recited in claim 15 , wherein focusing in on the participant with the highest importance score comprises zooming in on the participant with the highest importance score.

18. The non-transitory computer readable medium as recited in claim 15 , wherein focusing in on the participant with the highest importance score comprises zooming out to capture the participant with the highest importance score.

19. The non-transitory computer readable medium as recited in claim 15 , wherein focusing in on the participant with the highest importance score comprises panning or tilting a camera capturing the participant with the highest importance score.

20. The non-transitory computer readable medium as recited in claim 15 , wherein focusing in on the participant with the highest importance score comprises swiveling a camera capturing the participant with the highest importance score.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2022
From: PELL, OLIVER
To: FACEBOOK, INC.
Reel/Frame 062164/0120 →
CHANGE OF NAME Recorded Dec 20, 2022
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 062183/0636 →
Continuity (5)
Continuation 17341126 · Jun 7, 2021
Continuation 16863524 · Apr 30, 2020
Continuation 16127174 · Sep 10, 2018
Continuation 15385540 · Dec 20, 2016
Related Publication 20230124525A1 · Apr 20, 2023
References Cited (23)
US 7028269B1 · Cohen-Solal · 2006 [cited by examiner]
US 8346864B1 · Amidon et al. · 2013 [cited by applicant]
US 9602559B1 · Barros · 2017 [cited by examiner]
US 9942516B1 · Pell · 2018 [cited by applicant]
US 10075672B2 · Pell · 2018 [cited by applicant]
US 10659729B2 · Pell · 2020 [cited by examiner]
US 20020101505A1 · Gutta · 2002 [cited by examiner]
US 20080158339A1 · Civanlar et al. · 2008 [cited by applicant]
US 20140063178A1 · Krans et al. · 2014 [cited by applicant]
US 20140340467A1 · Kajarekar et al. · 2014 [cited by applicant]
US 20140362165A1 · Ackerman et al. · 2014 [cited by applicant]
US 20150006241A1 · Jamal et al. · 2015 [cited by applicant]
US 20150074206A1 · Baldwin · 2015 [cited by applicant]
US 20160212074A1 · Yu et al. · 2016 [cited by applicant]
US 20160227165A1 · Moorjani · 2016 [cited by examiner]
US 20170070704A1 · Li · 2017 [cited by examiner]
US 20190082142A1 · Pell · 2019 [cited by applicant]
Non-Final Office Action mailed Jul. 7, 2017 for U.S. Appl. No. 15/385,540, filed Dec. 20, 2016, 11 pages. [cited by applicant]
Non-Final Office Action mailed Jan. 17, 2019 for U.S. Appl. No. 16/127,174, filed Sep. 10, 2018, 15 pages. [cited by applicant]
Non-Final Office Action mailed Jan. 18, 2018 for U.S. Appl. No. 15/385,540, filed Dec. 20, 2016, 10 pages. [cited by applicant]
Non-Final Office Action mailed Oct. 25, 2019 for U.S. Appl. No. 16/127,174, filed Sep. 10, 2018, 08 pages. [cited by applicant]
Notice of Allowance mailed May 9, 2018 for U.S. Appl. No. 15/385,540, filed Dec. 20, 2016, 05 pages. [cited by applicant]
Notice of Allowance mailed Jan. 30, 2020 for U.S. Appl. No. 16/127,174, filed Sep. 10, 2018, 06 pages. [cited by applicant]