IP Library › Granted Patent US 11,856,146
Granted Patent B2
US 11,856,146 · App. 18/124,359 · Granted Dec 26, 2023

Systems, methods, and apparatus for virtual meetings

Inventors: James Jorasch (New York, NY); Michael Werner (Seneca, SC); Geoffrey Gelman (New York, NY); Isaac W. Hock (Chicago, IL); Gennaro Rendino (Horseheads, NY); Christopher Capobianco (Hastings-on-Hudson, NY)
Assignee: SCIENCE HOUSE LLC
H04M3/567H04L12/1827H04L65/1089H04L65/403H04M3/568H04N21/2187H04N21/44008H04N21/4781
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,856,146
App. No.
18/124,359
Granted
Dec 26, 2023
Kind
B2
Abstract

In accordance with some embodiments, systems, apparatus, interfaces, methods, and articles of manufacture are provided for providing information incorporating additional data feeds, creating common arrangements, and improving performance in a virtual meeting.

Claims (69)

1. A video conferencing system hosting a dynamically customized video conference, comprising:

an electronic processing device;

a non-transitory memory device in communication with the electronic processing device, the non-transitory memory device storing (i) video conference data, (ii) participant display device data, and (iii) processing instructions that, when executed by the electronic processing device, result in:

identifying, by the electronic processing device and based on the video conference data, a plurality of data feeds of a video conference;

identifying, by the electronic processing device and based on a first subset of the participant display device data corresponding to a first display device of a first participant in the video conference, a first arrangement of the plurality of data feeds of the video conference;

identifying, by the electronic processing device, a first data feed of the plurality of data feeds of the video conference that has the focus of the first participant;

reducing, by the electronic processing device, a data feed bandwidth of at least one second data feed of the plurality of data feeds of the video conference while maintaining a data feed bandwidth of the first data feed;

computing, by the electronic processing device and based on the video conference data, a statistical likelihood that a second participant will speak in the video conference; and

identifying, by the electronic processing device, that the statistical likelihood that the second participant will speak in the video conference is below a predetermined threshold.

2. The video conferencing system hosting the dynamically customized video conference of claim 1 , wherein the data feeds comprise video feeds and wherein the reducing of the data feed bandwidth of at least one second data feed of the plurality of data feeds of the video conference while maintaining a data feed bandwidth of the first data feed, comprises at least one of:

(a) reducing a frame rate of the video feeds;

(b) freezing the video feeds;

(c) reducing a resolution of the video feeds;

(d) reducing a bit depth of color of the video feeds;

(e) cropping the video feeds;

(f) increasing video compression of the video feeds; and

(g) eliminating an audio channel from the video feeds.

3. The video conferencing system hosting the dynamically customized video conference of claim 1 , wherein the processing instructions, when executed by the electronic processing device, further result in:

identifying, by the electronic processing device and based on the first arrangement of the plurality of data feeds of the video conference and the focus of the first participant, a first location of the focus of the participant in the first arrangement;

identifying, by the electronic processing device and based on the first arrangement of the plurality of data feeds of the video conference, a second location of the at least one second data feed of the plurality of data feeds of the video conference;

identifying, by the electronic processing device and based on the first arrangement of the plurality of data feeds of the video conference, a third location of a third data feed of the plurality of data feeds of the video conference;

computing, by the electronic processing device, a first distance between the first location and the second location; and

computing, by the electronic processing device, a second distance between the first location and the third location.

4. The video conferencing system hosting the dynamically customized video conference of claim 3 , wherein the reducing of the data feed bandwidth of the at least one second data feed of the plurality of data feeds of the video conference while maintaining a data feed bandwidth of the first data feed, comprises:

reducing, by the electronic processing device and based on the first distance, the data feed bandwidth of the at least one second data feed of the plurality of data feeds of the video conference by a first amount; and

reducing, by the electronic processing device and based on the second distance, a data feed bandwidth of the third data feed of the plurality of data feeds of the video conference by a second amount.

5. The video conferencing system hosting the dynamically customized video conference of claim 1 , wherein the first arrangement comprises a top portion and a bottom portion, wherein the first data feed of the plurality of data feeds of the video conference is in the bottom portion, and wherein the processing instructions, when executed by the electronic processing device, further result in:

altering, by the electronic processing device, the first arrangement by moving the first data feed of the plurality of data feeds of the video conference into the top portion.

6. The video conferencing system hosting the dynamically customized video conference of claim 5 , wherein the altering of the first arrangement further comprises:

altering, by the electronic processing device, the first arrangement by moving the at least one second data feed of the plurality of data feeds of the video conference into the bottom portion.

7. The video conferencing system hosting the dynamically customized video conference of claim 1 , wherein the reducing of the data feed bandwidth of the at least one second data feed of the plurality of data feeds of the video conference while maintaining the data feed bandwidth of the first data feed, is conducted in response to a detection of an audio volume exceeding a threshold level in the at least one second data feed of the plurality of data feeds of the video conference.

8. The video conferencing system hosting the dynamically customized video conference of claim 1 , wherein the reducing of the data feed bandwidth of the at least one second data feed of the plurality of data feeds of the video conference while maintaining the data feed bandwidth of the first data feed, is conducted in response to a detection of a gesture in a video feed of the at least one second data feed of the plurality of data feeds of the video conference.

9. The video conferencing system hosting the dynamically customized video conference of claim 1 , wherein the reducing of the data feed bandwidth of the at least one second data feed of the plurality of data feeds of the video conference while maintaining the data feed bandwidth of the first data feed, is conducted in response to the identifying that the statistical likelihood that the second participant will speak in the video conference is below a predetermined threshold.

10. The video conferencing system hosting the dynamically customized video conference of claim 1 , wherein the predetermined threshold comprises five percent.

11. The video conferencing system hosting the dynamically customized video conference of claim 1 , wherein the statistical likelihood is computed for a predetermined time period extending from a current time to a time five minutes later.

12. The video conferencing system hosting the dynamically customized video conference of claim 1 , wherein computing the statistical likelihood includes:

determining an elapsed time of the video conference; and

determining a number of times that the second participant has previously spoken during the video conference.

13. The video conferencing system hosting the dynamically customized video conference of claim 1 , wherein identifying a first data feed that has the focus of the first participant includes:

determining, at a first time, an action exhibited by a second participant featured in the first data feed; and

determining, at a second time shortly after the first time, a reaction exhibited by the first participant.

14. The video conferencing system hosting the dynamically customized video conference of claim 13 , wherein the reaction is one of: (a) waving; and (b) sitting up straight.

15. The video conferencing system of claim 1 wherein the processing instructions, when executed by the electronic processing device, further result in:

determining, by the electronic processing device, that first data feed has the focus of a second participant,

wherein reducing the data feed bandwidth of the at least one second data feed is performed in response to the determination that the first data feed has the focus of both the first and second participants.

16. The video conferencing system of claim 1 wherein the at least one second data feed is a side channel for text-based communication, and wherein reducing the data feed bandwidth includes terminating the side channel.

17. The video conferencing system of claim 1 further comprising a headset worn by a second participant, wherein reducing a data feed bandwidth of at least one second data feed includes:

identifying that the second participant is featured in the at least one second data feed;

replacing a live video feed of the second participant with an avatar representation of the second participant;

detecting a signal from the headset indicative of a motion of the headset;

determining a first motion of the second participant's head that is consistent with the signal; and

causing the avatar to exhibit a head motion that reflects the determined first motion.

18. A video conferencing system hosting a dynamically customized video conference, comprising:

an electronic processing device;

a non-transitory memory device in communication with the electronic processing device, the non-transitory memory device storing (i) video conference data, (ii) participant display device data, and (iii) processing instructions that, when executed by the electronic processing device, result in:

identifying, by the electronic processing device and based on the video conference data, a plurality of data feeds of a video conference;

identifying, by the electronic processing device and based on a first subset of the participant display device data corresponding to a first display device of a first participant in the video conference, a first arrangement of the plurality of data feeds of the video conference;

identifying, by the electronic processing device, a first data feed of the plurality of data feeds of the video conference that has a first detectable audio volume;

identifying, by the electronic processing device, and concurrently to the identification of the first data feed, a second data feed of the plurality of data feeds of the video conference that has a second detectable audio volume;

determining a first technical condition associated with the first data feed;

determining a second technical condition associated with the second data feed;

determining that the first technical condition is more favorable than the second technical condition;

reducing, by the electronic processing device, and in response to the determination that the first technical condition is more favorable than the second technical condition, a data feed bandwidth of the second data feed while maintaining a data feed bandwidth of the first data feed;

computing, by the electronic processing device and based on the video conference data, a statistical likelihood that a second participant will speak in the video conference; and

identifying, by the electronic processing device, that the statistical likelihood that the second participant will speak in the video conference is below a predetermined threshold.

19. The video conferencing system of claim 18 wherein the processing instructions, when executed by the electronic processing device, further result in:

determining, based on the identification of the first data feed having a detectable audio volume, that a first participant featured in the first data feed is speaking.

20. The video conferencing system of claim 18 wherein the first technical condition is a first lag for the first data feed, the second technical condition is a second lag for the second data feed, and wherein determining that the first technical condition is more favorable than the second technical condition includes determining that the first lag is lower than the second lag.

21. The video conferencing system of claim 18 wherein the first technical condition is a first background noise level for the first data feed, the second technical condition is a second background noise level for the second data feed, and wherein determining that the first technical condition is more favorable than the second technical condition includes determining that the first background noise level is lower than the second background noise level.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2023
From: JORASCH, JAMES; WERNER, MICHAEL; GELMAN, GEOFFREY; HOCK, ISAAC W.; RENDINO, GENNARO; CAPOBIANCO, CHRISTOPHER
To: SCIENCE HOUSE LLC
Reel/Frame 063049/0681 →
Continuity (3)
Division 17353692 · Jun 21, 2021
Provisional Application 63041821 · Jun 20, 2020
Related Publication 20230254412A1 · Aug 10, 2023
Cited By (2)
US 12,481,733 US 12,682,995