IP Library Granted Patent US 12,282,981
Granted Patent B2
US 12,282,981 · App. 17/932,072 · Granted Apr 22, 2025

Augmentation for web conference participants

Inventors: Su Liu (Austin, TX); Jill S. Dhillon (Laguna Niguel, CA); Luis Osvaldo Pizana (Austin, TX); Yang Liang (Beijing, CN)
Assignee: International Business Machines Corporation
G06T11/00G06T7/11G06V20/41G10L17/02G10L25/57H04L65/403G06T2207/10016G06T2207/20021G06T2207/20092G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,282,981
App. No.
17/932,072
Granted
Apr 22, 2025
Kind
B2
Abstract

Aspects of the present disclosure relate to augmentation for web conference participants. An augmentation rule set defining mappings between augmentations and participant characteristics can be received, where the augmentation rule set is implemented for a web conference to determine augmentations to apply onto participant video feeds within the web conference. A plurality of participants within the web conference can be identified. The web conference can be analyzed to determine participant characteristics of each participant of the plurality within the web conference. Augmentation can be applied on respective video feeds of each participant according to the augmentation rule set based on the determined characteristics of each participant.

Claims (36)

1. A method comprising:

receiving a first augmentation rule set defining a first set of mappings between augmentations and participant characteristics and a second augmentation rule set defining a second set of mappings between augmentations and participant characteristics, the first and second augmentation rule sets implemented to determine augmentations to apply onto participant video feeds within web conferences, wherein respective augmentation rule sets are applied to respective web conferences;

identifying a plurality of participants within a web conference, the web conference having a set of web conference characteristics;

determining that the first augmentation rule set should be applied to the web conference instead of the second augmentation rule set based on a web conference meeting identifier (ID) associated with the web conference;

analyzing the web conference to determine participant characteristics of respective participants of the plurality within the web conference; and

applying, within the web conference, augmentations on respective applicable video feeds of respective participants according to the first augmentation rule set based on the determined characteristics of each participant.

2. The method of claim 1 , wherein applying augmentations on respective applicable video feeds of respective participants includes determining a portion of pixels of each respective video feed to modify using image segmentation.

3. The method of claim 1 , wherein the determined characteristics include visual characteristics of participants determined in real-time based on an analysis of the video feeds of each participant.

4. The method of claim 1 , wherein the determined characteristics include audio characteristics of participants determined in real-time based on an analysis of audio data associated with video feeds of each participant.

5. The method of claim 1 , wherein a first augmentation is applied to a first participant video feed based on a first participant associated with the first participant video feed belonging to a first classification.

6. The method of claim 5 , wherein a second augmentation is applied to a second participant video feed based on a second participant associated with the second participant video feed belonging to a second classification.

7. The method of claim 1 , wherein the first augmentation rule set is determined using machine learning based on historical data.

8. A system comprising:

one or more processors; and

one or more computer-readable storage media collectively storing program instructions which, when executed by the one or more processors, are configured to cause the one or more processors to perform a method comprising:

receiving a first augmentation rule set defining a first set of mappings between augmentations and participant characteristics and a second augmentation rule set defining a second set of mappings between augmentations and participant characteristics, the first and second augmentation rule sets implemented to determine augmentations to apply onto participant video feeds within web conferences, wherein respective augmentation rule sets are applied to respective web conferences;

identifying a plurality of participants within a web conference, the web conference having a set of web conference characteristics;

determining that the first augmentation rule set should be applied to the web conference instead of the second augmentation rule set based on a web conference meeting identifier (ID) associated with the web conference;

analyzing the web conference to determine participant characteristics of respective participants of the plurality within the web conference; and

applying, within the web conference, augmentations on respective applicable video feeds of respective participants according to the first augmentation rule set based on the determined characteristics of each participant.

9. The system of claim 8 , wherein applying augmentations on respective applicable video feeds of respective participant includes determining a portion of pixels of each respective video feed to modify using image segmentation.

10. The system of claim 9 , wherein the image segmentation is a machine learning algorithm configured to learn pixel areas to modify for different augmentations to apply within the first augmentation rule set.

11. The system of claim 8 , wherein a first augmentation is applied to a first participant video feed based on a first participant associated with the first participant video feed belonging to a first classification.

12. The system of claim 8 , wherein the first augmentation rule set is mapped to a first set of web conference characteristics and wherein the second augmentation rule set is mapped to a second set of web conference characteristics, wherein the one or more computer-readable storage media collectively store additional program instructions which, when executed by the one or more processors, are configured to cause the one or more processors to perform the method further comprising:

determining that a second web conference hosted at a future time has the first set of web conference characteristics; and

applying the first augmentation rule set to the second web conference instead of the second augmentation rule set based on the second web conference having the first set of web conference characteristics.

13. A computer program product comprising one or more computer readable storage media, and program instructions collectively stored on the one or more computer readable storage media, the program instructions comprising instructions configured to cause one or more processors to perform a method comprising:

receiving a first augmentation rule set defining a first set of mappings between augmentations and participant characteristics and a second augmentation rule set defining a second set of mappings between augmentations and participant characteristics, the first and second augmentation rule sets implemented to determine augmentations to apply onto participant video feeds within web conferences, wherein respective augmentation rule sets are applied to respective web conferences;

identifying a plurality of participants within a web conference, the web conference having a set of web conference characteristics;

determining that the first augmentation rule set should be applied to the web conference instead of the second augmentation rule set based on a web conference meeting identifier (ID) associated with the web conference;

analyzing the web conference to determine participant characteristics of respective participants of the plurality within the web conference; and

applying, within the web conference, augmentations on respective applicable video feeds of respective participants according to the first augmentation rule set based on the determined characteristics of each participant.

14. The computer program product of claim 13 , wherein applying augmentations on respective applicable video feeds of respective participants includes determining a portion of pixels of each respective video feed to modify using image segmentation.

15. The computer program product of claim 14 , wherein the image segmentation is a machine learning algorithm configured to learn pixel areas to modify for different augmentations to apply within the first and second augmentation rule sets.

16. The computer program product of claim 13 , wherein a first augmentation is applied to a first subset of participants of the plurality based on the first subset of participants belonging to a first organization, wherein a second augmentation is applied to a second subset of participants of the plurality based on the second subset of participants belonging to a second organization.

17. The computer program product of claim 13 , wherein a first augmentation is applied to a first participant of the plurality based on the first participant having a first geo-location.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2022
From: LIU, SU; DHILLON, JILL S.; PIZANA, LUIS OSVALDO; LIANG, YANG
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 061092/0817 →
Continuity (1)
Related Publication 20240087177A1 · Mar 14, 2024
References Cited (13)
US 6307568B1 · Rom · 2001 [cited by applicant]
US 9105013B2 · Chavez · 2015 [cited by applicant]
US 10417613B1 · Brisebois · 2019 [cited by examiner]
US 11190735B1 · Trim · 2021 [cited by examiner]
US 20160232941A1 · Cunico · 2016 [cited by applicant]
US 20190287306A1 · Wieser · 2019 [cited by examiner]
US 20220230396A1 · Croxford · 2022 [cited by examiner]
CN 110102048A · 2019 [cited by applicant]
WO 2014074072A1 · 2014 [cited by applicant]
Dai et al., “Clothing Fashion Style Recommendation System”, A Thesis Presented, Northeastern University, Boston Massachusetts, May 2015, 30 Pgs. [cited by applicant]
IBM Watson Media, “Live Event Streaming Solution”, Downloaded Aug. 3, 2022, 9 Pgs, <https://www.ibm.com/watson/media/live-event-streaming-services>. [cited by applicant]
No Author, “Hardware & Software IT Services”, Web Conference Software Market Size, Share Growth Global Report [2027], Report ID: FB1102993, Downloaded Aug. 3, 2022, 9 Pgs, <https://www.fortunebusinessinsights.com/web-co… [cited by applicant]
Yu-Chu et al., “Personalized Clothing-Recommendation System Bases on a Modified Bayesian Network”, 2012 IEEE/IPSJ 12th International Symposium on Applications and the Internet, D01 10.1109/SAINT.2012.75, Downloaded Aug.… [cited by applicant]