IP Library Granted Patent US 12,670,567
Granted Patent B2
US 12,670,567 · App. 18/300,432 · Granted Jun 30, 2026

Video conference appearance validation and remediation

Inventors: Zachary A. Silverstein (Georgetown, TX); Melanie Dauber (Oceanside, NY); Jacob Ryan Jepperson (St. Paul, MN); Jeremy R. Fox (Georgetown, TX); Spencer Thomas Reynolds (Austin, TX)
Assignee: International Business Machines Corporation
G06T7/0002G06T5/77G06T2207/10016G06T2207/20081G06T2207/20084G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,670,567
App. No.
18/300,432
Granted
Jun 30, 2026
Kind
B2
Abstract

An approach for preventing anomalous appearance characteristics of a user during a video conference. The approach receives a user's video feed from a video conference comprising the user's video feed. The approach analyzes the user's video feed based on a comparison with a reference appearance model associated with the user. The approach detects, based on the analysis, anomalous appearance characteristics associated with the user. The approach notifies the user of the anomalous appearance.

Claims (54)

1 . A computer-implemented method for preventing anomalous appearance characteristics of a user during a video conference, the computer-implemented method comprising:

receiving, by one or more processors, a user's video feed from a video conference comprising the user's video feed and meeting data, wherein the meeting data comprises of emails, text messages and verbal communications;

creating, by a recurrent neural network (RNN), a reference appearance model of the user based on historical video appearances and user defined preferences;

training the reference appearance model, by the recurrent neural network (RNN), based on the user's video feed;

analyzing, by the recurrent neural network (RNN), the user's video feed based on a comparison with the reference appearance model associated with the user;

determining whether the video conference is a formal meeting or an informal meeting, wherein the formal meeting is a meeting that is associated with presenting a professional appearance for the user and is determined by executing a pre-meeting evaluation function;

in response to having determined that the video conference is the formal meeting, selecting a pre-meeting evaluation function to be performed on the user's video feed to validate the professional appearance of the user, where in the pre-meeting evaluation function further comprising:

comparing the user's video feed against the reference appearance model based on a predetermined threshold to determine a standard deviation of formality;

detecting, anomalous appearance characteristics associated with the user, wherein the anomalous appearance characteristics is characteristics that is outside the predetermined threshold of a professional image model;

notifying, by the one or more processors, the user of an anomalous appearance, wherein the anomalous appearance is an appearance that is outside a predetermined threshold of the professional image model; and

in response to having determined that the video conference is the informal meeting, detecting, by using a natural language processing (NLP) technique, informal data from the meeting data and removing of formal data associated with the reference appearance model.

2 . The computer-implemented method of claim 1 , wherein the reference appearance model is trained with a recurrent neural network.

3 . The computer-implemented method of claim 1 , further comprising:

executing, by the one or more processors, remedial actions comprising at least one of obfuscation of the anomalous appearance characteristics or feed manipulation of the user's feed to eliminate the anomalous appearance characteristics.

4 . The computer-implemented method of claim 1 , wherein the reference appearance model is trained based on at least one of verbal communication or messaging associated with the video conference.

5 . The computer-implemented method of claim 1 , wherein the reference appearance model is trained based on user reaction to notification of the anomalous appearance.

6 . The computer-implemented method of claim 1 , wherein the reference appearance model is selected based on attendees of a video conference.

7 . A computer program product for preventing anomalous appearance characteristics of a user during a video conference, the computer program product comprising:

one or more non-transitory computer readable storage media and program instructions stored on the one or more non-transitory computer readable storage media, the program instructions comprising:

program instructions to receive a user's video feed from a video conference comprising the user's video feed and meeting data, wherein the meeting data comprises of emails, text messages and verbal communications;

program instructions to create, by a recurrent neural network (RNN), a reference appearance model of the user based on historical video appearances and user defined preferences;

program instructions to train the reference appearance model, by the recurrent neural network (RNN), based on the user's video feed;

program instructions to analyze, by the recurrent neural network (RNN), the user's video feed based on a comparison with the reference appearance model associated with the user;

program instructions to determine whether the video conference is a formal meeting or an informal meeting, wherein the formal meeting is a meeting that is associated with presenting a professional appearance for the user and is determined by executing a pre-meeting evaluation function;

in response to having determined that the video conference is the formal meeting, program instructions to select a pre-meeting evaluation function to be performed on the user's video feed to validate the professional appearance of the user, wherein the pre-meeting evaluation function further comprising:

program instructions to compare the user's video feed against the reference appearance model based on a predetermined threshold to determine a standard deviation of formality;

program instructions to detect, anomalous appearance characteristics associated with the user, wherein the anomalous appearance characteristics is characteristics that is outside the predetermined threshold of a professional image model;

program instructions to notify the user of the anomalous appearance, wherein the anomalous appearance is an appearance that is outside a predetermined threshold of the professional image model; and

in response to having determined that the video conference is the informal meeting, program instructions to detect, by using a natural language processing (NLP) technique, informal data from the meeting data and removing of formal data associated with the reference appearance model.

8 . The computer program product of claim 7 , wherein the reference appearance model is trained with a recurrent neural network.

9 . The computer program product of claim 7 , further comprising:

program instructions to execute remedial actions comprising at least one of obfuscation of the anomalous appearance characteristics or feed manipulation of the user's feed to eliminate the anomalous appearance characteristics.

10 . The computer program product of claim 7 , wherein the reference appearance model is trained based on at least one of verbal communication or messaging associated with the video conference.

11 . The computer program product of claim 7 , wherein the reference appearance model is trained based on user reaction to notification of the anomalous appearance.

12 . The computer program product of claim 7 , wherein the reference appearance model is selected based on attendees of a video conference.

13 . A computer system for preventing anomalous appearance characteristics of a user during a video conference, the computer system comprising:

one or more computer processors;

one or more non-transitory computer readable storage media; and

program instructions stored on the one or more non-transitory computer readable storage media, the program instructions comprising:

program instructions to receive a user's video feed from a video conference comprising the user's video feed and meeting data, wherein the meeting data comprises of emails, text messages and verbal communications;

program instructions to create, by a recurrent neural network (RNN), a reference appearance model of the user based on historical video appearances and user defined preferences;

program instructions to train the reference appearance model, by the recurrent neural network (RNN), based on the user's video feed;

program instructions to analyze, by the recurrent neural network (RNN), the user's video feed based on a comparison with the reference appearance model associated with the user;

program instructions to determine whether the video conference is a formal meeting or an informal meeting, wherein the formal meeting is a meeting that is associated with presenting a professional appearance for the user and is determined by executing a pre-meeting evaluation function;

in response to having determined that the video conference is the formal meeting, program instructions to select a pre-meeting evaluation function to be performed on the user's video feed to validate the professional appearance of the user, wherein the pre-meeting evaluation function further comprising:

program instructions to compare the user's video feed against the reference appearance model based on a predetermined threshold to determine a standard deviation of formality;

program instructions to detect, anomalous appearance characteristics associated with the user, wherein the anomalous appearance characteristics is characteristics that is outside the predetermined threshold of a professional image model;

program instructions to notify the user of the anomalous appearance, wherein the anomalous appearance is an appearance that is outside a predetermined threshold of the professional image model; and

in response to having determined that the video conference is the informal meeting, program instructions to detect, by using a natural language processing (NLP) technique, informal data from the meeting data and removing of formal data associated with the reference appearance model.

14 . The computer system of claim 13 , wherein the reference appearance model is trained with a recurrent neural network.

15 . The computer system of claim 13 , further comprising:

program instructions to execute remedial actions comprising at least one of obfuscation of the anomalous appearance characteristics or feed manipulation of the user's feed to eliminate the anomalous appearance characteristics.

16 . The computer system of claim 13 , wherein the reference appearance model is trained based on user reaction to notification of the anomalous appearance and based on at least one of verbal communication or messaging associated with the video conference.

17 . The computer system of claim 13 , wherein the reference appearance model is selected based on attendees of a video conference.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2023
From: SILVERSTEIN, ZACHARY A.; DAUBER, MELANIE; JEPPERSON, JACOB RYAN; FOX, JEREMY R.; REYNOLDS, SPENCER THOMAS
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 063321/0638 →
Continuity (1)
Related Publication 20240346635A1 · Oct 17, 2024
References Cited (18)
US 7564476B1 · Coughlan · 2009 [cited by examiner]
US 9361469B2 · Thiyagarajan et al. · 2016 [cited by applicant]
US 10402655B2 · Javan-Roshtkhari et al. · 2019 [cited by applicant]
US 11350059B1 · Swierk et al. · 2022 [cited by applicant]
US 20200143842A1 · Doumbouya et al. · 2020 [cited by applicant]
US 20200401811A1 · Yu · 2020 [cited by examiner]
US 20220295012A1 · Swierk · 2022 [cited by examiner]
CA 2953394C · 2015 [cited by applicant]
CN 104361716A · 2015 [cited by applicant]
CN 114005153A · 2022 [cited by applicant]
“Amazon Rekognition Image”, AWS, downloaded from the Internet on Jan. 26, 2023, 6 pages, <https://aws.amazon.com/rekognition/image-features/>. [cited by applicant]
“Video Conferencing Market Size, Share, Trends & Growth [2029]”, Fortune Business Insights, Hardware & Software IT Services, downloaded from the Internet on Jan. 26, 2023, 10 pages, <https://www.fortunebusinessinsights.… [cited by applicant]
“A System for Detecting Appropriate Dress Code in Virtual Meeting”, An IP.com Prior Art Database Technical Disclosure, Authors et. al.: Disclosed Anonymously, IP.com No. IPCOM000257923D, IP.com Electronic Publication Da… [cited by applicant]
“Hand Mirror: A one-click camera check, right from the menu bar”, downloaded from the Internet on Jan. 26, 2023, 9 pages, <https://handmirror.app>. [cited by applicant]
Bailey, Lily, “Worried About Doing Something Embarrassing on Zoom? The fear of doing something inappropriate or awkward during a video call.”, Because We Are Bad, psychologytoday.com, posted Sep. 15, 2020, 9 pages. [cited by applicant]
IBM, “Live event streaming solution”, IBM Watson Media, downloaded from the Internet on Jan. 26, 2023, <https://www.ibm.com/watson/media/live-event-streaming-services>, 7 pages. [cited by applicant]
Peters, Jay, “This handy Mac app is a one-click way to check how you look before your next video call: Make sure there's no spinach in your teeth”, TECH/APPLE/MACOS, theverge.com, published online Mar. 19, 2020, 5 pages. [cited by applicant]
Ustik, Georgina, “Stop embarrassing yourself in Zoom calls—use this app to check your face”, thenextweb.com, posted online on Nov. 26, 2020, 6 pages. [cited by applicant]