IP Library Granted Patent US 12,401,854
Granted Patent B2
US 12,401,854 · App. 18/161,358 · Granted Aug 26, 2025

Notification of manipulations in communication sessions

Inventor: Alexander Waibel (Sammamish, WA)
Assignee: Zoom Communications, Inc.
H04N21/47205H04N21/4788
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,401,854
App. No.
18/161,358
Granted
Aug 26, 2025
Kind
B2
Abstract

A manipulation of a media stream associated with a manipulated participant of a communication session is identified. A notification of the manipulation is transmitted to a first participant of the communication session. An approval indication of the manipulation is received from the first participant. A determination is made that the approval indication indicates a disapproval of the manipulation. A request to disable the manipulation is transmitted to a second participant of the communication session.

Claims (74)

1. A method implemented by a conferencing server, comprising:

receiving a query from a first participant of a communication session regarding whether a media stream corresponding to a manipulated participant of the communication session is manipulated;

transmitting an approval request to the manipulated participant seeking permission from the manipulated participant to reply to the query with whether the media stream is manipulated;

receiving, in response to the approval request, a permission to reply to the query;

identifying a manipulation of the media stream, wherein the manipulation comprises at least one of an accent reduction manipulation or a language translation manipulation;

transmitting, in response to the query, a notification of the manipulation to the first participant;

prompting the first participant to approve or disapprove the manipulation;

receiving, based on the prompting, an approval indication of the manipulation from the first participant;

determining that the approval indication indicates a disapproval of the manipulation; and

transmitting a request to disable the manipulation to the manipulated participant of the communication session.

2. The method of claim 1 , wherein the manipulation is enabled by the manipulated participant.

3. The method of claim 1 , further comprising:

in response to the manipulation not being disabled, disconnecting the manipulated participant from the communication session.

4. The method of claim 1 , wherein the notification of the manipulation includes a degree of the manipulation.

5. The method of claim 1 , wherein identifying the manipulation of the media stream associated with the manipulated participant of the communication session comprises:

obtaining initial images from a camera of a device of the manipulated participant;

obtaining an initial feature based on the initial images;

obtaining current images from the media stream;

obtaining a current feature from the current images; and

obtaining a match score by comparing the initial feature to the current feature.

6. The method of claim 1 , wherein transmitting the notification of the manipulation to the first participant of the communication session comprises:

obtaining initial voice samples from a microphone of a device of the manipulated participant;

obtaining an initial feature based on the initial voice samples;

obtaining current voice samples from the media stream;

obtaining a current feature from the current voice samples; and

obtaining a match score by comparing the initial feature to the current feature.

7. A device, comprising:

a memory; and

a processor, the processor configured to execute instructions stored in the memory to:

receive a query from a first participant of a communication session regarding whether a media stream corresponding to a manipulated participant of the communication session is manipulated;

transmit an approval request to the manipulated participant seeking permission from the manipulated participant to reply to the query with whether the media stream is manipulated;

receive, in response to the approval request, a permission to reply to the query;

identify a manipulation of the media stream, wherein the manipulation comprises at least one of an accent reduction manipulation or a language translation manipulation;

transmit, in response to the query, a notification of the manipulation to the first participant;

prompt the first participant to approve or disapprove the manipulation;

receive, based on the prompt, an approval indication of the manipulation from the first participant;

determine that the approval indication indicates a disapproval of the manipulation; and

transmit a request to disable the manipulation to the manipulated participant of the communication session.

8. The device of claim 7 , wherein the manipulation is enabled by the manipulated participant.

9. The device of claim 7 , wherein the processor is further configured to execute instructions stored in the memory to:

in response to the manipulation not being disabled, disconnect the manipulated participant from the communication session.

10. The device of claim 7 , wherein the notification of the manipulation comprises a degree of the manipulation.

11. The device of claim 7 , wherein the instructions to identify the manipulation of the media stream associated with the manipulated participant of the communication session comprise instructions to:

obtain initial images from a camera of a device of the manipulated participant;

obtain an initial feature based on the initial images;

obtain current images from the media stream;

obtain a current feature from the current images; and

obtain a match score by comparing the initial feature to the current feature.

12. The device of claim 7 , wherein the instructions to transmit the notification of the manipulation to the first participant of the communication session comprise instructions to:

obtain initial voice samples from a microphone of a device of the manipulated participant;

obtain an initial feature based on the initial voice samples;

obtain current voice samples from the media stream;

obtain a current feature from the current voice samples; and

obtain a match score by comparing the initial feature to the current feature.

13. A non-transitory computer-readable storage medium of a conferencing server storing instructions operable to cause one or more processors to perform operations, comprising:

receiving a query from a first participant of a communication session regarding whether a media stream corresponding to a manipulated participant of the communication session is manipulated;

transmitting an approval request to the manipulated participant seeking permission from the manipulated participant to reply to the query with whether the media stream is manipulated;

receiving, in response to the approval request, a permission to reply to the query;

identifying a manipulation of the media stream, wherein the manipulation comprises at least one of an accent reduction manipulation or a language translation manipulation;

transmitting, in response to the query, a notification of the manipulation to the first participant;

prompting the first participant to approve or disapprove the manipulation;

receiving, based on the prompting, an approval indication of the manipulation from the first participant;

determining that the approval indication indicates a disapproval of the manipulation; and

transmitting a request to disable the manipulation to the manipulated participant of the communication session.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the manipulation is enabled by the manipulated participant, the first participant is a participant other than the manipulated participant.

15. The non-transitory computer-readable storage medium of claim 13 , wherein the operations further comprise:

in response to the manipulation not being disabled, disconnecting the manipulated participant from the communication session.

16. The non-transitory computer-readable storage medium of claim 13 , wherein the notification of the manipulation comprises a degree of the manipulation.

17. The non-transitory computer-readable storage medium of claim 13 , wherein transmitting the notification of the manipulation to the first participant of the communication session comprises:

obtaining initial media from a device of the manipulated participant, wherein the initial media comprises at least one of initial images or initial voice samples;

obtaining an initial feature based on the initial media;

obtaining current media from the media stream;

obtaining a current feature from the current media; and

obtaining a match score by comparing the initial feature to the current feature.

Assignments (2)
CHANGE OF NAME Recorded Jan 7, 2025
From: ZOOM VIDEO COMMUNICATIONS, INC.
To: ZOOM COMMUNICATIONS, INC.
Reel/Frame 069839/0593 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2023
From: WAIBEL, ALEXANDER
To: ZOOM VIDEO COMMUNICATIONS, INC.
Reel/Frame 062531/0738 →
Continuity (1)
Related Publication 20240259636A1 · Aug 1, 2024
References Cited (33)
US 10019561B1 · Shelton et al. · 2018 [cited by applicant]
US 11594032B1 · Raman · 2023 [cited by examiner]
US 20010056468A1 · Okayasu · 2001 [cited by examiner]
US 20080118042A1 · Hogg · 2008 [cited by applicant]
US 20100228656A1 · Wasserblat et al. · 2010 [cited by applicant]
US 20100305960A1 · Gutierrez et al. · 2010 [cited by applicant]
US 20120262296A1 · Bezar · 2012 [cited by applicant]
US 20130162752A1 · Herz et al. · 2013 [cited by applicant]
US 20130216029A1 · Pawlewski · 2013 [cited by applicant]
US 20140330563A1 · Faians et al. · 2014 [cited by applicant]
US 20180342121A1 · Borgmeyer · 2018 [cited by applicant]
US 20210037128A1 · Breuer et al. · 2021 [cited by applicant]
US 20210193174A1 · Enzinger et al. · 2021 [cited by applicant]
US 20210209388A1 · Ciftci et al. · 2021 [cited by applicant]
US 20210358503A1 · Keret et al. · 2021 [cited by applicant]
US 20220021724A1 · Sivakumar · 2022 [cited by examiner]
US 20220083634A1 · Chen · 2022 [cited by applicant]
US 20230208966A1 · Zheng · 2023 [cited by examiner]
US 20230359719A1 · Summerfield · 2023 [cited by applicant]
US 20230388440A1 · Chen · 2023 [cited by examiner]
US 20230402041A1 · Headings et al. · 2023 [cited by applicant]
US 20240021211A1 · Deole · 2024 [cited by examiner]
US 20240097925A1 · Palamadai · 2024 [cited by examiner]
US 20240163367A1 · Frommelt et al. · 2024 [cited by applicant]
US 20240195904A1 · Min et al. · 2024 [cited by applicant]
US 20240220592A1 · Kunin et al. · 2024 [cited by applicant]
New method detects deepfake videos with up to 99% accuracy, University of California, Riverside, Holly Ober, https://news.ucr.edu/articles/2022/05/03/new-method-detects-deepfake-videos-99-accuracy, May 3, 2022, 4 pages. [cited by applicant]
Detection and Localization of Facial Expression Manipulations, University of California, Riverside, Ghazel Mazaheri and Amit K. Roy-Chowdhury, 2022, 11 pages. [cited by applicant]
Detect Fakes, Attention Check, MIT Media Lab, https://detectfakes.media.mit.edu/, Jan. 2023, 1 page. [cited by applicant]
Detect DeepFakes: How to counteract misinformation created by AI, MIT Meida Lab, https://www.media.mit.edu/projects/detect-fakes/overview/, Jan. 2023, 6 pages. [cited by applicant]
Using AI to Detect Seemingly Perfect Deep-Fake Videos, Standord University, https://hai.stanford.edu/news/using-ai-detect-seemingly-perfect-deep-fake-videos, Edmund L. Andrews, Oct. 13, 2020, 5 pages. [cited by applicant]
Detecting Deepfake Video Calls Through Monitor Illumination, Unite.AI, https://www.unite.ai/detecting-deepfake-video-calls-through-monitor-illumination/, Martin Anderson, Dec. 9, 2022, 7 pages. [cited by applicant]
FakeBuster: A DeepFakes Detection Tool for Video Conferencing Scenarios, Cornell University, https://arxiv.org/abs/2101.03321, Vineet Mehta et al., Jan. 9, 2021, 4 pages. [cited by applicant]