IP Library Granted Patent US 12,670,297
Granted Patent B2
US 12,670,297 · App. 18/480,690 · Granted Jun 30, 2026

Privacy protection of digital image data on a social network

Inventor: Daniil Baryshnikov (London, GB)
Assignee: BUMBLE IP HOLDCO LLC
G06F21/84G06F21/6263G06T5/70G06V10/70G06V40/168G06V40/172G06T2207/20081G06T2207/20212G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,670,297
App. No.
18/480,690
Granted
Jun 30, 2026
Kind
B2
Abstract

Methods, systems, and apparatus for privacy protection of digital image data on a social network. In one aspect, a method includes obtaining, from a first client device associated with a first user, digital image data. The first user is one of a plurality of users of a social network. The method includes determining that the digital image data includes an image of multiple unique faces; applying, to the digital image data, a machine learning model configured to identify, among the multiple unique faces, a face of the first user; obscuring, in the digital image data and based on a user preference specifying a mode of obscuring, the multiple unique faces except the face of the first user; storing the digital image data having the obscured faces in a database; and associating the stored digital image data with a profile associated with the first user in the social network.

Claims (65)

1 . A computer-implemented method comprising:

obtaining, from a first client device associated with a first user, digital image data, wherein the first user is one of a plurality of users of a social network;

determining that the digital image data includes an image of multiple unique faces;

applying, to the digital image data, a machine learning model configured to identify, among the multiple unique faces, a face of the first user;

selecting an obscuring mechanism that specifies a type of action to obscure image regions in the digital image data corresponding to the multiple unique faces except the face of the first user based on a preference of the first user;

obscuring, in the digital image data and using the type of action specified by the selected obscured mechanism based on the preference of the first user, the multiple unique faces except the face of the first user on the image regions;

storing the digital image data having the obscured faces in a database;

associating the stored digital image data with a profile associated with the first user in the social network;

obtaining, from the first client device, a plurality of digital image data that include an image of the face of the first user; and

training, based on the plurality of digital image data, the machine learning model configured to extract features representative of the face of the first user.

2 . The computer-implemented method of claim 1 , wherein the digital image data comprise (i) one or more pictures, (ii) one or more videos, or both.

3 . The computer-implemented method of claim 1 , further comprising:

providing, to the first client device and at least some of a plurality of client devices associated with users of the social network, the digital image data.

4 . The computer-implemented method of claim 1 , further comprising:

prompting the first user to take a live selfie; and

verifying an identity of the first user based on the live selfie.

5 . The computer-implemented method of claim 1 , further comprising:

in response to obtaining, from the first client device, feedback data specifying additional faces to be obscured, obscuring the additional faces in the digital image data.

6 . The computer-implemented method of claim 1 , wherein the obscuring mechanism comprises one or more of (i) blurring a face in the image regions in the digital image data and (ii) overlaying a visual representation on pixels indicative of the face in the image regions in the digital image data.

7 . The computer-implemented method of claim 6 , wherein the visual representation comprises one or more of an emoji and a face of the first user.

8 . The computer-implemented method of claim 1 , further comprising:

obtaining, from a second client device associated with a second user, a privacy preference specifying approval to display a face of the second user in the digital image data associated with the profile of the first user; and

obscuring the multiple unique faces in the digital image data except the face of the first user and the face of the second user.

9 . The computer-implemented method of claim 1 , wherein the users of the social network are users matched to the first user on the social network.

10 . The computer-implemented method of claim 1 , wherein each of the digital image data is accompanied with a text caption.

11 . The computer-implemented method of claim 1 , further comprising:

determining that the first user violates a privacy requirement of the social network; and

presenting, to the first client device, a warning indication.

12 . The computer-implemented method of claim 11 , wherein determining that the first user violates the privacy requirement of the social network comprises:

obtaining an indication, from a third client device associated with a third user matched to the first user, that at least one of the digital image data in the profile associated with the first user includes a second face other than the face of the first user; and

determining that the second face does not belong to users who approved usage of their faces to the first user.

13 . The computer-implemented method of claim 1 , further comprising:

applying, to the digital image data, a second machine learning model configured to identify a portion of the digital image data that do not meet one or more safety criteria; and

obscuring, in the digital image data, the portion of the digital image data.

14 . The computer-implemented method of claim 13 , wherein the portion of the digital image data that do not meet the safety criteria comprises age-inappropriate contents.

15 . A system comprising:

one or more processors and one or more storage devices storing instructions that are operable, when executed by the one or more processors, to cause the one or more processors to perform operations comprising:

obtaining, from a first client device associated with a first user, digital image data, wherein the first user is one of a plurality of users of a social network;

determining that the digital image data includes an image of multiple unique faces;

applying, to the digital image data, a machine learning model configured to identify, among the multiple unique faces, a face of the first user;

selecting an obscuring mechanism that specifies a type of action to obscure image regions in the digital image data corresponding to the multiple unique faces except the face of the first user based on a preference of the first user;

obscuring, in the digital image data and using the type of action specified by the selected obscured mechanism based on the preference of the first user, the multiple unique faces except the face of the first user on the image regions;

storing the digital image data having the obscured faces in a database;

associating the stored digital image data with a profile associated with the first user in the social network;

obtaining, from the first client device, a plurality of digital image data that include an image of the face of the first user; and

training, based on the plurality of digital image data, the machine learning model configured to extract features representative of the face of the first user.

16 . The system of claim 15 , further comprising:

prompting the first user to take a live selfie; and

verifying an identity of the first user based on the live selfie.

17 . The system of claim 15 , further comprising:

obtaining, from a second client device associated with a second user, a privacy preference specifying approval to display a face of the second user in the digital image data associated with the profile of the first user; and

obscuring the multiple unique faces in the digital image data except the face of the first user and the face of the second user.

18 . The system of claim 15 , further comprising:

applying, to the digital image data, a second machine learning model configured to identify a portion of the digital image data that do not meet one or more safety criteria; and

obscuring, in the digital image data, the portion of the digital image data.

19 . A non-transitory computer-readable medium, comprising software instructions, that when executed by a computer, cause the computer to execute operations comprising:

obtaining, from a first client device associated with a first user, digital image data, wherein the first user is one of a plurality of users of a social network;

determining that the digital image data includes an image of multiple unique faces;

applying, to the digital image data, a machine learning model configured to identify, among the multiple unique faces, a face of the first user;

selecting an obscuring mechanism that specifies a type of action to obscure image regions in the digital image data corresponding to the multiple unique faces except the face of the first user based on a preference of the first user;

obscuring, in the digital image data and using the type of action specified by the selected obscured mechanism based on the preference of the first user, the multiple unique faces except the face of the first user on the image regions;

storing the digital image data having the obscured faces in a database;

associating the stored digital image data with a profile associated with the first user in the social network;

obtaining, from the first client device, a plurality of digital image data that include an image of the face of the first user; and

training, based on the plurality of digital image data, the machine learning model configured to extract features representative of the face of the first user.

Assignments (5)
PATENT SECURITY AGREEMENT RELEASE, ON ON MAY 24, 2024 AT REEL/FRAME 67529/0483 Recorded May 14, 2026
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: BUMBLE IP HOLDCO LLC
Reel/Frame 075572/0612 →
SECURITY INTEREST Recorded Apr 24, 2026
From: BUMBLE IP HOLDCO LLC; GENEVA TECHNOLOGIES, INC.
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 074472/0485 →
FOURTH PATENT SECURITY AGREEMENT SUPPLEMENT Recorded May 24, 2024
From: BUMBLE IP HOLDCO LLC
To: CITIBANK, N.A.
Reel/Frame 067529/0483 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2024
From: AMI HOLDINGS LIMITED
To: BUMBLE IP HOLDCO LLC
Reel/Frame 066730/0022 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2023
From: BARYSHNIKOV, DANIIL
To: AMI HOLDINGS LIMITED
Reel/Frame 065403/0019 →
Continuity (2)
Provisional Application 63413505 · Oct 5, 2022
Related Publication 20240119184A1 · Apr 11, 2024
References Cited (125)
US 5858139A · Ouderkirk et al. · 1999 [cited by applicant]
US 5993940A · Ouderkirk et al. · 1999 [cited by applicant]
US 6067399A · Berger · 2000 [cited by applicant]
US 7688282B2 · Motoe · 2010 [cited by applicant]
US 7783075B2 · Zhang et al. · 2010 [cited by applicant]
US 7911513B2 · Garrison et al. · 2011 [cited by applicant]
US 8126190B2 · Jung et al. · 2012 [cited by applicant]
US 8571354B2 · Miksa et al. · 2013 [cited by applicant]
US 8610787B2 · Namba et al. · 2013 [cited by applicant]
US 8875034B2 · Roulliere et al. · 2014 [cited by applicant]
US 8922480B1 · Freed et al. · 2014 [cited by applicant]
US 8923647B2 · Kothari · 2014 [cited by applicant]
US 8973149B2 · Buck · 2015 [cited by applicant]
US 9104886B1 · Dolbakian et al. · 2015 [cited by applicant]
US 9124730B2 · Kurabayashi et al. · 2015 [cited by applicant]
US 9124762B2 · Cutler et al. · 2015 [cited by applicant]
US 9235711B1 · Xavier et al. · 2016 [cited by applicant]
US 9313454B2 · Lalonde et al. · 2016 [cited by applicant]
US 9350914B1 · Kaur et al. · 2016 [cited by applicant]
US 9358926B2 · Lambert et al. · 2016 [cited by applicant]
US 9396354B1 · Murphy et al. · 2016 [cited by applicant]
US 9600688B2 · Buck et al. · 2017 [cited by applicant]
US 9600715B2 · Natan et al. · 2017 [cited by applicant]
US 9679194B2 · Ra · 2017 [cited by examiner]
US 9721144B2 · Shuster · 2017 [cited by applicant]
US 9729824B2 · Cutler et al. · 2017 [cited by applicant]
US 9785796B1 · Murphy et al. · 2017 [cited by applicant]
US 9875530B2 · Traff · 2018 [cited by applicant]
US 9911002B2 · Shim et al. · 2018 [cited by applicant]
US 9953187B2 · Rylski · 2018 [cited by applicant]
US 9984729B2 · Steiner · 2018 [cited by applicant]
US 10102543B2 · Holman · 2018 [cited by examiner]
US 10129253B2 · Buscemi · 2018 [cited by applicant]
US 10181178B2 · Cutler · 2019 [cited by applicant]
US 10185841B2 · Holman · 2019 [cited by examiner]
US 10223576B2 · Shuster · 2019 [cited by applicant]
US 10229312B2 · Barnett · 2019 [cited by examiner]
US 10242282B2 · Loce et al. · 2019 [cited by applicant]
US 10289863B2 · Holman et al. · 2019 [cited by applicant]
US 10313638B1 · Yeturu et al. · 2019 [cited by applicant]
US 10346624B2 · Holman · 2019 [cited by examiner]
US 10387675B2 · Adams et al. · 2019 [cited by applicant]
US 10395056B2 · Li · 2019 [cited by examiner]
US 10491558B2 · Morrison et al. · 2019 [cited by applicant]
US 10572681B1 · Murphy et al. · 2020 [cited by applicant]
US 10586070B2 · Cai et al. · 2020 [cited by applicant]
US 10628922B2 · Ra et al. · 2020 [cited by applicant]
US 10657361B2 · Appleyard et al. · 2020 [cited by applicant]
US 10761343B2 · Haseltine et al. · 2020 [cited by applicant]
US 10834290B2 · Holman · 2020 [cited by examiner]
US 10878679B2 · Russell · 2020 [cited by applicant]
US 10885606B2 · Eswara · 2021 [cited by applicant]
US 10915660B2 · Matusek et al. · 2021 [cited by applicant]
US 10915995B2 · Moloney · 2021 [cited by applicant]
US 10990697B2 · Murphy et al. · 2021 [cited by applicant]
US 11049349B2 · Onischuk · 2021 [cited by applicant]
US 11080513B2 · Shuster · 2021 [cited by applicant]
US 11089014B2 · Buscemi · 2021 [cited by applicant]
US 11115627B1 · Drako · 2021 [cited by applicant]
US 11126262B2 · Von Und Zu Liechtenstein et al. · 2021 [cited by applicant]
US 11144659B2 · Grant · 2021 [cited by examiner]
US 11176357B2 · Wang et al. · 2021 [cited by applicant]
US 11270407B2 · Sano et al. · 2022 [cited by applicant]
US 11282174B1 · Demaio · 2022 [cited by applicant]
US 11328095B2 · Bates · 2022 [cited by applicant]
US 11379953B2 · Le Jouan · 2022 [cited by examiner]
US 11600066B2 · Kondabathini · 2023 [cited by examiner]
US 11706381B2 · Guzik · 2023 [cited by examiner]
US 11743064B2 · Cheung · 2023 [cited by examiner]
US 11790051B2 · Denton · 2023 [cited by examiner]
US 11790653B2 · Desai · 2023 [cited by examiner]
US 11800201B2 · Chen · 2023 [cited by examiner]
US 12021844B2 · Courtwright · 2024 [cited by examiner]
US 20030231769A1 · Bolle et al. · 2003 [cited by applicant]
US 20040208394A1 · Kurata · 2004 [cited by applicant]
US 20060081706A1 · Onischuk · 2006 [cited by applicant]
US 20060238380A1 · Kimchi et al. · 2006 [cited by applicant]
US 20070153091A1 · Watlington et al. · 2007 [cited by applicant]
US 20070192176A1 · Onischuk · 2007 [cited by applicant]
US 20080180459A1 · Jung et al. · 2008 [cited by applicant]
US 20080180538A1 · Jung et al. · 2008 [cited by applicant]
US 20080297586A1 · Kurtz et al. · 2008 [cited by applicant]
US 20090228348A1 · Woolston et al. · 2009 [cited by applicant]
US 20090262987A1 · Ioffe · 2009 [cited by examiner]
US 20100241493A1 · Onischuk · 2010 [cited by applicant]
US 20110145150A1 · Onischuk · 2011 [cited by applicant]
US 20130083155A1 · Andresen · 2013 [cited by applicant]
US 20130085815A1 · Onischuk · 2013 [cited by applicant]
US 20130305383A1 · Garralda et al. · 2013 [cited by applicant]
US 20140025443A1 · Onischuk · 2014 [cited by applicant]
US 20140086493A1 · Kothari · 2014 [cited by examiner]
US 20140231512A1 · Onischuk · 2014 [cited by applicant]
US 20140365281A1 · Onischuk · 2014 [cited by applicant]
US 20150012339A1 · Onischuk · 2015 [cited by applicant]
US 20150104103A1 · Candelore · 2015 [cited by applicant]
US 20150113664A1 · Aad et al. · 2015 [cited by applicant]
US 20160132719A1 · Fithian · 2016 [cited by examiner]
US 20160171244A1 · Ur · 2016 [cited by examiner]
US 20160294781A1 · Ninan et al. · 2016 [cited by applicant]
US 20160358013A1 · Carter et al. · 2016 [cited by applicant]
US 20170091822A1 · Tian et al. · 2017 [cited by applicant]
US 20170337652A1 · Sarin · 2017 [cited by examiner]
US 20170353423A1 · Morrison et al. · 2017 [cited by applicant]
US 20180190032A1 · Barnett · 2018 [cited by examiner]
US 20180225477A1 · Deluca et al. · 2018 [cited by applicant]
US 20190080098A1 · Garralda et al. · 2019 [cited by applicant]
US 20190147185A1 · Cai · 2019 [cited by examiner]
US 20190228182A1 · Einecke et al. · 2019 [cited by applicant]
US 20200211162A1 · Ra et al. · 2020 [cited by applicant]
US 20200372792A1 · Li et al. · 2020 [cited by applicant]
US 20200386920A1 · Pham et al. · 2020 [cited by applicant]
US 20210084194A1 · Rakshit et al. · 2021 [cited by applicant]
US 20210303851A1 · Dodson et al. · 2021 [cited by applicant]
US 20210374659A1 · Ganapathi et al. · 2021 [cited by applicant]
US 20210388671A1 · Kirkeby et al. · 2021 [cited by applicant]
US 20220012359A1 · Burceanu et al. · 2022 [cited by applicant]
US 20220012366A1 · Burceanu et al. · 2022 [cited by applicant]
US 20220012471A1 · Yuan et al. · 2022 [cited by applicant]
US 20220109670A1 · Buscemi · 2022 [cited by applicant]
US 20220159175A1 · Vemury · 2022 [cited by applicant]
US 20220159176A1 · Vemury · 2022 [cited by applicant]
US 20220188973A1 · Puttagunta · 2022 [cited by applicant]
WO WO2014028009 · 2014 [cited by applicant]
WO WO2018125762 · 2018 [cited by applicant]
International Search Report and Written Opinion in International Appln. No. PCT/IB2023/059979, mailed on Nov. 17, 2023, 15 pages. [cited by applicant]