IP Library Granted Patent US 12,288,416
Granted Patent B2
US 12,288,416 · App. 18/489,651 · Granted Apr 29, 2025

Secure biometric metadata generation

Inventors: Jonathan Mumm (Marina del Rey, CA); Donald Holly (Venice, CA); Faisal Alqadi (Santa Monica, CA); Jonathan Brody (Marina Del Rey, CA)
Assignee: Snap Inc.
G06V40/172G06F21/602G06N20/00G06V40/161G06V40/179
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,288,416
App. No.
18/489,651
Granted
Apr 29, 2025
Kind
B2
Abstract

Systems, devices, media and methods are presented for generating biometric image data. In one example, a system accesses a set of images stored on a mobile computing device. The system identifies one or more faces depicted in the set of images and generates a set of face images from the set of images. The system determines a set of positions of a set of facial features depicted within the set of face images and generates a set of biometric reference maps based on the set of positions. The system transmits the set of face images to a reference server and stores the set of biometric reference maps on the mobile computing device.

Claims (56)

1. A method comprising:

accessing a first image stored on a device;

determining a set of positions for a set of facial features depicted within the first image;

generating a set of biometric reference maps by inputting the set of positions for the set of facial features into a machine learning model to receive the set of biometric reference maps from the machine learning model based on the inputted set of positions, wherein the machine learning model is trained to generate biometric reference maps based on face images and positions; and

applying the set of biometric reference maps on a second image.

2. The method of claim 1 , further comprising:

accessing a set of images, wherein the set of images comprises the first image; and

determining a set of positions for a set of facial features depicted within the set of images, wherein generating the set of biometric reference maps is based on the inputting of the set of positions.

3. The method of claim 1 , further comprising:

identifying one or more faces depicted in a set of images; and

generating a set of face images from the set of images based on facial features determined for each face of the one or more faces.

4. The method of claim 3 , wherein each face image in the set of face images comprising a face that is aligned within one or more boundaries of the face image.

5. The method of claim 3 , further comprising:

determining the facial features of each face of the one or more faces depicted in the set of images.

6. The method of claim 3 , further comprising:

transmitting the set of face images to a reference server.

7. The method of claim 6 , further comprising removing the set of face images from the device in response to transmitting the set of face images to the reference server.

8. The method of claim 3 , wherein generating the set of face images from the set of images further comprising:

generating a set of thumbnail images, wherein each thumbnail image includes a single face.

9. The method of claim 3 , wherein generating the set of face images from the set of images further comprising:

for each image in the set of images,

determining whether a number of facial features depicted in the image exceeds a predetermined threshold value; and

in response to determining that the number of facial features depicted in the image does not exceed the predetermined threshold value, disregarding a face depicted in the image.

10. The method of claim 3 , wherein identifying the one or more faces in the set of images further comprises:

identifying a set of coordinates associated with the one or more faces in the set of images, and

generating one or more bounding boxes around each face of the one or more faces.

11. The method of claim 1 , further comprising:

transmitting the set of biometric reference maps to a reference server.

12. The method of claim 1 , further comprising:

storing the set of biometric reference maps on the device.

13. The method of claim 12 , wherein storing the set of biometric reference maps further comprises:

encrypting the set of biometric reference maps to generate an encrypted set of biometric reference maps; and

storing the encrypted set of biometric reference maps on the device.

14. The method of claim 1 , wherein generating the set of biometric reference maps further comprises:

analyzing the set of face images and the set of positions using a machine learning model trained to identify the faces depicted in the face images.

15. A system comprising:

one or more processors; and

a non-transitory processor-readable storage medium storing processor executable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

accessing a first image stored on a device;

determining a set of positions for a set of facial features depicted within the first image;

generating a set of biometric reference maps by inputting the set of positions for the set of facial features into a machine learning model to receive the set of biometric reference maps from the machine learning model based on the inputted set of positions, wherein the machine learning model is trained to generate biometric reference maps based on face images and positions; and

applying the set of biometric reference maps on a second image.

16. The system of claim 15 , the operations further comprising:

accessing a set of images, wherein the set of images comprises the first image; and

determining a set of positions for a set of facial features depicted within the set of images, wherein generating the set of biometric reference maps is based on the inputting of the set of positions.

17. The system of claim 15 , the operations further comprising:

identifying one or more faces depicted in a set of images; and

generating a set of face images from the set of images based on facial features determined for each face of the one or more faces.

18. The system of claim 17 , wherein each face image in the set of face images comprising a face that is aligned within one or more boundaries of the face image.

19. The system of claim 17 , wherein comprising:

determining the facial features of each face of the one or more faces depicted in the set of images.

20. A non-transitory processor-readable storage medium storing processor executable instructions that, when executed by a processor of a machine, cause the machine to perform operations comprising:

accessing a first image stored on a device;

determining a set of positions for a set of facial features depicted within the first image;

generating a set of biometric reference maps by inputting the set of positions for the set of facial features into a machine learning model to receive the set of biometric reference maps from the machine learning model based on the inputted set of positions, wherein the machine learning model is trained to generate biometric reference maps based on face images and positions; and

applying the set of biometric reference maps on a second image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 18, 2023
From: MUMM, JONATHAN; HOLLY, DONALD; ALQADI, FAISAL; BRODY, JONATHAN
To: SNAP INC.
Reel/Frame 065272/0966 →
Continuity (4)
Continuation 17662524 · May 9, 2022
Continuation 16394792 · Apr 25, 2019
Provisional Application 62662562 · Apr 25, 2018
Related Publication 20240046697A1 · Feb 8, 2024
References Cited (20)
US 11328153B1 · Mumm et al. · 2022 [cited by applicant]
US 20120250950A1 · Papakipos et al. · 2012 [cited by applicant]
US 20140289595A1 · Park et al. · 2014 [cited by applicant]
US 20140358954A1 · Kocher et al. · 2014 [cited by applicant]
US 20160232402A1 · Jiang · 2016 [cited by applicant]
US 20170069056A1 · Sachs · 2017 [cited by examiner]
US 20170091774A1 · White · 2017 [cited by applicant]
US 20170316598A1 · Wang et al. · 2017 [cited by applicant]
US 20190149767A1 · Turbell · 2019 [cited by applicant]
US 20220375260A1 · Mumm et al. · 2022 [cited by applicant]
JP 2007521577A · 2007 [cited by applicant]
“U.S. Appl. No. 16/394,792, Non Final Office Action mailed Aug. 5, 2020”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 16/394,792, Notice of Allowance mailed Jan. 12, 2022”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 16/394,792, Notice of Allowance mailed Jan. 25, 2021”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 16/394,792, Notice of Allowance mailed May 10, 2021”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 16/394,792, Response filed Jan. 5, 2021 to Non Final Office Action mailed Aug. 5, 2020”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/662,524, Non Final Office Action mailed Mar. 2, 2023”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 17/662,524, Notice of Allowance mailed Jun. 27, 2023”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 17/662,524, Preliminary Amendment Filed Aug. 12, 2022”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 17/662,524, Response filed May 25, 2023 to Non Final Office Action mailed Mar. 2, 2023”, 11 pgs. [cited by applicant]