IP Library › Granted Patent US 12,469,323
Granted Patent B2
US 12,469,323 · App. 17/951,918 · Granted Nov 11, 2025

Identity recognition utilizing face-associated body characteristics

Inventors: Nitin Gupta (Cupertino, CA); Jingwen Zhu (Santa Clara, CA); Jonghoon Jin (Cupertino, CA); Andrew C. Edwards (Altadena, CA); Floris Chabert (San Francisco, CA); Vinay Sharma (Palo Alto, CA); Hendrik Dahlkamp (Palo Alto, CA)
Assignee: Apple Inc.
G06V40/103G06T7/0002G06V10/751G06V40/172G06T2207/10016G06T2207/30168G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,469,323
App. No.
17/951,918
Granted
Nov 11, 2025
Kind
B2
Abstract

Techniques are disclosed for determining whether to include a bodyprint in a cluster of bodyprints associated with a recognized person. For example, a device performs facial recognition to identify the identity of a first person. The device also identifies and stores physical characteristic information of the first person, the stored information associated with the identity of the first person based on the recognized face. Subsequently, the device receives a second video feed showing an image of a second person whose face is also determined to be recognized by the device. The device then generates a quality score for physical characteristics in the image of the user. The device can then add the image with the physical characteristics to a cluster of images associated with the person if the quality score is above a threshold, or discard the image if not.

Claims (58)

1 . A method, comprising:

maintaining, by a computing device, a plurality of images associated with a person;

receiving, by the computing device, a new image;

determining, by the computing device, whether the new image includes a face of the person; and

in accordance with the new image including the face of the person:

generating, by the computing device, a score associated with the new image, wherein the score comprises a quality score;

determining, by the computing device, whether the score is above a threshold;

in accordance with a determination that the score is above the threshold, adding the new image to the plurality of images; and

in accordance with a determination that the score is not above the threshold, discarding the new image.

2 . The method of claim 1 , wherein the plurality of images comprises a first physical characteristic associated with the person, and further comprising:

in accordance with the new image not including the face of the person and not being identifiable based at least in part on having the quality score below the threshold:

comparing, by the computing device, a second physical characteristic identified in the new image with the first physical characteristic associated with the person;

determining, by the computing device, whether the second physical characteristic identified in the new image corresponds to the first physical characteristic associated with the person; and

identifying the person in accordance with the second physical characteristic identified in the new image corresponding to the first physical characteristic associated with the person.

3 . The method of claim 1 , further comprising providing, by the computing device, a notification that the person was identified.

4 . The method of claim 1 , wherein the computing device comprises a resident device in a home environment, wherein the resident device is configured to be relatively stationary within the home environment.

5 . The method of claim 1 , wherein the quality score identifies a relative quality of the new image with respect to other images.

6 . The method of claim 1 , wherein the quality score is determined based at least in part on at least one of an amount of saturation, an amount of contrast, an amount of brightness, or an amount of sharpness.

7 . The method of claim 1 , wherein the plurality of images comprises a collection of bodyprints associated with the person.

8 . The method of claim 7 , wherein a bodyprint of the collection of bodyprints is generated based at least in part on a torso of the person.

9 . The method according to claim 1 , wherein the score identifies a level of similarity between the new image and one or more of the plurality of images associated with the person.

10 . A computing device, comprising:

a memory comprising computer-executable instructions; and

one or more processors in communication with the memory and configured to access the memory and execute the computer-executable instructions to at least:

maintain a plurality of images associated with a person;

receive a new image;

determine whether the new image includes a face of the person; and

in accordance with the new image including the face of the person:

generate a score associated with the new image, wherein the score comprises a quality score;

determine whether the score is above a threshold;

in accordance with a determination that the score is above the threshold, add the new image to the plurality of images; and

in accordance with a determination that the score is not above the threshold, discard the new image.

11 . The computing device of claim 10 , wherein the plurality of images comprises a first physical characteristic associated with the person, and wherein the one or more processors are further configured to execute the computer-executable instructions to at least:

in accordance with the new image not including the face of the person and not being identifiable based at least in part on having the quality score below the threshold:

compare a second physical characteristic identified in the new image with the first physical characteristic associated with the person;

determine whether the second physical characteristic identified in the new image corresponds to the first physical characteristic associated with the person; and

identify the person in accordance with the second physical characteristic identified in the new image corresponding to the first physical characteristic associated with the person.

12 . The computing device of claim 10 , wherein the computing device comprises a resident device in a home environment, wherein the resident device is configured to be relatively stationary within the home environment.

13 . The computing device of claim 10 , wherein at least one of a) the quality score identifies a relative quality of the new image with respect to other images or b) the quality score is determined based at least in part on at least one of an amount of saturation, an amount of contrast, an amount of brightness, or an amount of sharpness.

14 . The computing device of claim 10 , wherein the plurality of images comprises a collection of bodyprints associated with the person, and wherein a bodyprint of the collection of bodyprints is generated based at least in part on a torso of the person.

15 . One or more non-transitory computer-readable storage media comprising computer-executable instructions that, when executed by one or more processors of a computing device, cause the one or more processors to perform operations comprising:

maintaining, by the computing device, a plurality of images associated with a person;

receiving, by the computing device, a new image;

determining, by the computing device, whether the new image includes a face of the person; and

in accordance with the new image including the face of the person:

generating, by the computing device, a score associated with the new image, wherein the score comprises a quality score;

determining, by the computing device, whether the score is above a threshold;

in accordance with a determination that the score is above the threshold, adding the new image to the plurality of images; and

in accordance with a determination that the score is not above the threshold, discarding the new image.

16 . The one or more non-transitory computer-readable storage media of claim 15 , wherein the plurality of images comprises a first physical characteristic associated with the person, and wherein the operations further comprise:

in accordance with the new image not including the face of the person and not being identifiable based at least in part on having the quality score below the threshold:

comparing, by the computing device, a second physical characteristic identified in the new image with the first physical characteristic associated with the person;

determining, by the computing device, whether the second physical characteristic identified in the new image corresponds to the first physical characteristic associated with the person; and

identifying the person in accordance with the second physical characteristic identified in the new image corresponding to the first physical characteristic associated with the person.

17 . The one or more non-transitory computer-readable storage media of claim 15 , wherein the computing device comprises a resident device in a home environment, wherein the resident device is configured to be relatively stationary within the home environment.

18 . The one or more non-transitory computer-readable storage media of claim 15 , wherein at least one of a) the quality score identifies a relative quality of the new image with respect to other images or b) the quality score is determined based at least in part on at least one of an amount of saturation, an amount of contrast, an amount of brightness, or an amount of sharpness.

19 . The one or more non-transitory computer-readable storage media of claim 15 , wherein the plurality of images comprises a collection of bodyprints associated with the person.

20 . The one or more non-transitory computer-readable storage media of claim 19 , wherein a bodyprint of the collection of bodyprints is generated based at least in part on a torso of the person.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2022
From: GUPTA, NITIN; ZHU, JINGWEN; JIN, JONGHOON; EDWARDS, ANDREW C.; CHABERT, FLORIS; SHARMA, VINAY; DAHLKAMP, HENDRIK
To: APPLE INC.
Reel/Frame 061484/0948 →
Continuity (4)
Continuation In Part 17743416 · May 12, 2022
Provisional Application 63341379 · May 12, 2022
Provisional Application 63188949 · May 14, 2021
Related Publication 20230013117A1 · Jan 19, 2023
References Cited (15)
US 8924735B2 · Forbes et al. · 2014 [cited by applicant]
US 10789820B1 · Jones et al. · 2020 [cited by applicant]
US 20080137918A1 · Eura et al. · 2008 [cited by applicant]
US 20130076487A1 · Evers · 2013 [cited by applicant]
US 20200380299A1 · Hu et al. · 2020 [cited by applicant]
US 20220157078A1 · Boic · 2022 [cited by examiner]
Godil, Afzal et al., “Human Identification from Body Shape,” downloaded on Feb. 26, 2021. Proceedings of the Fourth International Conference on 3-D Digital Imaging and Modeling (3DIM'03). 7 pages. [cited by applicant]
“Invitation to Pay Additional Fees,” mailed Aug. 8, 2022 in International Application No. PCT/US2022/029314. 9 pages. [cited by applicant]
Long, Jianfeng et al., “Near Infrared Face Image Quality Assessment System of Video Sequences,” 2011. IEEE Computer Society, 978-0-7695-4541—Jul. 2011. 5 pages. [cited by applicant]
“International Search Report and Written Opinion,” mailed Nov. 9, 2022 in International Application No. PCT/US2000/029314. 19 pages. [cited by applicant]
U.S. Appl. No. 17/743,416 , Notice of Allowance, Mailed on Jul. 22, 2024, 9 pages. [cited by applicant]
Bondi, Enrico et al., “Long Term Person Re-Identification from Depth Cameras using Facial and Skeleton Data.” Understanding Human Activities Through 3D Sensors. pp. 29-41. May 16, 2018. [cited by applicant]
Munaro, Matteo, “3D Reconstruction of Freely Moving Persons for Re-Identification with a Depth Sensor.” Institute of Electrical and Electronics Engineers, International Conference on Robotics and Automation. pp. 4512-45… [cited by applicant]
“International Search Report and Written Opinion,” mailed Dec. 7, 2023 from the International Searching Authority in International Application No. PCT/US2023/032393. 12 pages. [cited by applicant]
International Patent Application No. PCT/US2023/032393, “International Preliminary Report on Patentability”, Apr. 3, 2025, 8 pages. [cited by applicant]