IP Library › Granted Patent US 12,287,847
Granted Patent B2
US 12,287,847 · App. 17/524,475 · Granted Apr 29, 2025

Systems and methods for artificial facial image generation conditioned on demographic information

Inventors: Tung Thanh Tran (Bradenton, FL); Dongwook Shin (Potomac, MD); Jefferson D. Hoye (Arlington, VA); Matthew R. Ehlers (Raleigh, NC)
Assignee: IDS TECHNOLOGY LLC
G06F18/214G06F18/2431G06T11/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,287,847
App. No.
17/524,475
Granted
Apr 29, 2025
Kind
B2
Abstract

A method, computer program product, and computer system for analyzing, by a computing device, a plurality of facial images to determine a plurality of demographic labels associated with each facial image of the plurality of facial images. A model may be trained based upon, at least in part, the plurality of demographic labels associated with each facial image of the plurality of facial images. An input of at least a portion of the plurality of demographic labels may be received. An artificially generated facial image may be provided for display that is generated based upon, at least in part, the model and the input.

Claims (33)

1. A computer-implemented method comprising:

analyzing, by a computing device, a plurality of facial images to determine a plurality of demographic labels associated with each facial image of the plurality of facial images;

training a model based upon, at least in part, the plurality of demographic labels associated with each facial image of the plurality of facial images, wherein the model is a generative adversarial network (GAN) with a generator and a discriminator, wherein the generator includes a label embedding layer that processes a one-hot encoded vector for each of the demographic labels, wherein the discriminator includes an affine layer that processes a tensor for each of the demographic labels;

receiving an input of at least a portion of the plurality of demographic labels; and

providing an artificially generated facial image for display that is generated based upon, at least in part, the model and the input.

2. The computer-implemented method of claim 1 wherein the demographic labels include at least one of a gender, an age, and an ethnicity.

3. The computer-implemented method of claim 2 wherein the age is based upon, at least in part, a weighted blending of age labels of the plurality of demographic labels.

4. The computer-implemented method of claim 2 wherein the ethnicity is based upon, at least in part, a weighted blending of ethnicity labels of the plurality of demographic labels.

5. The computer-implemented method of claim 1 wherein the plurality of facial images are automatically selected for analysis from an internet.

6. The computer-implemented method of claim 1 further comprising determining whether a candidate face image is acceptable for use as one of the plurality of facial images to train the model based upon, at least in part, at least one of whether the candidate face image is a real human face and one or more attributes of the candidate face image.

7. The computer-implemented method of claim 1 wherein the model is trained to automatically assign the demographic labels to the plurality of facial images.

8. A computer program product residing on a non-transitory computer readable storage medium having a plurality of instructions stored thereon which, when executed across one or more processors, causes at least a portion of the one or more processors to perform operations comprising:

analyzing a plurality of facial images to determine a plurality of demographic labels associated with each facial image of the plurality of facial images;

training a model based upon, at least in part, the plurality of demographic labels associated with each facial image of the plurality of facial images, wherein the model is a generative adversarial network (GAN) with a generator and a discriminator, wherein the generator includes a label embedding layer that processes a one-hot encoded vector for each of the demographic labels, wherein the discriminator includes an affine layer that processes a tensor for each of the demographic labels;

receiving an input of at least a portion of the plurality of demographic labels; and

providing an artificially generated facial image for display that is generated based upon, at least in part, the model and the input.

9. The computer program product of claim 8 wherein the demographic labels include at least one of a gender, an age, and an ethnicity.

10. The computer program product of claim 9 wherein the age is based upon, at least in part, a weighted blending of age labels of the plurality of demographic labels.

11. The computer program product of claim 9 wherein the ethnicity is based upon, at least in part, a weighted blending of ethnicity labels of the plurality of demographic labels.

12. The computer program product of claim 8 wherein the plurality of facial images are automatically selected for analysis from an internet.

13. The computer program product of claim 8 wherein the operations further comprise determining whether a candidate face image is acceptable for use as one of the plurality of facial images to train the model based upon, at least in part, at least one of whether the candidate face image is a real human face and one or more attributes of the candidate face image.

14. The computer program product of claim 8 wherein the model is trained to automatically assign the demographic labels to the plurality of facial images.

15. A computing system including one or more processors and one or more memories configured to perform operations comprising:

analyzing a plurality of facial images to determine a plurality of demographic labels associated with each facial image of the plurality of facial images;

training a model based upon, at least in part, the plurality of demographic labels associated with each facial image of the plurality of facial images, wherein the model is a generative adversarial network (GAN) with a generator and a discriminator, wherein the generator includes a label embedding layer that processes a one-hot encoded vector for each of the demographic labels, wherein the discriminator includes an affine layer that processes a tensor for each of the demographic labels;

receiving an input of at least a portion of the plurality of demographic labels; and

providing an artificially generated facial image for display that is generated based upon, at least in part, the model and the input.

16. The computing system of claim 15 wherein the demographic labels include at least one of a gender, an age, and an ethnicity.

17. The computing system of claim 16 wherein the age is based upon, at least in part, a weighted blending of age labels of the plurality of demographic labels.

18. The computing system of claim 16 wherein the ethnicity is based upon, at least in part, a weighted blending of ethnicity labels of the plurality of demographic labels.

19. The computing system of claim 15 wherein the plurality of facial images are automatically selected for analysis from an internet.

20. The computing system of claim 15 wherein the operations further comprise determining whether a candidate face image is acceptable for use as one of the plurality of facial images to train the model based upon, at least in part, at least one of whether the candidate face image is a real human face and one or more attributes of the candidate face image.

21. The computing system of claim 15 wherein the model is trained to automatically assign the demographic labels to the plurality of facial images.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Dec 13, 2024
From: JPMORGAN CHASE BANK, N.A.
To: IDS TECHNOLOGY LLC
Reel/Frame 069578/0738 →
SECURITY INTEREST Recorded May 26, 2023
From: IDS TECHNOLOGY LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 063774/0185 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 11, 2021
From: TRAN, TUNG THANH; SHIN, DONGWOOK; HOYE, JEFFERSON D.; EHLERS, MATTHEW R.
To: IDS TECHNOLOGY LLC
Reel/Frame 058090/0333 →
Continuity (2)
Provisional Application 63112323 · Nov 11, 2020
Related Publication 20220147769A1 · May 12, 2022
References Cited (10)
US 7505621B1 · Agrawal · 2009 [cited by examiner]
US 11335120B2 · Cole · 2022 [cited by examiner]
US 20140185926A1 · Ricanek, Jr. · 2014 [cited by examiner]
US 20200219295A1 · el Kaliouby · 2020 [cited by examiner]
CN 108108711A · 2018 [cited by examiner]
CN 112784631 · 2021 [cited by examiner]
Extended European Search Report and Search Opinion issued in related Application Serial No. 21892783.8 on Aug. 22, 2024. [cited by applicant]
Wang, Tianren et al., “Faces la Carte: Text-to-Face Generation via Attribute Disentanglement”, arXiv. Organization, Cornell University Library Itaca, NY 14853, Sep. 18, 2020. [cited by applicant]
Li, Shan et al., “Deep Facial Expression Recognition: A Survey”, IEEE Transactions on Affective Computing, Mar. 17, 2020. [cited by applicant]
Gao, Chenqiang et al., “Face Liveness Detection Based on the Improved CNN with Context and Texture Information”, Chinese Journal of Electronics, Technology Exchange LTD., Hong Kong, HK, vol. 28, Nov. 1, 2019, pp. 1092-1… [cited by applicant]