IP Library › Granted Patent US 12,412,352
Granted Patent B2
US 12,412,352 · App. 18/025,551 · Granted Sep 9, 2025

Method and an apparatus for generating a 3D face comprising at least one deformed region

Inventors: Fabien Danieau (Rennes, FR); Glenn Kerbiriou (Cesson-Sevigne, FR); Quentin Avril (Betton, FR); Nicolas Olivier (Chateaubourg, FR)
Assignee: InterDigital CE Patent Holdings, SAS
G06T19/20G06T7/11G06T7/64G06T2200/24G06T2207/20021G06T2207/20096G06T2207/20221G06T2207/30201G06T2210/44G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,412,352
App. No.
18/025,551
Granted
Sep 9, 2025
Kind
B2
Abstract

A method and an apparatus for generating a 3D face comprising at least one deformed region are disclosed. A curvature exaggeration face is obtained from at least one region of a first 3D face, and a proportion exaggeration deformation is obtained for said least one region of said first 3D face. The curvature exaggeration face and the proportion exaggeration deformation for obtaining said at least one deformed region of said 3D face are combined.

Claims (46)

1. A method for generating a three-dimensional (3D) face comprising at least one deformed region, the method comprising:

obtaining a curvature exaggeration face from at least one region of a first 3D face;

obtaining a set of relative deformations from a first set of 3D caricatured faces and a second set of 3D faces, wherein the set of relative deformations are the 3D caricatured faces of the first set standardized using a standard deviation and a mean of the 3D faces of the second set;

obtaining a first relative deformation for the at least one region of the first 3D face, wherein the first relative deformation is obtained by a standardization of the at least one region of the first 3D face using the standard deviation and the mean of the 3D faces of the second set;

obtaining, based on the first relative deformation, at least one nearest relative deformation from the set of relative deformations;

determining a proportion exaggeration deformation from the at least one nearest relative deformation, wherein the proportion exaggeration deformation is a weighted average deformation from the at least one nearest relative deformation, based on a distance of the at least one nearest relative deformation to the first relative deformation; and

combining the curvature exaggeration face and the proportion exaggeration deformation for obtaining the at least one deformed region of the 3D face.

2. The method of claim 1 , further comprising:

obtaining at least one user input setting at least one weighting factor for weighting at least one of the curvature exaggeration or the proportion exaggeration deformation.

3. The method of claim 1 , wherein the least one region of the first 3D face corresponds to the first 3D face.

4. The method of claim 1 , wherein the first 3D face comprises a head, and wherein the head comprises at least one eye, a nose and a mouth, the method further comprising:

segmenting the first 3D face into a set of face regions representative of at least the at least one eye, the nose, the mouth and a rest of the head of the first 3D face; and

merging deformed region obtained for the face regions to obtain a deformed 3D face.

5. The method of claim 4 , wherein the set of face regions further comprises the first 3D face.

6. The method of claim 1 , further comprising accessing the first 3D face.

7. The method of claim 1 , wherein the curvature exaggeration face is based on a gradient obtained from the second 3D face.

8. The method of claim 1 , wherein the curvature exaggeration face is reconstructed from the least one region of the first 3D face and a second 3D face distinct from the first 3D face.

9. An apparatus for generating a three-dimensional (3D) face comprising at least one deformed region, the apparatus comprising one or more processors configured to:

obtain a curvature exaggeration face from at least one region of a first 3D face;

obtain a set of relative deformations from a first set of 3D caricatured faces and a second set of 3D faces, wherein the set of relative deformations are the 3D caricatured faces of the first set standardized using a standard deviation and a mean of the 3D faces of the second set;

obtain a first relative deformation for the at least one region of the first 3D face, wherein the first relative deformation is obtained by a standardization of the at least one region of the first 3D face using the standard deviation and the mean of the 3D faces of the second set;

obtain, based on the first relative deformation, at least one nearest relative deformation from the set of relative deformations;

determine a proportion exaggeration deformation from the at least one nearest relative deformation, wherein the proportion exaggeration deformation is a weighted average deformation from the at least one nearest relative deformation, based on a distance of the at least one nearest relative deformation to the first relative deformation; and

combine the curvature exaggeration face and the proportion exaggeration deformation for obtaining the at least one deformed region of the 3D face.

10. The apparatus of claim 9 , wherein the one or more processors are further configured to access the first 3D face.

11. The apparatus of claim 9 , wherein the one or more processors are further configured to obtain at least one user input setting at least one weighting factor for weighting at least one of the curvature exaggeration or the proportion exaggeration deformation.

12. The apparatus of claim 9 , wherein the least one region of the first 3D face corresponds to the first 3D face.

13. The apparatus of claim 9 , wherein the curvature exaggeration face is reconstructed from the least one region of the first 3D face and a second 3D face distinct from the first 3D face.

14. The apparatus of claim 9 , wherein the curvature exaggeration face is based on a gradient obtained from the second 3D face.

15. A system for generating a three-dimensional (3D) face comprising at least one deformed region, the system comprising:

an apparatus according to claim 9 ;

a first data set of 3D faces; and

a second data set of 3D deformed faces.

16. A non-transitory computer readable storage medium having stored thereon instructions for causing one or more processors to perform a method for generating a three-dimensional (3D) face comprising at least one deformed region, the method comprising:

obtaining a curvature exaggeration face from at least one region of a first 3D face;

obtaining a set of relative deformations from a first set of 3D caricatured faces and a second set of 3D faces, wherein the set of relative deformations are the 3D caricatured faces of the first set standardized using a standard deviation and a mean of the 3D faces of the second set;

obtaining a first relative deformation for the at least one region of the first 3D face, wherein the first relative deformation is obtained by a standardization of the at least one region of the first 3D face using the standard deviation and the mean of the 3D faces of the second set;

obtaining, based on the first relative deformation, at least one nearest relative deformation from the set of relative deformations;

determining a proportion exaggeration deformation from the at least one nearest relative deformation, wherein the proportion exaggeration deformation is a weighted average deformation from the at least one nearest relative deformation, based on a distance of the at least one nearest relative deformation to the first relative deformation; and

combining the curvature exaggeration face and the proportion exaggeration deformation for obtaining the at least one deformed region of the 3D face.

17. The non-transitory computer readable storage medium of claim 16 , wherein the curvature exaggeration face is reconstructed from the least one region of the first 3D face and a second 3D face distinct from the first 3D face.

18. The non-transitory computer readable storage medium of claim 16 , wherein the instructions further cause the one or more processors to perform:

accessing the first 3D face.

19. The non-transitory computer readable storage medium of claim 16 , wherein the instructions further cause the one or more processors to perform:

obtaining at least one user input setting at least one weighting factor for weighting at least one of the curvature exaggeration or the proportion exaggeration deformation.

20. The non-transitory computer readable storage medium of claim 16 , wherein the least one region of the first 3D face corresponds to the first 3D face.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2023
From: DANIEAU, FABIEN; KERBIRIOU, GLENN; AVRIL, QUENTIN; OLIVIER, NICOLAS
To: INTERDIGITAL CE PATENT HOLDINGS, SAS
Reel/Frame 062936/0700 →
Priority Claims (1)
EP 20306006 · Sep 10, 2020 · regional
Continuity (1)
Related Publication 20230334805A1 · Oct 19, 2023
References Cited (27)
US 7483553B2 · Xu et al. · 2009 [cited by applicant]
US 9818216B2 · Sela et al. · 2017 [cited by applicant]
US 20140198106A1 · Sumner · 2014 [cited by examiner]
US 20150287229A1 · Sela · 2015 [cited by examiner]
US 20180033181A1 · Sela et al. · 2018 [cited by applicant]
US 20180130256A1 · Wampler · 2018 [cited by examiner]
US 20190272668A1 · Echevarria Vallespi · 2019 [cited by examiner]
US 20200219302A1 · Tarquini · 2020 [cited by examiner]
US 20210125390A1 · Cotter et al. · 2021 [cited by applicant]
US 20210319532A1 · Gong · 2021 [cited by examiner]
US 20220044352A1 · Liao · 2022 [cited by examiner]
CN 112837210A · 2021 [cited by applicant]
KR 101987748B1 · 2019 [cited by applicant]
WO WO2019098872A1 · 2019 [cited by applicant]
WO WO2021099003A1 · 2021 [cited by applicant]
Nonis et al., “3D Approaches and Challenges in Facial Expression Recognition Algorithms—A Literature Review”, MDPI Applied Sciences 2019, 9, 3904, Department of Management and Production Engineering, Sep. 18, 2019, 33 p… [cited by applicant]
Sorkine, Olga, “Laplacian Mesh Processing”, 26th Annual Conference of the European Association for Computer Graphics, Eurographics 2005—State of the Art Reports, Dublin, Ireland, Aug. 29, 2005, 18 pages. [cited by applicant]
Liu et al., “Three Dimensional Cartoon Reconstruction based on Art Rules”, Institute for Electronics and Electrical Engineers (IEEE), 2010 International Conference on Image Analysis and Signal Processing, Zhejiang, Chin… [cited by applicant]
Zhou et al., “3d cartoon face generation by local deformation mapping”, International Journal of Computer Graphics, The Visual Computer, Springer Publications, vol. 32, Jun. 10, 2016, 11 pages. [cited by applicant]
Sela et al., “Computational caricaturization of surfaces”, Elsevier Science Direct, Computer Vision and Image Understandings, vol. 141, Geometric Image Processing Lab, Technion-Israel Institute of Technology, Haifa, Isr… [cited by applicant]
Tseng et al., “Synthesis of Exaggerative Caricature with Inter and Intra Correlations”, Computer Vision (ACCV 2007), 8th Asian Conference on Computer Vision, Tokyo, Japan, Nov. 18, 2007, 10 pages. [cited by applicant]
Zhang et al., “Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model”, arXivLabs, Document: ArXiv:2004.09190, Apr. 20, 2020, 12 pages. [cited by applicant]
Chen et al., “Regularity-based Caricature Synthesis”, Institute of Electronics and Electrical Engineers (IEEE), 2009 International Conference on Management and Service Science, Beijing, China, Sep. 20, 2009, 5 pages. [cited by applicant]
Cao et al., “Carigans: Unpaired Photo-to-Caricature Translation”, arXivLabs, Document: ArXiv:1811.00222, ACM Transactions on Graphics, vol. 37, No. 6, Article 244, Nov. 2018, 14 pages. [cited by applicant]
Blanz et al., “A Morphable Model for the Synthesis of 3D Faces”, Association for Computing Machinery (ACM), ACM Digital Library, Siggraph '99: Proceedings of the 26th annual conference on Computer graphics and interacti… [cited by applicant]
Sadimon et al., “Computer Generated Caricature: A Survey,”, Institute of Electronics and Electrical Engineers (IEEE), 2010 International Conference on Cyberworlds, Singapore, Oct. 20, 2010, 8 pages. [cited by applicant]
Brennan, Susan, “Caricature Generator: The dynamic Exaggeration of Faces by Computer”, Leonardo, vol. 18, Issue No. 3, 1985, 9 pages. [cited by applicant]