IP Library › Granted Patent US 12,159,362
Granted Patent B2
US 12,159,362 · App. 17/928,217 · Granted Dec 3, 2024

Facial model reconstruction method and apparatus, and medium and device

Inventor: Xinting He (Beijing, CN)
Assignee: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
G06T19/20G06T2210/21G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,159,362
App. No.
17/928,217
Granted
Dec 3, 2024
Kind
B2
Abstract

A facial model reconstruction method and apparatus, and a medium and a device are provided. The facial model reconstruction method comprises: determining an anchor point of a three-dimensional special effect element to be attached on a face; determining an attachment point on a three-dimensional facial model to which the three-dimensional special effect element is to be attached, wherein the three-dimensional facial model corresponds to the face; attaching the anchor point to the attachment point in a way that the anchor point overlaps the attachment point; and moving the anchor point to a center of a world coordinate system of the three-dimensional facial model, and binding the 3D special effect element with the 3D facial model.

Claims (50)

1. A method for reconstructing a facial model, comprising:

determining an anchor point of a three-dimensional special effect element to be attached on a face, wherein the anchor point is a central position around which the three-dimensional effect element is to be shifted, rotated, and scaled;

determining an attachment point on a three-dimensional facial model to which the three-dimensional special effect element is to be attached, wherein the three-dimensional facial model corresponds to the face;

attaching the anchor point to the attachment point in a way that the anchor point overlaps the attachment point; and

moving the anchor point to a center of a world coordinate system of the three-dimensional facial model, and binding the 3D special effect element with the 3D facial model.

2. The method according to claim 1 , wherein determining the attachment point on the three-dimensional facial model to which the three-dimensional special effect element is to be attached comprises:

determining a vertex corresponding to a vertex identifier in the three-dimensional facial model corresponding to the face; and

determining, based on the vertex, the attachment point on the three-dimensional facial model to which the three-dimensional special effect element is to be attached.

3. The method according to claim 1 , wherein binding the three-dimensional special effect element with the three-dimensional facial model comprises:

disposing the three-dimensional special effect element based on position information of the attachment point and rotation information of the attachment point, to bind the three-dimensional special effect element with the three-dimensional facial model.

4. The method according to claim 3 , wherein the rotation information is an average surface normal of a region where the attachment point is located.

5. The method according claim 1 , further comprising:

detecting a collision force of the three-dimensional special effect element colliding on the face during a process of attaching the anchor point to the attachment point in the way that the anchor point overlaps the attachment point; and

determining an elastic change on the face based on the collision force.

6. The method according to claim 1 , further comprising:

determining, by using a weight map, an attachment area in which the three-dimensional special effect element is attached onto a surface of the three-dimensional facial model, and a quantity of three-dimensional special effect elements attached within the attachment area.

7. A device for reconstructing a facial model, comprising:

a storage storing a computer program; and

a processor configured to execute the computer program stored in the storage to:

determine an anchor point of a three-dimensional special effect element to be attached on a face, wherein the anchor point is a central position around which the three-dimensional effect element is to be shifted, rotated, and scaled;

determine an attachment point on a three-dimensional facial model to which the three-dimensional special effect element is to be attached, wherein the three-dimensional facial model corresponds to the face;

attach the anchor point to the attachment point in a way that the anchor point overlaps the attachment point; and

move the anchor point to overlap a center of a world coordinate system of the three-dimensional facial model, and bind the three-dimensional special effect element with the three-dimensional facial model.

8. The device according to claim 7 , wherein the processor is further configured to:

bind the three-dimensional special effect element with the three-dimensional facial model by disposing the three-dimensional special effect element based on position information of the attachment point and rotation information of the attachment point.

9. The device according to claim 7 , wherein the processor is further configured to:

determine, by using a weight map, an attachment area in which the three-dimensional special effect element is attached onto a surface of the three-dimensional facial model, and a quantity of three-dimensional special effect elements attached within the attachment area.

10. The device according to claim 7 , wherein the processor is further configured to implement:

determining a vertex corresponding to a vertex identifier in the three-dimensional facial model corresponding to the face; and

determining, based on the vertex, the attachment point on the three-dimensional facial model to which the three-dimensional special effect element is to be attached.

11. The device according to claim 7 , wherein the processor is further configured to implement:

detecting a collision force of the three-dimensional special effect element colliding on the face during a process of attaching the anchor point to the attachment point in the way that the anchor point overlaps the attachment point; and

determining an elastic change on the face based on the collision force.

12. The device according to claim 7 , wherein the processor is further configured to implement:

disposing the three-dimensional special effect element based on position information of the attachment point and rotation information of the attachment point, to bind the three-dimensional special effect element with the three-dimensional facial model.

13. The device according to claim 12 , wherein the rotation information is an average surface normal of a region where the attachment point is located.

14. A non-transitory computer-readable medium storing a computer program, wherein, the computer program, when being executed by a processing device, implements:

determining an anchor point of a three-dimensional special effect element to be attached on a face, wherein the anchor point is a central position around which the three-dimensional effect element is to be shifted, rotated, and scaled;

determining an attachment point on a three-dimensional facial model to which the three-dimensional special effect element is to be attached, wherein the three-dimensional facial model corresponds to the face;

attaching the anchor point to the attachment point in a way that the anchor point overlaps the attachment point; and

moving the anchor point to a center of a world coordinate system of the three-dimensional facial model, and binding the 3D special effect element with the 3D facial model.

15. The computer-readable medium according to claim 14 , wherein the computer program, when being executed by the processing device, further implements:

determining a vertex corresponding to a vertex identifier in the three-dimensional facial model corresponding to the face; and

determining, based on the vertex, the attachment point on the three-dimensional facial model to which the three-dimensional special effect element is to be attached.

16. The computer-readable medium according to claim 14 , wherein the computer program, when being executed by the processing device, further implements:

disposing the three-dimensional special effect element based on position information of the attachment point and rotation information of the attachment point, to bind the three-dimensional special effect element with the three-dimensional facial model.

17. The computer-readable medium according to claim 16 , wherein the rotation information is an average surface normal of a region where the attachment point is located.

18. The computer-readable medium according to claim 14 , wherein the computer program, when being executed by the processing device, further implements:

detecting a collision force of the three-dimensional special effect element colliding on the face during a process of attaching the anchor point to the attachment point in the way that the anchor point overlaps the attachment point; and

determining an elastic change on the face based on the collision force.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2023
From: HE, XINTING
To: LEMON TECHNOLOGY(SHENZHEN)CO., LTD.
Reel/Frame 062340/0442 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2023
From: LEMON TECHNOLOGY(SHENZHEN)CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 062340/0477 →
Priority Claims (1)
CN 202010478888.5 · May 29, 2020 · national
Continuity (1)
Related Publication 20230334801A1 · Oct 19, 2023