IP Library Granted Patent US 11,276,238
Granted Patent B2
US 11,276,238 · App. 16/967,962 · Granted Mar 15, 2022

Method, apparatus and electronic device for generating a three-dimensional effect based on a face

Inventors: Jing Wang (Beijing, CN); Xin Lin (Beijing, CN)
Assignee: BEIJING MICROLIVE VISION TECHNOLOGY CO., LTD
G06T19/006G06K9/00281G06T7/74G06T15/04G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,276,238
App. No.
16/967,962
Granted
Mar 15, 2022
Kind
B2
Abstract

Disclosed is a method, an apparatus, an electronic device and a computer readable storage medium for generating a three-dimensional effect based on a face. In an embodiment of the method, a standard face image is displayed, a three-dimensional effect which located on the standard face image is created at least by configuring a three-dimensional model and configuring a material of the three-dimensional model, effect parameters are generated according to the three-dimensional effect, a first face image recognized from an image sensor is obtained, and the three-dimensional effect is generated on the first face image according to the effect parameters. Through the above method, the three-dimensional effect can be easily configured and edited, and the three-dimensional effect generation algorithm can generate three-dimensional effects on the face images acquired in real time using three-dimensional effects parameters.

Claims (75)

1. A method for generating a three-dimensional effect based on a face, comprising steps of:

displaying a standard face image;

creating a three-dimensional effect at least by configuring a three-dimensional model and configuring a material of the three-dimensional model on the standard face image, wherein the configuring a material of the three-dimensional model further comprises:

creating the material, and

adjusting parameters of the material, wherein the parameters of the material comprise a rendering and blending mode parameter, a parameter for whether to perform depth testing, a parameter for whether to perform depth writing, and a parameter for whether to perform eliminating one or more of parameters;

generating effect parameters according to the three-dimensional effect;

obtaining a first face image recognized from an image sensor;

generating the three-dimensional effect on the first face image according to the effect parameters.

2. The method of claim 1 , wherein the configuring a three-dimensional model comprises:

obtaining the three-dimensional model, and displaying it on the standard face image;

configuring a position and a size of the three-dimensional model.

3. The method of claim 1 , wherein the creating a three-dimensional effect further comprises:

configuring a light source, the light source comprising one of a point light source, a parallel light source, and a spotlight source.

4. The method of claim 3 , wherein the configuring a light source comprises:

configuring a position, an orientation, a color, and an intensity of the light source.

5. The method of claim 1 , wherein the creating a three-dimensional effect further comprises:

configuring a map of the three-dimensional model, comprising:

obtaining a texture of the map;

configuring a wrapping mode of the texture.

6. The method of claim 1 , wherein:

the standard face image comprises face landmarks, and after the displaying the standard face image, the method comprises:

receiving an instruction to select reference points, selecting at least one landmark as reference points;

the generating the three-dimensional effect on the first face image according to the effect parameters comprises:

generating the three-dimensional effect on the first face image according to the effect parameters and the reference points.

7. An apparatus for generating a three-dimensional effect based on a face, comprising:

at least one processor; and

at least one memory communicatively coupled to the at least one processor and storing instructions that upon execution by the at least one processor cause the apparatus to:

display a standard face image;

create a three-dimensional effect at least by configuring a three-dimensional model and configuring a material of the three-dimensional model on the standard face image;

generate effect parameters according to the three-dimensional effect;

obtain a first face image recognized from an image sensor;

generate the three-dimensional effect on the first face image according to the effect parameters;

wherein at least one memory further stores instructions that upon execution by the at least one processor cause the apparatus to:

create the material; and

adjust parameters of the material, wherein the parameters of the material comprise a rendering and blending mode parameter, a parameter for whether to perform depth testing, a parameter for whether to perform depth writing, and a parameter for whether to perform eliminating one or more of parameters.

8. The apparatus according to claim 7 , wherein the processor is configured to execute the computer readable instructions to further perform operations of:

obtaining the three-dimensional model, and displaying it on the standard face image;

configuring a position and a size of the three-dimensional model.

9. The apparatus according to claim 7 , wherein the processor is configured to execute the computer readable instructions to further perform operations of:

configuring a light source, the light source comprising one of a point light source, a parallel light source, and a spotlight source.

10. The apparatus according to claim 9 , wherein the processor is configured to execute the computer readable instructions to further perform operations of:

configuring a position, an orientation, a color, and an intensity of the light source.

11. The apparatus according to claim 7 , wherein the processor is configured to execute the computer readable instructions to further perform operations of:

configuring a map of the three-dimensional model, comprising:

obtaining a texture of the map;

configuring a wrapping mode of the texture.

12. The apparatus according to claim 7 , wherein the standard face image comprises face landmarks; and

the processor is configured to execute the computer readable instructions to further perform operations of:

receiving an instruction to select reference points, selecting at least one landmark as reference points;

the generating the three-dimensional effect on the first face image according to the effect parameters comprises:

generating the three-dimensional effect on the first face image according to the effect parameters and the reference points.

13. A non-transitory computer readable storage medium, wherein the non-transitory computer readable storage medium stores computer instructions for enabling a computer to execute operations, the operations comprising:

displaying a standard face image;

creating a three-dimensional effect at least by configuring a three-dimensional model and configuring a material of the three-dimensional model on the standard face image, wherein the configuring a material of the three-dimensional model further comprises:

creating the material, and

adjusting parameters of the material, wherein the parameters of the material comprise a rendering and blending mode parameter, a parameter for whether to perform depth testing, a parameter for whether to perform depth writing, and a parameter for whether to perform eliminating one or more of parameters;

generating effect parameters according to the three-dimensional effect;

obtaining a first face image recognized from an image sensor;

generating the three-dimensional effect on the first face image according to the effect parameters.

14. The non-transitory computer readable storage medium of claim 13 , wherein the configuring a three-dimensional model comprises:

obtaining the three-dimensional model;

displaying the three-dimensional model on the standard face image; and

configuring a position and a size of the three-dimensional model.

15. The non-transitory computer readable storage medium of claim 13 , wherein the creating a three-dimensional effect further comprises:

configuring a light source, the light source comprising one of a point light source, a parallel light source, and a spotlight source.

16. The non-transitory computer readable storage medium of claim 15 , wherein the configuring a light source comprises:

configuring a position, an orientation, a color, and an intensity of the light source.

17. The non-transitory computer readable storage medium of claim 13 , wherein the creating a three-dimensional effect further comprises:

configuring a map of the three-dimensional model, wherein the configuring a map of the three-dimensional model comprises:

obtaining a texture of the map; and

configuring a wrapping mode of the texture.

18. The non-transitory computer readable storage medium of claim 13 , wherein the standard face image comprises face landmarks, and after the displaying the standard face image, the operations further comprise:

receiving an instruction to select reference points, and selecting at least one landmark as at least one of the reference points; and

wherein the generating the three-dimensional effect on the first face image according to the effect parameters further comprises:

generating the three-dimensional effect on the first face image according to the effect parameters and the reference points.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2020
From: WANG, JING; LIN, XIN
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 053421/0532 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2020
From: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
To: BEIJING MICROLIVE VISION TECHNOLOGY CO., LTD.
Reel/Frame 053421/0638 →
Priority Claims (1)
CN 201810838414.X · Jul 27, 2018 · national
Continuity (1)
Related Publication 20210035369A1 · Feb 4, 2021