IP Library › Granted Patent US 11,354,825
Granted Patent B2
US 11,354,825 · App. 16/997,551 · Granted Jun 7, 2022

Method, apparatus for generating special effect based on face, and electronic device

Inventors: Xin Lin (Beijing, CN); Jing Wang (Beijing, CN)
Assignee: BEIJING MICROLIVE VISION TECHNOLOGY CO., LTD
G06T11/00G06F3/04845G06F3/04847G06V40/16G06F3/04842G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,354,825
App. No.
16/997,551
Granted
Jun 7, 2022
Kind
B2
Abstract

A method and an apparatus for generating a special effect based on a face, an electronic device, and a computer readable storage medium are provided. With the method, a standard face image is displayed, a reference point is selected on the standard face image in response to a received reference point selecting command, a special effect is formed on the standard face image in response to a received special effect forming operation, a parameter of the special effect is generated, a first face image recognized by an image sensor is acquired, and the special effect is generated on the first face image based on the parameter of the special effect and the reference point.

Claims (66)

1. A method for generating a special effect based on a face, comprising:

displaying a standard face image, wherein the standard face image comprises a plurality of feature points;

selecting at least one reference point on the standard face image in response to a received reference point selecting command, wherein the at least one reference point is selected among the plurality of feature points;

forming a special effect on the standard face image in response to a received special effect forming operation;

generating parameters of the special effect based on determining a plurality of linear difference coefficients, wherein the plurality of linear difference coefficients indicate a size of the special effect and a position of the special effect relative to the at least one reference point;

acquiring a first face image recognized by an image sensor; and

generating the special effect on the first face image based at least in part on the plurality of linear difference coefficients, wherein there is a mapping relationship between the standard face image and the first face image.

2. The method for generating a special effect based on a face according to claim 1 , wherein

the standard face image comprises a plurality of regions,

the at least one reference point is located in one of the plurality of regions, and

the special effect is located in the region where the reference point is located.

3. The method for generating a special effect based on a face according to claim 2 , wherein

a number of the special effect is more than one, and the more than one special effect corresponds to different reference points and is located in different regions.

4. The method for generating a special effect based on a face according to claim 1 , wherein before the generating a parameter of the special effect, the method further comprises:

setting a trigger condition of the special effect in response to a received trigger condition setting command.

5. The method for generating a special effect based on a face according to claim 1 , wherein before the generating a parameter of the special effect, the method further comprises:

setting at least one of a play order and a play time of the special effect in response to a received play setting command.

6. The method for generating a special effect based on a face according to claim 5 , wherein

the play order is set based on a message, and

the message is set to control starting or stopping the special effect.

7. The method for generating a special effect based on a face according to claim 1 , wherein

the position of the special effect and the size of the special effect are respectively determined based on a position of the at least one reference point and a distance between different reference points.

8. The method for generating a special effect based on a face according to claim 1 , wherein the forming a special effect on the standard face image in response to a received special effect forming operation comprises:

selecting a resource package in response to a received resource package selecting command;

analyzing the resource package and displaying a configuration interface;

configuring a resource in the resource package in response to a received configuration command; and

generating the special effect based on the configured resource, and displaying the special effect on the standard face image.

9. The method for generating a special effect based on a face according to claim 8 , wherein the configuring a resource in the resource package comprises:

configuring a size, a position, and a rotation center of the resource.

10. An electronic device, comprising:

at least one processor; and

a memory communicatively connected to the at least one processor, wherein

the memory stores instructions executable by the at least one processor, and the instructions, when being executed by the at least one processor, causes the at least one processor to perform operations, the operations comprising:

displaying a standard face image, wherein the standard face image comprises a plurality of feature points;

selecting at least one reference point on the standard face image in response to a received reference point selecting command, wherein the at least one reference point is selected among the plurality of feature points;

forming a special effect on the standard face image in response to a received special effect forming operation;

generating parameters of the special effect based on determining a plurality of linear difference coefficients, wherein the plurality of linear difference coefficients indicate a size of the special effect and a position of the special effect relative to the at least one reference point;

acquiring a first face image recognized by an image sensor; and

generating the special effect on the first face image based at least in part on the plurality of linear difference coefficients, wherein there is a mapping relationship between the standard face image and the first face image.

11. The electronic device for generating a special effect based on a face according to claim 10 , wherein

the standard face image comprises a plurality of regions,

the reference point is located in one of the plurality of regions, and

the special effect is located in the region where the at least one reference point is located.

12. The electronic device for generating a special effect based on a face according to claim 11 , wherein

a number of the special effect is more than one, and the more than one special effect corresponds to different reference points and is located in different regions.

13. The electronic device for generating a special effect based on a face according to claim 10 , wherein before the generating a parameter of the special effect, the operations further comprise:

setting a trigger condition of the special effect in response to a received trigger condition setting command.

14. The electronic device for generating a special effect based on a face according to claim 10 , wherein before the generating a parameter of the special effect, the operations further comprise:

setting at least one of a play order and a play time of the special effect in response to a received play setting command.

15. The electronic device for generating a special effect based on a face according to claim 14 , wherein

the play order is set based on a message, and

the message is set to control starting or stopping the special effect.

16. The electronic device for generating a special effect based on a face according to claim 10 , wherein

the position of the special effect and the size of the special effect are respectively determined based on a position of the reference point and a distance between reference points.

17. The electronic device for generating a special effect based on a face according to claim 10 , wherein the forming a special effect on the standard face image in response to a received special effect forming operation comprises:

selecting a resource package in response to a received resource package selecting command;

analyzing the resource package and displaying a configuration interface;

configuring a resource in the resource package in response to a received configuration command; and

generating the special effect based on the configured resource, and displaying the special effect on the standard face image.

18. A non-transitory computer readable storage medium comprising computer instructions stored thereon, wherein the computer instructions, when being executed by a computer, cause the computer to perform operations, the operations comprising:

displaying a standard face image, wherein the standard face image comprises a plurality of feature points;

selecting at least one reference point on the standard face image in response to a received reference point selecting command, wherein the at least one reference point is selected among the plurality of feature points;

forming a special effect on the standard face image in response to a received special effect forming operation;

generating parameters of the special effect based on determining a plurality of linear difference coefficients, wherein the plurality of linear difference coefficients indicate a size of the special effect and a position of the special effect relative to the at least one reference point;

acquiring a first face image recognized by an image sensor; and

generating the special effect on the first face image based at least in part on the plurality of linear difference coefficients, wherein there is a mapping relationship between the standard face image and the first face image.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 18, 2021
From: LIN, XIN; WANG, JING
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 055322/0009 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 18, 2021
From: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO,. LTD.
To: BEIJING MICROLIVE VISION TECHNOLOGY CO., LTD.
Reel/Frame 055322/0114 →
Priority Claims (1)
CN 201810838432.8 · Jul 27, 2018 · national
Continuity (1)
Related Publication 20210366163A1 · Nov 25, 2021