IP Library › Granted Patent US 12,536,835
Granted Patent B2
US 12,536,835 · App. 18/294,433 · Granted Jan 27, 2026

Method for determining expression model, electronic device and non-transient computer readable storage medium

Inventor: Chen Han (Beijing, CN)
Assignee: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
G06V40/174G06F3/011G06T13/40G06V40/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,536,835
App. No.
18/294,433
Granted
Jan 27, 2026
Kind
B2
Abstract

A method for determining an expression model, an electronic device and a non-transient computer readable storage medium are provided. The method includes: acquiring a facial image and eyeball feature information of a user; determining a corresponding expression classification according to the facial image; determining a corresponding expression model to be adjusted based on the expression classification; adjusting corresponding parameters of the expression model to be adjusted by utilizing the facial image and the eyeball feature information to obtain a target expression model.

Claims (63)

1 . A method for determining an expression model, comprising:

acquiring a facial image and eyeball feature information of a user;

determining a corresponding expression classification according to the facial image;

determining a corresponding expression model to be adjusted based on the expression classification;

adjusting corresponding parameters of the expression model to be adjusted by utilizing the facial image and the eyeball feature information to obtain a target expression model,

wherein adjusting the corresponding parameters of the expression model to be adjusted by utilizing the facial image and the eyeball feature information to obtain the target expression model comprises:

determining corresponding facial feature information according to the facial image, wherein the facial feature information includes any one or more of: information of a distance between angulus orises at two sides, and information of a vertical distance between an angulus oris at one side or angulus orises at two sides and a labial peak;

adjusting the corresponding parameters of the expression model to be adjusted by utilizing the facial feature information and the eyeball feature information to obtain the target expression model.

2 . The method according to claim 1 , wherein determining the corresponding expression classification according to the facial image comprises:

inputting the facial image into a preset expression recognition model to determine the expression classification, wherein the expression recognition model is a neural network model.

3 . The method according to claim 1 , wherein adjusting the corresponding parameters of the expression model to be adjusted by utilizing the facial feature information and the eyeball feature information to obtain the target expression model comprises:

adjusting facial feature parameters to be adjusted of the expression model to be adjusted to match with the facial feature information, and adjusting eyeball feature parameters of the expression model to be adjusted to match with the eyeball feature information, to obtain the target expression model.

4 . The method according to claim 1 , wherein determining the corresponding expression model to be adjusted based on the expression classification comprises:

determining a plurality of corresponding selectable expression models by utilizing the expression classification;

controlling to render the plurality of selectable expression models;

acquiring a selecting instruction of the user for selecting the expression model to be adjusted from the plurality of selectable expression models;

determining the expression model to be adjusted based on the selecting instruction.

5 . The method according to claim 4 , wherein determining the plurality of corresponding selectable expression models by utilizing the expression classification comprises:

determining corresponding facial proportion information according to the facial image;

determining the plurality of selectable expression models according to the facial proportion information and an expression model library corresponding to the expression classification.

6 . An electronic device, comprising:

at least one processor; and

a memory for storing executable instructions for the at least one processor;

wherein the at least one processor is configured to perform a method by executing the executable instructions, wherein the method comprises:

acquiring a facial image and eyeball feature information of a user;

determining a corresponding expression classification according to the facial image;

determining a corresponding expression model to be adjusted based on the expression classification;

adjusting corresponding parameters of the expression model to be adjusted by utilizing the facial image and the eyeball feature information to obtain a target expression model,

wherein adjusting the corresponding parameters of the expression model to be adjusted by utilizing the facial image and the eyeball feature information to obtain the target expression model comprises:

determining corresponding facial feature information according to the facial image, wherein the facial feature information includes any one or more of: information of a distance between angulus orises at two sides, and information of a vertical distance between an angulus oris at one side or angulus orises at two sides and a labial peak;

adjusting the corresponding parameters of the expression model to be adjusted by utilizing the facial feature information and the eyeball feature information to obtain the target expression model.

7 . The electronic device according to claim 6 , wherein determining the corresponding expression classification according to the facial image comprises:

inputting the facial image into a preset expression recognition model to determine the expression classification, wherein the expression recognition model is a neural network model.

8 . The electronic device according to claim 6 , wherein adjusting the corresponding parameters of the expression model to be adjusted by utilizing the facial feature information and the eyeball feature information to obtain the target expression model comprises:

adjusting facial feature parameters to be adjusted of the expression model to be adjusted to match with the facial feature information, and adjusting eyeball feature parameters of the expression model to be adjusted to match with the eyeball feature information, to obtain the target expression model.

9 . The electronic device according to claim 6 , wherein determining the corresponding expression model to be adjusted based on the expression classification comprises:

determining a plurality of corresponding selectable expression models by utilizing the expression classification;

controlling to render the plurality of selectable expression models;

acquiring a selecting instruction of the user for selecting the expression model to be adjusted from the plurality of selectable expression models;

determining the expression model to be adjusted based on the selecting instruction.

10 . The electronic device according to claim 9 , wherein determining the plurality of corresponding selectable expression models by utilizing the expression classification comprises:

determining corresponding facial proportion information according to the facial image;

determining the plurality of selectable expression models according to the facial proportion information and an expression model library corresponding to the expression classification.

11 . A non-transient computer-readable storage medium having stored thereon computer programs which, when executed by a processor, implement a method, the method comprises:

acquiring a facial image and eyeball feature information of a user;

determining a corresponding expression classification according to the facial image;

determining a corresponding expression model to be adjusted based on the expression classification;

adjusting corresponding parameters of the expression model to be adjusted by utilizing the facial image and the eyeball feature information to obtain a target expression model,

wherein adjusting the corresponding parameters of the expression model to be adjusted by utilizing the facial image and the eyeball feature information to obtain the target expression model comprises:

determining corresponding facial feature information according to the facial image, wherein the facial feature information includes any one or more of: information of a distance between angulus orises at two sides, and information of a vertical distance between an angulus oris at one side or angulus orises at two sides and a labial peak;

adjusting the corresponding parameters of the expression model to be adjusted by utilizing the facial feature information and the eyeball feature information to obtain the target expression model.

12 . The non-transient computer-readable storage medium according to claim 11 , wherein determining the corresponding expression classification according to the facial image comprises:

inputting the facial image into a preset expression recognition model to determine the expression classification, wherein the expression recognition model is a neural network model.

13 . The non-transient computer-readable storage medium according to claim 12 , wherein adjusting the corresponding parameters of the expression model to be adjusted by utilizing the facial feature information and the eyeball feature information to obtain the target expression model comprises:

adjusting facial feature parameters to be adjusted of the expression model to be adjusted to match with the facial feature information, and adjusting eyeball feature parameters of the expression model to be adjusted to match with the eyeball feature information, to obtain the target expression model.

14 . The non-transient computer-readable storage medium according to claim 11 , wherein determining the corresponding expression model to be adjusted based on the expression classification comprises:

determining a plurality of corresponding selectable expression models by utilizing the expression classification;

controlling to render the plurality of selectable expression models;

acquiring a selecting instruction of the user for selecting the expression model to be adjusted from the plurality of selectable expression models;

determining the expression model to be adjusted based on the selecting instruction.

15 . The non-transient computer-readable storage medium according to claim 14 , wherein determining the plurality of corresponding selectable expression models by utilizing the expression classification comprises:

determining corresponding facial proportion information according to the facial image;

determining the plurality of selectable expression models according to the facial proportion information and an expression model library corresponding to the expression classification.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2024
From: HAN, CHEN
To: QINGDAO CHUANGJIAN WEILAI TECHNOLOGY CO., LTD.
Reel/Frame 066840/0039 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2024
From: QINGDAO CHUANGJIAN WEILAI TECHNOLOGY CO., LTD.
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 066840/0816 →
Priority Claims (1)
CN 202111572188.3 · Dec 21, 2021 · national
Continuity (1)
Related Publication 20240346848A1 · Oct 17, 2024
References Cited (23)
US 11328533B1 · Tadi · 2022 [cited by examiner]
US 20110007174A1 · Bacivarov · 2011 [cited by examiner]
US 20140307926A1 · Murakami · 2014 [cited by examiner]
US 20200272806A1 · Walker · 2020 [cited by examiner]
US 20210049350A1 · Wu et al. · 2021 [cited by applicant]
US 20220114838A1 · Xu · 2022 [cited by examiner]
US 20220237892A1 · Anderton-Yang · 2022 [cited by examiner]
US 20220269879A1 · Liu · 2022 [cited by examiner]
US 20250014386A1 · Yan · 2025 [cited by examiner]
US 20250218281A1 · Lan · 2025 [cited by examiner]
US 20250252775A1 · Covell · 2025 [cited by examiner]
CN 105797375A · 2016 [cited by applicant]
CN 105868694A · 2016 [cited by applicant]
CN 106599811A · 2017 [cited by applicant]
CN 106919259A · 2017 [cited by applicant]
CN 108537881A · 2018 [cited by applicant]
CN 110096925A · 2019 [cited by applicant]
CN 110442237A · 2019 [cited by applicant]
CN 110807364A · 2020 [cited by applicant]
CN 111632374A · 2020 [cited by applicant]
CN 112785669A · 2021 [cited by applicant]
International Search Report in PCT/CN2022/125570, mailed Dec. 13, 2022, 6 pages. [cited by applicant]
Office Action for Chinese Patent Application No. 202111572188.3, mailed on Sep. 16, 2025, 12 pages. [cited by applicant]