IP Library Granted Patent US 12688730
Granted Patent B2
US 12688730 · App. 18/690,079 · Granted Jul 21, 2026

Method, system, and program for facial expression evaluation using reference and measurement result

Inventors: Akane Kitagawa (Kyoto, JP); Koichi Murata (Kyoto, JP); Yasuyuki Uraoka (Kyoto, JP); Masafumi Furuta (Kyoto, JP)
Assignee: SHIMADZU CORPORATION
G06V40/174A61B5/16A61B5/389G06V40/168G06V40/176A61B5/165
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12688730
App. No.
18/690,079
Granted
Jul 21, 2026
Kind
B2
Abstract

A computer evaluates a facial expression of a subject. More specifically, the computer obtains a reference for physiological information of a facial area of the subject in response to occurrence of a given incident. Further, the computer obtains a measurement result of the physiological information of the facial area of the subject at a targeted timing for evaluation. The computer generates evaluation information about a facial expression of the subject using the reference and the measurement result, and outputs the evaluation information.

Claims (30)

1 . A method for evaluating a facial expression of a subject, comprising:

obtaining a reference for physiological information of a facial area of the subject;

obtaining a measurement result of the physiological information of the facial area of the subject at a targeted timing for evaluation;

generating evaluation information about a facial expression of the subject using the reference and the measurement result; and

outputting the evaluation information

wherein a reference value is obtained as the reference for the physiological information of the facial area of the subject and a measurement value is obtained as the measurement result of the physiological information of the facial area of the subject, and

wherein the method further comprises updating the reference value by replacing the reference value with the measurement value when the measurement value exceeds the reference value.

2 . The method according to claim 1 , wherein the generating evaluation information about a facial expression of the subject includes calculating the evaluation information using a ratio of the measurement value to the reference value.

3 . The method according to claim 1 , wherein the reference value and the measurement value each include one or more types of feature values of a face of the subject that are obtained from a facial image of the subject.

4 . The method according to claim 3 , wherein the one or more types of feature values include at least one of a first feature value changing as a cheek moves and a second feature value changing as two eyebrows move.

5 . The method according to claim 4 , wherein the first feature value is a distance between a nose and a corner of a mouth.

6 . The method according to claim 4 , wherein the second feature value is a distance between the two eyebrows.

7 . The method according to claim 1 , wherein the physiological information of the facial area of the subject is obtained from a myoelectric potential signal of a facial muscle of the subject.

8 . The method according to claim 7 , wherein the facial muscle includes at least one of a muscle in a vicinity of a cheek and a muscle in a vicinity of an eyebrow.

9 . The method according to claim 1 , wherein the physiological information of the facial area of the subject is obtained from a facial image of the subject.

10 . The method according to claim 1 , further comprising outputting content for obtaining the reference, wherein the obtaining a reference is performed in response to the content being output.

11 . The method according to claim 1 , further comprising detecting a new subject as a target for evaluating a facial expression, wherein the obtaining a reference is performed in response to the new subject being detected.

12 . A system for evaluating a facial expression of a subject, comprising:

a processor; and

an interface that obtains physiological information of a facial area of the subject,

wherein the processor generates evaluation information about a facial expression of the subject using a reference for the physiological information of the facial area of the subject and a measurement result of the physiological information of the facial area of the subject obtained at a targeted timing for evaluation, and outputs the evaluation information,

wherein a reference value is obtained as the reference for the physiological information of the facial area of the subject and a measurement value is obtained as the measurement result of the physiological information of the facial area of the subject, and

wherein the processor updates the reference value by replacing the reference value with the measurement value when the measurement value exceeds the reference value.

13 . A non-transitory computer-readable storage medium storing a program for causing an evaluation of a facial expression of a subject, the program being executed by a processor of a computer to cause the computer to perform:

obtaining a reference for physiological information of a facial area of the subject;

obtaining a measurement result of the physiological information of the facial area of the subject at a targeted timing for evaluation;

generating evaluation information about a facial expression of the subject using the reference and the measurement result; and

outputting the evaluation information,

wherein a reference value is obtained as the reference for the physiological information of the facial area of the subject and a measurement value is obtained as the measurement result of the physiological information of the facial area of the subject, and

wherein the program further causes the computer to perform updating the reference value by replacing the reference value with the measurement value when the measurement value exceeds the reference value.