EXPRESSION GENERATING DEVICE, EXPRESSION GENERATING METHOD AND EXPRESSION GENERATING PROGRAM
An expression generation device includes a memory and processing circuitry configured to acquire, as processing targets, a face feature related to a face image of a person and a brainwave of the person, estimate an expression feature of the acquired brainwave by using a first model obtained by performing learning on a relationship between a brainwave and an expression feature related to an expression image, which is an image representing an expression, and generate a face image with an expression by using the face feature and the estimated expression feature.
1 . An expression generation device comprising:
a memory; and
processing circuitry configured to:
acquire, as processing targets, a face feature related to a face image of a person and a brainwave of the person;
estimate an expression feature of the acquired brainwave by using a first model obtained by performing learning on a relationship between a brainwave and an expression feature related to an expression image, which is an image representing an expression; and
generate a face image with an expression by using the face feature and the estimated expression feature.
2 . The expression generation device according to claim 1 , wherein the processing circuitry is further configured to perform learning on the first model.
3 . The expression generation device according to claim 1 , wherein the processing circuitry is further configured to estimate an internal-state feature of the acquired brainwave by using a second model obtained by performing learning on a relationship between a brainwave and an internal-state feature related to an internal state representing an emotion state, and estimate an expression feature of the acquired brainwave by using a third model obtained by performing learning on a relationship between an internal-state feature related to an internal state and an expression feature related to an expression image in the internal state.
4 . The expression generation device according to claim 3 , wherein the processing circuitry is further configured to perform learning on the second model and the third model.
5 . The expression generation device according to claim 1 , wherein the processing circuitry is further configured to estimate an action-unit feature of the acquired brainwave by using a fourth model obtained by performing learning on a relationship between a brainwave and an action-unit feature related to an action unit representing movements of facial muscles when expressing the expression, and estimate an expression feature based on the estimated action-unit feature.
6 . The expression generation device according to claim 5 , wherein the processing circuitry is further configured to perform learning on the fourth model.
7 . An expression generation method executed by an expression generation device, the expression generation method comprising:
acquiring, as processing targets, a face feature related to a face image of a person and a brainwave of the person;
estimating an expression feature of the acquired brainwave by using a first model obtained by performing learning on a relationship between a brainwave and an expression feature related to an expression image, which is an image representing an expression; and
generating a face image with an expression by using the face feature and the estimated expression feature.
8 . A non-transitory computer-readable recording medium storing therein an expression generation program that causes a computer to execute a process comprising:
acquiring, as processing targets, a face feature related to a face image of a person and a brainwave of the person;
estimating an expression feature of the acquired brainwave by using a first model obtained by performing learning on a relationship between a brainwave and an expression feature related to an expression image, which is an image representing an expression; and
generating a face image with an expression by using the face feature and the estimated expression feature.