Emotion estimation device and emotion estimation method

1. An emotion estimation device comprising processing circuitry

to detect facial information related to a facial feature of a driver of a vehicle,

to detect physical information related to a physical feature of the driver,

to estimate driving capability of the driver on a basis of the facial information and the physical information,

to estimate a facial expression of the driver as one from among a positive facial expression, a negative facial expression, and a neutral facial expression on a basis of the facial information, and

to estimate an emotion of the driver represented by a degree of comfort and a degree of activeness on a basis of a temporal change in the driving capability of the driver and the facial expression of the driver.

2. The emotion estimation device according to claim 1 , wherein the processing circuitry estimates the emotion of the driver on a basis of a duration of the facial expression of the driver in a case where it is estimated that the driver is capable of driving.

3. The emotion estimation device according to claim 1 , wherein the processing circuitry determines the degree of comfort and the degree of activeness depending on a duration of the driving capability of the driver and the duration of the facial expression of the driver and estimates the emotion of the driver that corresponds to the degree of comfort and the degree of activeness that have been determined by referring to a predetermined correspondence relation among the degree of comfort, the degree of activeness, and the emotion.

4. The emotion estimation device according to claim 1 , wherein the processing circuitry is further configured to warn the driver or to prompt the driver to switch to autonomous driving depending on the emotion of the driver estimated.

5. The emotion estimation device according to claim 1 , wherein the estimation of the emotion of the driver comprises:

assigning a first number value to the driving capability of the driver; assigning a second number value to the facial expression of the driver;

gradually increasing or decreasing at least one of the first number value and the second number value based on the temporal change in the driving capability of the driver and the temporal change in the facial expression of the driver; and

estimating the emotion of the driver based on the first number value and the second number value.

6. The emotion estimation device according to claim 5 , wherein the processing circuitry is configured to estimate the emotion of the driver from among a plurality of emotions, each of the plurality of emotions corresponding to a respective region in a graph in which one axis represents the driving capability of the driver and another axis represents the facial expression of the driver.

7. The emotion estimation device according to claim 1 , wherein at least one of the degree of comfort and the degree of activeness is changed by an amount that corresponds to a duration of any one of the positive facial expression, the negative facial expression, or the neutral facial expression of the driver.

8. An emotion estimation method performed by processing circuitry comprising:

detecting facial information related to a facial feature of a driver of a vehicle;

detecting physical information related to a physical feature of the driver;

estimating driving capability of the driver on a basis of the facial information and the physical information;

estimating a facial expression of the driver as one from among a positive facial expression, a negative facial expression, and a neutral facial expression on a basis of the facial information; and

estimating an emotion of the driver represented by a degree of comfort and a degree of activeness on a basis of a temporal change in the facial expression of the driver in a case where it is estimated that the driver is capable of driving.