Information processing device, information processing method, and program
An information processing device includes an emotion recognition unit, a facial expression output unit, and an avatar composition unit. The emotion recognition unit recognizes an emotion on the basis of a speech waveform. The facial expression output unit outputs a facial expression corresponding to the emotion. The avatar composition unit composes an avatar showing the output facial expression.
1. An information processing device comprising:
circuitry including a CPU that is configured to
recognize an emotion based on a speech waveform;
output a facial expression corresponding to the emotion;
compose an avatar showing the facial expression; and
compose a background corresponding to a scene estimated based on the speech waveform or uttered contents, wherein
the circuitry is further configured to
extract a waveform component indicating an environmental sound from the speech waveform; and
determine the background based on the waveform component.
2. The information processing device according to claim 1 , wherein
the circuitry is further configured to
recognize an excitement degree based on the speech waveform and the uttered contents; and
output the facial expression reflecting the excitement degree.
3. The information processing device according to claim 2 , wherein
the circuitry is further configured to recognize a gesture based on the uttered contents; and
output an action of the avatar which action corresponds to the gesture.
4. The information processing device according to claim 3 , wherein
the circuitry is further configured to output the action reflecting the excitement degree.
5. The information processing device according to claim 3 , wherein
the circuitry is further configured to output the action corresponding to a scene estimated based on the speech waveform.
6. The information processing device according to claim 1 , wherein
the circuitry is further configured to
search for one or more background candidates indicating an environment similar to an environment in which the environmental sound is generated; and
use one background candidate selected based on user input information as the background for the avatar.
7. The information processing device according to claim 1 , wherein
the circuitry is further configured to generate the avatar by using data of a character estimated based on the speech waveform.
8. The information processing device according to claim 7 , wherein
the circuitry is further configured to
search for one or more character candidates having a voice quality similar to the speech waveform; and
use one character candidate selected based on user input information as the character for the avatar.
9. The information processing device according to claim 8 , wherein
the circuitry is further configured to
generate a facial expression corresponding to the speech waveform for each of the one or more character candidates; and
present facial expressions of the one or more character candidates as selection targets.
10. The information processing device according to claim 1 , wherein
the circuitry is further configured to output a video including the avatar, wherein
the video includes speech data from which the speech waveform is extracted in a case where mute setting is OFF, and the video does not include the speech data in a case where the mute setting is ON.
11. An information processing method executed by a computer, the method comprising:
recognizing an emotion based on a speech waveform;
outputting a facial expression corresponding to the emotion;
composing an avatar showing the facial expression; and
composing a background corresponding to a scene estimated based on the speech waveform or uttered contents, wherein
the method further comprises
extracting a waveform component indicating an environmental sound from the speech waveform; and
determining the background based on the waveform component.
12. A non-transitory computer-readable storage medium storing a program for causing a computer to perform processing comprising:
recognizing an emotion based on a speech waveform;
outputting a facial expression corresponding to the emotion; and
composing an avatar showing the facial expression by using data of a character estimated based on the speech waveform, wherein
the processing further comprises
searching for one or more character candidates having a voice quality similar to the speech waveform; and
using one character candidate selected based on user input information as the character for the avatar.