Human centered computing based digital persona generation
In some examples, human centered computing based digital persona generation may include generating, for a digital persona that is to be generated for a target person, synthetic video files and synthetic audio files that are combined to generate synthetic media files. The digital persona may be generated based on a synthetic media file. An inquiry may be received from a user of the generated digital persona. Another synthetic media file may be used by the digital persona to respond to the inquiry. A real-time emotion of the user may be analyzed based on a text sentiment associated with the inquiry, and a voice sentiment and a facial expression associated with the user. Based on the real-time emotion of the user, a further synthetic media file may be utilized by the digital persona to continue or modify a conversation between the generated digital persona and the user.
1. A human centered computing based digital persona generation apparatus comprising:
a face superimposer, executed by at least one hardware processor, to
generate, for a digital persona that is to be generated for a target person, a plurality of synthetic video files;
a speech synthesizer, executed by the at least one hardware processor, to
generate, for the digital persona that is to be generated for the target person, a plurality of synthetic audio files;
a synthetic media generator, executed by the at least one hardware processor, to
generate a plurality of synthetic media files by combining the synthetic video files and the synthetic audio files;
a digital persona generator, executed by the at least one hardware processor, to
generate, based on a synthetic media file of the plurality of synthetic media files, the digital persona displayed as a holographic projection of the target person;
a dialogue and navigation manager, executed by the at least one hardware processor, to
receive, from a user of the generated digital persona, an inquiry, and
utilize, based on an analysis of the inquiry and by the generated digital persona, another synthetic media file of the plurality of synthetic media files to respond to the inquiry; and
a real-time emotion analyzer, executed by the at least one hardware processor, to
analyze a real-time emotion of the user by analyzing a text sentiment associated with the inquiry, a voice sentiment associated with the user, and a facial expression associated with the user.
2. The human centered computing based digital persona generation apparatus according to claim 1 , further comprising:
a conversation adapter, executed by the at least one hardware processor, to
utilize, based on the real-time emotion of the user and by the generated digital persona, a further synthetic media file of the plurality of synthetic media files to continue or modify a conversation between the generated digital persona and the user.
3. The human centered computing based digital persona generation apparatus according to claim 1 , further comprising:
a conversation adapter, executed by the at least one hardware processor, to
utilize, based on a level selected from a plurality of levels associated with the real-time emotion of the user and by the generated digital persona, a further synthetic media file of the plurality of synthetic media files to continue or modify a conversation between the generated digital persona and the user.
4. The human centered computing based digital persona generation apparatus according to claim 1 , further comprising:
a conversation adapter, executed by the at least one hardware processor, to
utilize, based on the real-time emotion of the user, a topic of interest specified by the user, and by the generated digital persona, a further synthetic media file of the plurality of synthetic media files to continue or modify a conversation between the generated digital persona and the user.
5. The human centered computing based digital persona generation apparatus according to claim 1 , further comprising:
a conversation adapter, executed by the at least one hardware processor, to
compare an involvement level of the user to a specified threshold;
based on a determination that the involvement level meets or exceeds the specified threshold, continue a conversation between the generated digital persona and the user; and
based on a determination that the involvement level is less than the specified threshold, modify the conversation between the generated digital persona and the user.
6. The human centered computing based digital persona generation apparatus according to claim 1 , wherein the dialogue and navigation manager is executed by the at least one hardware processor to receive, from the user of the generated digital persona, the inquiry by:
receiving, within a specified time interval associated with monitoring for inquiries, the inquiry from the user.
7. The human centered computing based digital persona generation apparatus according to claim 1 , wherein the dialogue and navigation manager is executed by the at least one hardware processor to:
determine whether a specified time interval associated with monitoring for inquiries is exceeded; and
based on a determination that the specified time interval associated with monitoring for inquiries is exceeded, utilize, by the generated digital persona, a further synthetic media file of the plurality of synthetic media files to prompt the user.
8. The human centered computing based digital persona generation apparatus according to claim 1 , wherein the dialogue and navigation manager is executed by the at least one hardware processor to:
end, based on a keyword in the inquiry, a conversation between the generated digital persona and the user.
9. The human centered computing based digital persona generation apparatus according to claim 1 , wherein the dialogue and navigation manager is executed by the at least one hardware processor to:
determine, based on training associated with a plurality of user utterances, which synthetic media file of the plurality of synthetic media files to utilize to respond to the inquiry.
10. The human centered computing based digital persona generation apparatus according to claim 1 , wherein the speech synthesizer is executed by the at least one hardware processor to generate, for the digital persona that is to be generated for the target person, the plurality of synthetic audio files by:
generating, based on a plurality of audio file samples of different time intervals, for the digital persona that is to be generated for the target person, the plurality of synthetic audio files.
11. A method for human centered computing based digital persona generation, the method comprising:
generating, by at least one hardware processor, for a digital persona that is to be generated for a target person, a plurality of synthetic video files;
generating, by the at least one hardware processor, for the digital persona that is to be generated for the target person, a plurality of synthetic audio files;
generating, by the at least one hardware processor, a plurality of synthetic media files by combining the synthetic video files and the synthetic audio files;
generating, by the at least one hardware processor, based on a synthetic media file of the plurality of synthetic media files, the digital persona displayed as a holographic projection of the target person;
receiving, by the at least one hardware processor, from a user of the generated digital persona, an inquiry; and
analyzing, by the at least one hardware processor, a real-time emotion of the user by analyzing at least one of a text sentiment associated with the inquiry, a voice sentiment associated with the user, or a facial expression associated with the user.
12. The method for human centered computing based digital persona generation according to claim 11 , the method comprising:
utilizing, by the at least one hardware processor, based on an analysis of the inquiry and by the generated digital persona, another synthetic media file of the plurality of synthetic media files to respond to the inquiry.
13. The method for human centered computing based digital persona generation according to claim 11 , the method comprising:
utilizing, by the at least one hardware processor, based on the real-time emotion of the user and by the generated digital persona, a further synthetic media file of the plurality of synthetic media files to continue or modify a conversation between the generated digital persona and the user.
14. A non-transitory computer readable medium having stored thereon machine readable instructions, the machine readable instructions, when executed by at least one hardware processor, cause the at least one hardware processor to:
generate, for a digital persona that is to be generated for a target person, a plurality of synthetic video files;
generate, for the digital persona that is to be generated for the target person, a plurality of synthetic audio files;
generate a plurality of synthetic media files by combining the synthetic video files and the synthetic audio files;
generate, based on a synthetic media file of the plurality of synthetic media files, the digital persona displayed as a holographic projection of the target person;
receive, from a user of the generated digital persona, an inquiry;
utilize, based on an analysis of the inquiry and by the generated digital persona, another synthetic media file of the plurality of synthetic media files to respond to the inquiry;
analyze a real-time emotion of the user by analyzing at least one of a text sentiment associated with the inquiry, a voice sentiment associated with the user, or a facial expression associated with the user; and
utilize, based on the real-time emotion of the user and by the generated digital persona, a further synthetic media file of the plurality of synthetic media files to continue or modify a conversation between the generated digital persona and the user.
15. The non-transitory computer readable medium according to claim 14 , wherein the machine readable instructions, when executed by the at least one hardware processor, further cause the at least one hardware processor to:
determine whether a specified time interval associated with monitoring for inquiries is exceeded; and
based on a determination that the specified time interval associated with monitoring for inquiries is exceeded, utilize, by the generated digital persona, a yet further synthetic media file of the plurality of synthetic media files to prompt the user.
16. The non-transitory computer readable medium according to claim 14 , wherein the machine readable instructions, when executed by the at least one hardware processor, further cause the at least one hardware processor to:
end, based on a keyword in the inquiry, the conversation between the generated digital persona and the user.
17. The non-transitory computer readable medium according to claim 14 , wherein the machine readable instructions to utilize, based on the real-time emotion of the user and by the generated digital persona, the further synthetic media file of the plurality of synthetic media files to continue or modify the conversation between the generated digital persona and the user, when executed by the at least one hardware processor, further cause the at least one hardware processor to:
compare an involvement level of the user to a specified threshold;
based on a determination that the involvement level meets or exceeds the specified threshold, continue the conversation between the generated digital persona and the user; and
based on a determination that the involvement level is less than the specified threshold, modify the conversation between the generated digital persona and the user.