Emotion-based sign language enhancement of content
A content enhancement system includes a computing platform having processing hardware and a system memory storing software code. The processing hardware is configured to execute the software code to receive audio-video (A/V) content, to execute at least one of a visual analysis or an audio analysis of the A/V content, and to determine, based on executing the at least one of the visual analysis or the audio analysis, an emotional aspect of the A/V content. The processing hardware is further configured to execute the software code to generate, using the emotional aspect of the A/V content, a sign language translation of the A/V content, the sign language translation including one or more of a gesture, a posture, or a facial expression conveying the emotional aspect.
1. A content enhancement system comprising:
a computing platform including a processing hardware and a system memory storing a character profile database and a software code, the character profile database including a first emotive profile associated with a first animated character for conveying an emotion using one or more of a first gesture, a first posture, or a first facial expression and a second emotive profile associated with a second animated character for conveying the emotion using one or more of a second gesture, a second posture, or a second facial expression different from the first gesture, the first posture, or the first facial expression, respectively;
the processing hardware configured to execute the software code to:
receive video content;
execute a visual analysis of the video content;
determine, based on executing the visual analysis of the video content, an emotional aspect of the video content being the emotion;
identify one of the first animated character or the second animated character for performing the sign language enhancement;
obtain, from the character profile database, one of the first emotive profile or the second emotive profile corresponding to the identified one of the first animated character or the second animated character; and
generate, using the emotional aspect of the video content and the obtained one of the first emotive profile or the second emotive profile, a sign language enhancement conveying the emotion using one or more of the first gesture, the first posture, or the first facial expression or one or more of the second gesture, the second posture, or the second facial expression of the obtained one of the first emotive profile or the second emotive profile, respectively.
2. The content enhancement system of claim 1 , further comprising:
a display;
wherein the processing hardware is further configured to execute the software code to:
render the video content on the display; and
render the sign language enhancement on the display concurrently with rendering the video content corresponding to the sign language enhancement.
3. The content enhancement system of claim 1 , wherein the identified one of the first animated character or the second animated character is selectable by a user based on a subject matter of the video content.
4. The content enhancement system of claim 1 , further comprising:
a display;
wherein the processing hardware is further configured to execute the software code to:
render the video content on the display for viewing by all of a plurality of users concurrently viewing the video content on the display; and
contemporaneously with rendering the video content on the display, render the sign language enhancement such that the sign language enhancement is visible to at least one of the plurality of users on another display, but not all of the plurality of users concurrently viewing the video content on the display.
5. The content enhancement system of claim 1 , wherein the video content is further accompanied with at least one of audio content or text, and wherein the processing hardware is further configured to execute the software code to determine the emotional aspect further based on analyzing the at least one of the audio content or the text.
6. The content enhancement system of claim 1 , wherein the video content includes a plurality of video frames, and wherein the processing hardware is further configured to execute the software code to execute the visual analysis on a frame-by-frame basis.
7. The content enhancement system of claim 1 , wherein the processing hardware is further configured to execute the software code to:
synchronize the sign language enhancement with a timecode of the video content to produce an enhanced video content; and
record the enhanced video content, or broadcast or stream the enhanced video content to a user system.
8. The content enhancement system of claim 1 , further comprising at least one machine learning (ML) model-based emotion analyzer, wherein the emotional aspect of the video content is determined using the at least one ML model-based emotion analyzer.
9. The content enhancement system of claim 1 , wherein the first emotive profile defines the first animated character that is more excitable than the second animated character defined by the second emotive profile, wherein the first animated character conveys the emotion with one or more exaggerated facial expressions, emphatic gestures, or frequent changes in posture than the second animated character.
10. The content enhancement system of claim 1 , wherein the first emotive profile defines the first animated character that is more stoic than the second animated character defined by the second emotive profile, wherein the first animated character conveys the emotion with one or more subdued facial expressions, subdued gestures, or less body movements than the second animated character.
11. A method for use by a content enhancement system including a computing platform having a processing hardware and a system memory storing a character profile database and a software code, the character profile database including a first emotive profile associated with a first animated character for conveying an emotion using one or more of a first gesture, a first posture, or a first facial expression and a second emotive profile associated with a second animated character for conveying the emotion using one or more of a second gesture, a second posture, or a second facial expression different from the first gesture, the first posture, or the first facial expression, respectively, the method comprising:
receiving, by the software code executed by the processing hardware, video content;
executing, by the software code executed by the processing hardware, a visual analysis of the video content;
determining, by the software code executed by the processing hardware, based on executing the visual analysis of the video content, an emotional aspect of the video content being the emotion;
identifying, by the software code executed by the processing hardware, one of the first animated character or the second animated character for performing the sign language enhancement;
obtaining, by the software code executed by the processing hardware, from the character profile database, one of the first emotive profile or the second emotive profile corresponding to the identified one of the first animated character or the second animated character; and
generating, by the software code executed by the processing hardware, using the emotional aspect of the video content and the obtained one of the first emotive profile or the second emotive profile, a sign language enhancement conveying the emotion using one or more of the first gesture, the first posture, or the first facial expression or one or more of the second gesture, the second posture, or the second facial expression of the obtained one of the first emotive profile or the second emotive profile, respectively.
12. The method of claim 11 , wherein the content enhancement system further comprises a display, the method further comprising:
rendering, by the software code executed by the processing hardware, the video content on the display; and
rendering, by the software code executed by the processing hardware, the sign language enhancement on the display concurrently with rendering the video content corresponding to the sign language enhancement.
13. The method of claim 11 , wherein the identified one of the first animated character or the second animated character is selectable by a user based on a subject matter of the video content.
14. The method of claim 11 , wherein the content enhancement system further comprises a display, the method further comprising:
rendering, by the software code executed by the processing hardware, the video content on the display for viewing by all of a plurality of users concurrently viewing the video content on the display; and
contemporaneously with rendering the video content on the display, rendering, by the software code executed by the processing hardware, the sign language enhancement such that the sign language enhancement is visible to at least one of the plurality of users on another display, but not all of the plurality of users concurrently viewing the video content on the display.
15. The method of claim 11 , wherein the video content is further accompanied with at least one of audio content or text, and wherein the emotional aspect is determined further based on analyzing, by the software code executed by the processing hardware, the at least one of the audio content or the text.
16. The method of claim 11 , wherein the video content includes a plurality of video frames, and wherein the software code, executed by the processing hardware, executes the visual analysis on a frame-by-frame basis.
17. The method of claim 11 , further comprising:
synchronizing, by the software code executed by the processing hardware, the sign language enhancement with a timecode of the video content to produce an enhanced video content; and
recording, by the software code executed by the processing hardware, the enhanced video content, or broadcasting or streaming the enhanced video content to a user system.
18. The method of claim 11 , wherein the content enhancement system further comprises at least one machine learning (ML) model-based emotion analyzer, and wherein the emotional aspect of the video content is determined using the at least one ML model-based emotion analyzer.
19. The method of claim 11 , wherein the first emotive profile defines the first animated character that is more excitable than the second animated character defined by the second emotive profile, wherein the first animated character conveys the emotion with one or more exaggerated facial expressions, emphatic gestures, or frequent changes in posture than the second animated character.
20. The method of claim 11 , wherein the first emotive profile defines the first animated character that is more stoic than the second animated character defined by the second emotive profile, wherein the first animated character conveys the emotion with one or more subdued facial expressions, subdued gestures, or less body movements than the second animated character.