TRANSLATION OF SIGN LANGUAGE CONTENT
A communication system may include a communication device configured to receive a video stream including sign language content and any content indicators associated with the video stream during a real-time communication session within a single communication device or between a plurality of communication devices. The communication system may also include a translation engine configured to automatically translate the sign language content into word content during the real-time communication session without assistance of a human sign language interpreter. Further, the communication system may be configured to output the word content translation to a communication device during the real-time communication session.
1 . A system, comprising:
one or more computer readable medias configured to store instructions; and
one or more processing systems coupled to the one or more computer readable medias, the one or more processing systems configured to execute the instructions to cause or direct the system to perform operations, the operations comprising:
obtain a video stream that includes sign language content; and
translate the sign language content into word content using one or more content indicators from the video stream, the one or more content indicators including a size and/or a speed of a motion pattern that is used to make a sign in the video stream that represents a phrase of the word content, an interpretation of the motion pattern as representing the phrase not being affected by the size and/or the speed of the motion pattern.
2 . The system of claim 1 , wherein the one or more content indicators comprises the size of the motion pattern and the speed of the motion pattern.
3 . The system of claim 1 , wherein the one or more content indicators further include one or more of: a head position, a head motion, a face position, a face motion, a body position, and a body motion.
4 . The system of claim 1 , wherein the motion pattern is formed by a hand and/or arm of a person performing the sign language content.
5 . The system of claim 1 , wherein the operations further comprise direct the word content to a communication device for presentation by the communication device.
6 . The system of claim 5 , wherein the video stream is obtained from a second communication device that is participating in a communication session with the communication device.
7 . The system of claim 1 , wherein the system is part of a video relay service.
8 . The system of claim 1 , wherein the phrase includes one or more letters, one or more numbers, or one or more words.
9 . The system of claim 1 , wherein the operations further comprise:
obtain second word content;
translate the second word content into second sign language content; and
direct the second sign language content to a communication device.
10 . The system of claim 9 , wherein the video stream is obtained from the communication device.
11 . A method of performing automated translation, the method comprising:
obtaining a video stream that includes sign language content; and
translating the sign language content into word content using one or more content indicators from the video stream, the one or more content indicators including a size and/or a speed of a motion pattern that is used to make a sign in the video stream that represents a phrase of the word content, an interpretation of the motion pattern as representing the phrase not being affected by the size and/or the speed of the motion pattern.
12 . The method of claim 11 , wherein the one or more content indicators comprises the size of the motion pattern and the speed of the motion pattern.
13 . The method of claim 11 , wherein the one or more content indicators further include one or more of: a head position, a head motion, a face position, a face motion, a body position, and a body motion.
14 . The method of claim 11 , wherein the motion pattern is formed by a hand and/or arm of a person performing the sign language content.
15 . The method of claim 11 , further comprising directing the word content to a communication device for presentation by the communication device.
16 . The method of claim 15 , wherein the video stream is obtained from a second communication device that is participating in a communication session with the communication device.
17 . The method of claim 11 , wherein the method is performed by a video relay service.
18 . The method of claim 11 , wherein the phrase includes one or more letters, one or more numbers, or one or more words.
19 . The method of claim 11 , further comprising:
obtaining second word content;
translating the second word content into second sign language content; and
directing the second sign language content to a communication device.
20 . One or more non-transitory computer-readable media configured to store instructions that when executed by a system cause or direct the system to perform operations, the operations comprising:
obtaining a video stream that includes sign language content; and
translating the sign language content into word content using one or more content indicators from the video stream, the one or more content indicators including a size and/or a speed of a motion pattern that is used to make a sign in the video stream that represents a phrase of the word content, an interpretation of the motion pattern as representing the phrase not being affected by the size and/or the speed of the motion pattern.