System and method for dual mode presentation of content in a target language to improve listening fluency in the target language
Embodiments of a language learning system and method for implementing or assisting in self-study for improving listening fluency in a target language are disclosed. Such embodiments may simultaneously present the same piece of content in an auditory presentation and a corresponding visual presentation of a transcript of the auditory presentation, where the two presentations are adapted to work in tandem to increase the effectiveness of language learning for users.
1. A system for language learning, comprising:
a processor; and
a non-transitory computer readable medium comprising instructions to:
obtain an audio file and a corresponding transcript and timing file, the transcript and timing file comprising words of a transcript of content of the audio file;
auditorily present the content of the audio file;
simultaneously with the auditory presentation of the content of the audio file, generate an interface using the transcript and timing file, the interface including a visual display, the visual display synchronized with the auditory presentation of the content and presenting a visual transcript of the content in a target language, wherein:
the visual transcript includes a visual transcript of a set of characters comprising the content,
the visual transcript of the set of characters includes a redacted character, and
the redacted character is redacted by presenting a corresponding lozenge for the redacted character in the visual display, wherein a visual appearance of the corresponding lozenge for the redacted character communicates a structure or expression of the redacted character, and synchronizing the visual display of the visual transcript of the content with the auditory presentation of the content comprises:
determining that the redacted character is being presented in the auditory presentation of the content;
highlighting the presentation of the corresponding lozenge of the redacted character in the visual display substantially simultaneously with the auditory presentation of that character in the auditory presentation.
2. The system of claim 1 , wherein the structure or expression is a number of syllables of the character.
3. The system of claim 2 , wherein the lozenge comprises at least one embedded dot corresponding to the number of syllables of the character.
4. The system of claim 1 , wherein the structure or expression comprises a class of the redacted character.
5. The system of claim 4 , wherein a color of the lozenge indicates the class of the redacted character.
6. The system of claim 5 , wherein the class of the redacted character is a kanji, a hiragana, a katakana, or a romaji.
7. The system of claim 1 , wherein the redacted character is an alphabetic character that comprises an alphabetic font, and wherein a vertical height of the lozenge corresponds to a distance between a baseline and a mean line of the alphabetic font.
8. A method for language learning, comprising:
obtaining an audio file and a corresponding transcript and timing file, the transcript and timing file comprising words of a transcript of content of the audio file;
auditorily present the content of the audio file;
simultaneously with the auditory presentation of the content of the audio file, generating an interface at an electronic device using the transcript and timing file, the interface including a visual display, the visual display synchronized with the auditory presentation of the content and presenting a visual transcript of the content in a target language, wherein:
the visual transcript includes a visual transcript of a set of characters comprising the content,
the visual transcript of the set of characters includes a redacted character, and
the redacted character is redacted by presenting a corresponding lozenge for the redacted character in the visual display, wherein a visual appearance of the corresponding lozenge for the redacted character communicates a structure or expression of the redacted character, and synchronizing the visual display of the visual transcript of the content with the auditory presentation of the content comprises:
determining that the redacted character is being presented in the auditory presentation of the content; and
highlighting the presentation of the corresponding lozenge of the redacted character in the visual display substantially simultaneously with the auditory presentation of that character in the auditory presentation.
9. The method of claim 8 , wherein the structure or expression is a number of syllables of the character.
10. The method of claim 9 , wherein the lozenge comprises at least one embedded dot corresponding to the number of syllables of the character.
11. The method of claim 8 , wherein the structure or expression comprises a class of the redacted character.
12. The method of claim 11 , wherein a color of the lozenge indicates the class of the redacted character.
13. The method of claim 12 , wherein the class of the redacted character is a kanji, a hiragana, a katakana, or a romaji.
14. The method of claim 8 , wherein the redacted character is an alphabetic character that comprises an alphabetic font, and wherein a vertical height of the lozenge corresponds to a distance between a baseline and a mean line of the alphabetic font.
15. A non-transitory computer readable medium, comprising instructions for:
obtaining an audio file and a corresponding transcript and timing file, the transcript and timing file comprising words of a transcript of content of the audio file;
auditorily present the content of the audio file;
simultaneously with the auditory presentation of the content of the audio file, generating an interface at an electronic device using the transcript and timing file, the interface including a visual display, the visual display synchronized with the auditory presentation of the content and presenting a visual transcript of the content in a target language, wherein:
the visual transcript includes a visual transcript of a set of characters comprising the content,
the visual transcript of the set of characters includes a redacted character, and
the redacted character is redacted by presenting a corresponding lozenge for the redacted character in the visual display, wherein a visual appearance of the corresponding lozenge for the redacted character communicates a structure or expression of the redacted character, and synchronizing the visual display of the visual transcript of the content with the auditory presentation of the content comprises:
determining that the redacted character is being presented in the auditory presentation of the content; and
highlighting the presentation of the corresponding lozenge of the redacted character in the visual display substantially simultaneously with the auditory presentation of that character in the auditory presentation.
16. The non-transitory computer readable medium of claim 15 , wherein the structure or expression is a number of syllables of the character.
17. The non-transitory computer readable medium of claim 16 , wherein the lozenge comprises at least one embedded dot corresponding to the number of syllables of the character.
18. The non-transitory computer readable medium of claim 15 , wherein the structure or expression comprises a class of the redacted character.
19. The non-transitory computer readable medium of claim 18 , wherein a color of the lozenge indicates the class of the redacted character.
20. The non-transitory computer readable medium of claim 19 , wherein the class of the redacted character is a kanji, a hiragana, a katakana, or a romaji.
21. The non-transitory computer readable medium of claim 15 , wherein the redacted character is an alphabetic character that comprises an alphabetic font, and wherein a vertical height of the lozenge corresponds to a distance between a baseline and a mean line of the alphabetic font.