System and method for dual mode presentation of content in a target language to improve listening fluency in the target language
Embodiments of a language learning system and method for implementing or assisting in self-study for improving listening fluency in a target language are disclosed. Such embodiments may simultaneously present the same piece of content in an auditory presentation and generate a corresponding visual interface, where the two presentations are adapted to work in tandem to increase the effectiveness of language learning for users.
1. A system for language learning, comprising:
a device, including a processor and an application comprising instructions to:
obtain an audio file and a corresponding transcript and timing file, wherein the transcript and timing file corresponds to the audio file and comprises words of a transcript of content of the audio file and associated word level timestamp for words of the transcript of the content of the audio file;
auditorily present the content of the audio file using an audio player at the device;
simultaneously with the auditory presentation of the content of the audio file, dynamically generate an interface using the transcript and timing file, the interface including a visual display associated with the content of the audio file in a target language, wherein:
the application is adapted to operate in a structural comprehension mode for auditory presentation of the content of the audio file in synchronization with a first type of visual presentation of the transcript of the content, the first type of visual presentation comprising a first level of redaction of words of the transcript of the content, and
a detailed comprehension mode adapted for increased interaction with the presentation of the content by presenting the content of the audio file in synchronization with a second type of visual presentation of the transcript of the content comprising a second level of redaction of words of the transcript,
wherein the application is adapted to transition between the structural comprehension mode and the detailed comprehension mode during presentation of the content to:
in the structural comprehension mode, auditorily present a portion of the content in synchronization with the first type of visual presentation of the transcript of that portion of content having the first level of redaction in association with a first level of controls, and,
when a transition between the modes is made, to auditorily present the portion of the content in synchronization with the second type of visual presentation of the transcript of that portion of content having the second level of redaction in association with a second level of controls in the detailed comprehension mode, the second level of controls is greater than the first level of controls.
2. The system of claim 1 , wherein the structural comprehension mode is dark themed and the detailed comprehension mode is light themed.
3. The system of claim 1 , wherein in the detailed comprehension mode the interface includes a delayed pause button, and the application is adapted to, in response to a first interaction with the delayed pause button, continue to auditorily present the content of the audio file until the end of a portion of the content.
4. The system of claim 3 , wherein the portion of the content is specified in the transcript and timing file.
5. The system of claim 3 , wherein the application is adapted to, in response to a second interaction with the delayed pause button, immediately pause the auditory presentation of the content of the audio file.
6. The system of claim 1 , wherein the structural comprehension mode includes a guided listen mode and in the guided listen mode the application is adapted to present a set of guides in the interface by dynamically generating the guides in the interface in synchronization with the auditory presentation of the content.
7. The system of claim 1 , wherein in the structural comprehension mode the application is adapted to mark a set of portions for study based on interaction with the interface without pausing the auditory presentation of the content of the audio file, and in the detailed comprehension mode the application is adapted to iterate over the marked set of portions based on interaction with the interface.
8. A method for language learning, comprising:
obtaining an audio file and a corresponding transcript and timing file, wherein the transcript and timing file corresponds to the audio file and comprises words of a transcript of content of the audio file and associated word level timestamp for words of the transcript of the content of the audio file;
auditorily present the content of the audio file using an audio player at a client device in a structural comprehension mode or a detailed comprehension mode;
simultaneously with the auditory presentation of the content of the audio file, dynamically generating an interface using the transcript and timing file, the interface including a visual display associated with the content of the audio file in a target language, wherein
the structural comprehension mode is adapted for auditory presentation of the content of the audio file in synchronization with a first type of visual presentation of the transcript of the content, the first type of visual presentation comprising a first level of redaction of words of the transcript of the content, and
the detailed comprehension mode is adapted for increased interaction with the presentation of the content by presenting the content of the audio file in synchronization with a second type of visual presentation of the transcript of the content comprising a second level of redaction of words of the transcript; and
transitioning between the structural comprehension mode and the detailed comprehension mode during presentation of the content to, in the structural comprehension mode, auditorily present a portion of the content in synchronization with the first type of visual presentation of the transcript of that portion of content having the first level of redaction in association with a first level of controls, and
when a transition between the modes is made, to auditorily present the portion of the content in synchronization with the second type of visual presentation of the transcript of that portion of content having the second level of redaction in association with a second level of controls in the detailed comprehension mode, the second level of controls is greater than the first level of controls.
9. The method of claim 8 , wherein the structural comprehension mode is dark themed and the detailed comprehension mode is light themed.
10. The method of claim 8 , wherein in the detailed comprehension mode the interface includes a delayed pause button and, in response to a first interaction with the delayed pause button, the presentation of the content of the audio file is continued until the end of a portion of the content.
11. The method of claim 10 , wherein the portion of the content is specified in the transcript and timing file.
12. The method of claim 10 , wherein in response to a second interaction with the delayed pause button, the auditory presentation of the content of the audio file is immediately paused.
13. The method of claim 8 , wherein the structural comprehension mode includes a guided listen mode and in the guided listen mode a set of guides is presented in the interface by dynamically generating the guides in the interface in synchronization with the auditory presentation of the content.
14. The method of claim 8 , wherein in the structural comprehension mode a set of portions is marked for study based on interaction with the interface without pausing the auditory presentation of the content of the audio file, and in the detailed comprehension mode the marked set of portions is iterated over based on interaction with the interface.
15. A non-transitory computer readable medium, comprising instructions for:
obtaining an audio file and a corresponding transcript and timing file, wherein the transcript and timing file corresponds to the audio file and comprises words of a transcript of content of the audio file and associated word level timestamp for words of the transcript of the content of the audio file;
auditorily present the content of the audio file using an audio player at a client device in a structural comprehension mode or a detailed comprehension mode;
simultaneously with the auditory presentation of the content of the audio file, dynamically generating an interface using the transcript and timing file, the interface including a visual display associated with the content of the audio file in a target language, wherein
the structural comprehension mode is adapted for auditory presentation of the content of the audio file in synchronization with a first type of visual presentation of the transcript of the content, the first type of visual presentation comprising a first level of redaction of words of the transcript of the content, and
the detailed comprehension mode is adapted for increased interaction with the presentation of the content by presenting the content of the audio file in synchronization with a second type of visual presentation of the transcript of the content comprising a second level of redaction of words of the transcript; and
transitioning between the structural comprehension mode and the detailed comprehension mode during presentation of the content to, in the structural comprehension mode, auditorily present a portion of the content in synchronization with the first type of visual presentation of the transcript of that portion of content having the first level of redaction in association with a first level of controls, and
when a transition between the modes is made, to auditorily present the portion of the content in synchronization with the second type of visual presentation of the transcript of that portion of content having the second level of redaction in association with a second level of controls in the detailed comprehension mode, the second level of controls is greater than the first level of controls.
16. The non-transitory computer readable medium of claim 15 , wherein the structural comprehension mode is dark themed and the detailed comprehension mode is light themed.
17. The non-transitory computer readable medium of claim 15 , wherein in the detailed comprehension mode the interface includes a delayed pause button and, in response to a first interaction with the delayed pause button, the presentation of the content of the audio file is continued until the end of a portion of the content.
18. The non-transitory computer readable medium of claim 17 , wherein the portion of the content is specified in the transcript and timing file.
19. The non-transitory computer readable medium of claim 17 , wherein in response to a second interaction with the delayed pause button, the auditory presentation of the content of the audio file is immediately paused.
20. The non-transitory computer readable medium of claim 15 , wherein the structural comprehension mode includes a guided listen mode and in the guided listen mode a set of guides is presented in the interface by dynamically generating the guides in the interface in synchronization with the auditory presentation of the content.
21. The non-transitory computer readable medium of claim 15 , wherein in the structural comprehension mode a set of portions is marked for study based on interaction with the interface without pausing the auditory presentation of the content of the audio file, and in the detailed comprehension mode the marked set of portions is iterated over based on interaction with the interface.