System and method for digital video retrieval involving speech recognition
View Patent ↗Disclosed are systems, methods, and computer readable media for retrieving digital images. The method embodiment includes converting a descriptive audio stream of a digital video that is provided for the visually impaired to text and then aligning that text to the appropriate segment of the digital video. The system then indexes the converted text from the descriptive audio stream with the text's relationship to the digital video. The system enables queries using action words describing a desired scene from a digital video.
1. A method comprising:
receiving a query for a portion of a video;
identifying, via a processor, the portion of the video using an index, wherein the index is generated by aligning text from a digital audio stream associated with the video to frames in the video based on a non-textual optical analysis of the video, and wherein the aligning of the text utilizes a first bit rate associated with the frames in the video and a second bit rate associated with the digital audio stream; and
presenting the portion of the video in response to the query.
2. The method of claim 1 , wherein the query is an action word describing the portion of the video.
3. The method of claim 1 , wherein the index is generated upon receiving the query.
4. The method of claim 1 , wherein the text from the digital audio stream is provided for visually impaired audiences.
5. The method of claim 1 , wherein the aligning of the text from the digital audio stream to the frames in the video further comprises converting the digital audio stream to the text using the non-textual optical analysis of the video.
6. The method of claim 5 , wherein the non-textual optical analysis recognizes objects within the video.
7. A system comprising:
a processor; and
a computer-readable storage device having instructions stored which, when executed by the processor, cause the processor to perform operations comprising:
receiving a query for a portion of a video;
identifying the portion of the video using an index, wherein the index is generated by aligning text from a digital audio stream associated with the video to frames in the video based on a non-textual optical analysis of the video, and wherein the aligning of the text utilizes a first bit rate associated with the frames in the video and a second bit rate associated with the digital audio stream; and
presenting the portion of the video in response to the query.
8. The system of claim 7 , wherein the query is an action word describing the portion of the video.
9. The system of claim 7 , wherein the index is generated upon receiving the query.
10. The system of claim 7 , wherein the text from the digital audio stream is provided for visually impaired audiences.
11. The system of claim 7 , wherein the aligning of the text from the digital audio stream to the frames in the video further comprises converting the digital audio stream to the text using the non-textual optical analysis of the video.
12. The system of claim 11 , wherein the non-textual optical analysis recognizes objects within the video.
13. A computer-readable storage device having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:
receiving a query for a portion of a video;
identifying the portion of the video using an index, wherein the index is generated by aligning text from a digital audio stream associated with the video to frames in the video based on a non-textual optical analysis of the video, wherein the aligning of the text when the index is generated further comprises utilizing a first bit rate associated with the frames in the video and a second bit rate associated with the digital audio stream; and
presenting the portion of the video in response to the query.
14. The computer-readable storage device of claim 13 , wherein the query is an action word describing the portion associated with the video.
15. The computer-readable storage device of claim 13 , wherein the index is generated upon receiving the query.
16. The computer-readable storage device of claim 13 , wherein the text from the digital audio stream is provided for visually impaired audiences.
17. The computer-readable storage device of claim 13 , wherein the aligning of the text from the digital audio stream to the frames in the video further comprises converting the digital audio stream to the text using the non-textual optical analysis of the video.