System and method for content-based navigation of live and recorded TV and video programs
A system, method and computer-readable medium are presented for providing real-time content-based navigation of live video programming. The method aspect of the invention comprises receiving a live video program, generating an index to the received live video program by extracting images and/or text from the video program, recording the live video program, presenting at least a portion of data associated with the generated index to a user, receiving user input regarding a portion of the recorded video program to which the user desires to navigate and playing back the recorded video program starting at the navigated portion identified by the user input.
1. A method comprising:
generating an index to a video program based on an indication of a portion of interest in the video program, wherein the index is (1) generated independent of index information transmitted with the video program and (2) is generated automatically, via a processor and without user input, by combining extracted images and text generated from the video program with network-based content provided by an external source, the network-based content being transmitted separately from the video program;
presenting the index on a display, wherein:
presenting of the index occurs on a first computing device different from a second computing device which displays the video program;
the first computing device is a hand-held device comprising a touch-sensitive screen;
the hand-held device presents the extracted images and the text; and
the video program is navigated via touch input received from the touch-sensitive screen of the hand-held device;
receiving, based on the index, user input regarding a location of the video program to navigate to; and
playing the video program, on the display, from the location.
2. The method of claim 1 , wherein the network-based content is transmitted concurrently with the video program.
3. The method of claim 1 , wherein the external source is a server connected via the Internet.
4. The method of claim 1 , wherein generating of the index further comprises utilizing content-based sampling.
5. The method of claim 1 , further comprising extracting the extracted images from the video program using content-based sampling.
6. The method of claim 1 , further comprising generating the text using automatic speech recognition.
7. The method of claim 1 , wherein the hand-held device is wireless.
8. A system comprising:
a processor; and
a computer-readable storage medium having instructions stored which, when executed by the processor, result in the processor performing operations comprising:
generating an index to a video program based on an indication of a portion of interest in the video program, wherein the index is (1) generated independent of index information transmitted with the video program and (2) is generated automatically, without user input, by combining extracted images and text generated from the video program with network-based content provided by an external source, the network-based content being transmitted separately from the video program;
presenting the index on a display, wherein:
presenting of the index occurs on a first computing device different from a second computing device which displays the video program;
the first computing device is a hand-held device comprising a touch-sensitive screen;
the hand-held device presents the extracted images and the text; and
the video program is navigated via touch input received from the touch-sensitive screen of the hand-held device;
receiving, based on the index, user input regarding a location of the video program to navigate to; and
playing the video program, on the display, from the location.
9. The system of claim 8 , wherein the network-based content is transmitted concurrently with the video program.
10. The system of claim 8 , wherein the external source is a server connected via the Internet.
11. The system of claim 8 , wherein generating of the index further comprises utilizing content-based sampling.
12. The system of claim 8 , the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising extracting the extracted images from the video program using content-based sampling.
13. The system of claim 8 , the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising generating the text using automatic speech recognition.
14. The system of claim 8 , wherein the hand-held device is wireless.
15. A computer-readable storage device having instructions stored which, when executed by a computing device, result in the computing device performing operations comprising:
generating an index to a video program based on an indication of a portion of interest in the video program, wherein the index is (1) generated independent of index information transmitted with the video program and (2) is generated automatically, without user input, by combining extracted images and text generated from the video program with network-based content provided by an external source, the network-based content being transmitted separately from the video program;
presenting the index on a display, wherein:
presenting of the index occurs on a first computing device different from a second computing device which displays the video program;
the first computing device is a hand-held device comprising a touch-sensitive screen;
the hand-held device presents the extracted images and the text; and
the video program is navigated via touch input received from the touch-sensitive screen of the hand-held device;
receiving, based on the index, user input regarding a location of the video program to navigate to; and
playing the video program, on the display, from the location.
16. The computer-readable storage device of claim 15 , wherein the network-based content is transmitted concurrently with the video program.
17. The computer-readable storage device of claim 15 , wherein the external source is a server connected via the Internet.
18. The computer-readable storage device of claim 15 , wherein generating of the index further comprises utilizing content-based sampling.
19. The computer-readable storage device of claim 15 , having additional instructions stored which, when executed by the computing device, result in operations comprising extracting the extracted images from the video program using content-based sampling.
20. The computer-readable storage device of claim 15 , having additional instructions stored which, when executed by the computing device, result in operations comprising generating the text using automatic speech recognition.