System and method for space-time annotation-capable media scrubbing
A system for creating a streaming media navigation and annotation display, allowing for deep annotation and efficient browsing of annotations. A system which additionally allows for annotating spatial elements of media, for example cinematic effects. A method which implements this using reactive methods which allow integration with advanced knowledge representation and display systems.
1. A computer system for collaborative annotation of video, the computer system comprising:
a video processing system for processing the video, the video processing system comprising a processor configured to extract a plurality of key frames from the video, to slice the key frames into vertical slices each having a uniform thickness and to combine the slices to create a plurality of space-time frames such that each slice occupies the same position in the respective space-time frame that it occupied in the respective key frame;
a knowledge management system for managing information associated with the video, and for providing the information to the video processing system, the information comprising a plurality of annotations, each of said plurality of annotations being associated spatially and temporally with at least one of the plurality of space-time frames; and
a graphical display for displaying the plurality of space-time frames in a scrubber and for displaying the plurality of annotations such that each of the plurality of annotations is displayed concurrently with each respective at least one of the plurality of space-time frames,
wherein in the knowledge management system comprises a data store having ontology information about the video,
wherein at least one of the plurality of annotations is one end of a typed link,
wherein the typed link represents that the annotation and an anchor in the video are related by a set of relations that constrain the ontologies of both the annotation and the anchor, and adds semantic value to the relationship.
2. The computer system of claim 1 , wherein the processor is further configured to compress the video.
3. The computer system of claim 1 , wherein the processor is further configured to annotate the plurality of space-time frames with information received from the knowledge management system.
4. The computer system of claim 3 , wherein the video processing system provides the annotated plurality of space-time frames to the graphical display for display and manipulation of the annotated space-time frames by a user.
5. The computer system of claim 1 , further comprising a user input device for allowing a user to add annotations to the plurality of space-time frames.
6. The computer system of claim 1 , wherein the knowledge management system is configured to reinterpret the plurality of annotations upon receipt of new information.
7. A method for collaborative annotation of video, the method comprising:
receiving in a video processing device a video stream;
extracting from the video stream a plurality of key frames;
slicing the key frames into vertical slices each having a uniform thickness;
combining the slices to create a plurality of space-time frames such that each slice occupies the same position in the respective space-time frame that it occupied in the respective key frame;
providing information from a knowledge management system to the video processing device, the information comprising a plurality of annotations, each of said plurality of annotations being associated spatially and temporally with at least one of the plurality of space-time frames; and
displaying on a graphical display the plurality of space-time frames and the information in a scrubber such that each of the plurality of annotations is displayed concurrently with each respective at least one of the plurality of space-time frames,
wherein in the knowledge management system comprises a data store having ontology information about the video,
wherein at least one of the plurality of annotations is one end of a typed link,
wherein the typed link represents that the annotation and an anchor in the video are related by a set of relations that constrain the ontologies of both the annotation and the anchor, and adds semantic value to the relationship.
8. The method of claim 7 , further comprising annotating the plurality of space-time frames with information received from the knowledge management system.
9. The method of claim 7 , further comprising manipulating an input device to add annotations to the space-time frames.
10. The method of claim 8 , further comprising manipulating by a user the annotated space-time frames.
11. The method of claim 7 , further comprising reinterpreting the plurality of annotations upon receipt of new information.