Systems and methods for adding content to video/multimedia based on metadata
An interactive video/multimedia application (IVM application) may specify one or more media assets for playback. The IVM application may define the rendering, composition, and interactivity of one or more the assets, such as video. Video multimedia application data (IVMA data may) be used to define the behavior of the IVM application. The IVMA data may be embodied as a standalone file in a text or binary, compressed format. Alternatively, the IVMA data may be embedded within other media content. A video asset used in the IVM application may include embedded, content-aware metadata that is tightly coupled to the asset. The IVM application may reference the content-aware metadata embedded within the asset to define the rendering and composition of application display elements and user-interactivity features. The interactive video/multimedia application (defined by the video and multimedia application data) may be presented to a viewer in a player application.
1. An apparatus comprising:
processing logic to automatically detect an object and its location in a plurality of frames of video while the video is playing, and to associate content with the detected object using metadata, wherein the metadata associates the location of the object in the frames to content to provide for metadata-to-content synchronization for said frames, and upon rendering of the frames, said processing logic to add the content to the frames, based on the metadata, at the locations in the frames, in association with the detected object, and track movement of the object and to display the content on the object as it moves; and
memory coupled to the processing logic, the memory to store the frames.
2. The apparatus of claim 1 , said processing logic to automatically detect an object by detecting at least one of a shape or texture.
3. The apparatus of claim 1 , wherein the metadata comprises at least one of a region of interest (ROI) bounding the detected object, and a location of the detected object in the frame.
4. The apparatus of claim 1 , wherein said content is an image.
5. The apparatus of claim 4 , wherein said image is an advertisement.
6. The apparatus of claim 1 , wherein said content is an advertisement.
7. The apparatus of claim 1 , wherein said content is text.
8. A method comprising:
automatically detecting an object and its location in a plurality of frames of video while the video is playing;
associating content with the detected object using metadata, wherein the metadata associates the location of the object in the frames to content to provide for metadata-to-content synchronization for said frames;
upon rendering of the frames, adding the content to the frames, based on the metadata, at the locations in the frames, in association with the detected object; and
tracking movement of the object and to display the content on the object as it moves.
9. The method of claim 8 , including detecting an object by detecting at least one of a shape or texture.
10. The method of claim 8 , wherein the metadata comprises at least one of a region of interest (ROI) bounding the detected object, and a location of the detected object in the frame.
11. The method of claim 8 , wherein said content is an image.
12. The method of claim 11 , wherein said image is an advertisement.
13. The method of claim 8 , wherein said content is an advertisement.
14. The method of claim 8 , wherein said content is text.
15. One or more non-transitory computer readable media storing instructions to perform a sequence comprising:
automatically detecting an object and its location in a plurality of frames of video while the video is playing;
associating content with the detected object using metadata, wherein the metadata associates the location of the object in the frames to content to provide for metadata-to-content synchronization for said frames,
upon rendering of the frames, adding the content to the frames, based on the metadata, at the locations in the frames, in association with the detected object; and
track movement of the object and to display the content on the object as it moves.
16. The media of claim 15 , further storing instructions to automatically detect an object by detecting at least one of a shape or texture.
17. The media of claim 15 , wherein the metadata comprises at least one of a region of interest (ROI) bounding the detected object, and a location of the detected object in the frame.
18. The media of claim 15 , wherein said content is an image.
19. The media of claim 18 , wherein said image is an advertisement.
20. The media of claim 15 , wherein said content is an advertisement.
21. The media of claim 15 , wherein said content is text.
22. An apparatus comprising:
means for automatically detecting an object and its location in a plurality of frames of video while the video is playing;
means for associating content with the detected object using metadata, wherein the metadata associates the location of the object in the frames to content to provide for metadata-to-content synchronization for said frames;
upon rendering of the frames, means for adding the content to the frames, based on the metadata, at the locations in the frames, in association with the detected object; and
means for tracking movement of the object and to display the content on the object as it moves.
23. The apparatus of claim 22 , including means for detecting an object by detecting at least one of a shape or texture.
24. The apparatus of claim 22 , wherein the metadata comprises at least one of a region of interest (ROI) bounding the detected object, and a location of the detected object in the frame.
25. The apparatus of claim 22 , wherein said content is an image.
26. The apparatus of claim 22 wherein said image is an advertisement.