Systems and methods for encoding multimedia content
An interactive video/multimedia application (IVM application) may specify one or more media assets for playback. The IVM application may define the rendering, composition, and interactivity of one or more the assets, such as video. Video multimedia application data (IVMA data may) be used to define the behavior of the IVM application. The IVMA data may be embodied as a standalone file in a text or binary, compressed format. Alternatively, the IVMA data may be embedded within other media content. A video asset used in the IVM application may include embedded, content-aware metadata that is tightly coupled to the asset. The IVM application may reference the content-aware metadata embedded within the asset to define the rendering and composition of application display elements and user-interactivity features. The interactive video/multimedia application (defined by the video and multimedia application data) may be presented to a viewer in a player application.
1. A computing device to encode video content including metadata, comprising:
processing logic to:
determine metadata associated with a region of interest of at least one video frame, wherein the region of interest corresponds to at least one of a shape, an object, a motion vector, and a scene in the video frame;
encode the video frame to generate an encoded video frame, wherein the region of interest is encoded at a higher resolution than the rest of the video frame; and
embed the metadata within a bitstream comprising the encoded video frame to tightly couple the metadata to the encoded video frame according to a bitstream syntax of encoding of the bitstream to provide for metadata-to-content synchronization that is independent of playback performance, playback timing, and user interaction; and
memory coupled to the processing logic, the memory to store the at least one video frame.
2. The computing device of claim 1 , wherein the
at least one of the shape, the object, the motion vector, and the scene in the video frame comprises a human face automatically detected by the processing logic in the region of interest of the at least one video frame.
3. The computing device of claim 2 , further comprising a display device coupled to the processing logic, the display device to display a multimedia object overlaid on the region of interest based on the metadata.
4. The computing device of claim 1 , wherein the processing logic to associate a multimedia element with the metadata, wherein the multimedia element is to provide for user interactivity based on the metadata.
5. The computing device of claim 1 , wherein the metadata specifies a location of the region of interest within the image frame.
6. The computing device of claim 1 , wherein the processing logic comprises at least one of a processor and a preprocessor.
7. The computing device of claim 1 , comprising one or more of a mobile computing device, a cell phone, a smart phone, a portable media player, a personal computer, a set top box, and a display device.
8. A method carried out by a computing device to encode video content including metadata, the method comprising:
determining metadata associated with a region of interest of at least one video frame, wherein the region of interest corresponds to at least one of a shape, an object, a motion vector or a scene in the video frame;
encoding the video frame to generate an encoded video frame, wherein the region of interest is encoded at a higher resolution or bitrate than the rest of the video frame; and
embedding the metadata according to a bitstream syntax of a bitstream comprising the encoded video frame to tightly couple the metadata to the encoded image frame to provide for metadata-to-content synchronization that is independent of playback performance, playback timing, and user interaction.
9. The method of claim 8 , wherein the region of interest comprises a human face.
10. The method of claim 8 , wherein the metadata identifies a multimedia element associated with the region of interest.
11. The method of claim 10 , wherein the multimedia element provides user interaction.
12. The method of claim 11 , wherein the multimedia element provides a user interface component.
13. The method of claim 10 , wherein the multimedia element is at least one of video content, audio content, graphical content, text, images, rendered graphics, and rendered 3D graphics.
14. The method of claim 8 , wherein the metadata comprises at least one of text data, formatted data or compressed binary data.
15. The method of claim 8 , wherein the metadata specifies the location of the region of interest within the video frame.
16. A non-transitory computer readable storage medium having stored thereon instructions that, when executed by one or more computing devices, cause the one or more computing devices to perform operations to encode video content including metadata, the operations comprising:
identifying metadata associated with a region of interest of at least one video frame, wherein the region of interest corresponds to at least one of a shape, an object, a motion vector or a scene in the video frame;
encoding the video frame to generate an encoded video frame, wherein the region of interest is encoded at a higher resolution or bitrate than the rest of the video frame; and
embedding the metadata according to a bitstream syntax of a bitstream comprising the encoded video frame to tightly couple the metadata to the encoded image frame to provide for metadata-to-content synchronization that is independent of playback performance, playback timing, and user interaction.
17. The computer readable storage medium of claim 16 , wherein the region of interest comprises a human face.
18. The computer readable storage medium of claim 16 , wherein the metadata identifies a multimedia element associated with the region of interest.
19. The computer readable storage medium of claim 18 , wherein the multimedia element provides user interaction.
20. The computer readable storage medium of claim 19 , wherein the multimedia element provides a user interface component.
21. The computer readable storage medium of claim 18 , wherein the multimedia element is at least one of video content, audio content, graphical content, text, images, rendered graphics, and rendered 3D graphics.
22. The computer readable storage medium of claim 16 , wherein the metadata comprises at least one of text data, formatted data or compressed binary data.
23. The computer readable storage medium of claim 16 , wherein the metadata specifies the location of the region of interest within the video frame.