Extending prediction modes and performance of video codecs
A video frame compression system includes a rendering engine that provides a current video frame and current additional rendering information. Additionally, the video frame compression system includes a warping engine that generates a warped video frame, wherein the warped video frame is a transformation of a previous video frame that is based on the current additional rendering information. Further, the video frame compression system includes a video encoder that compresses the current video frame by using the warped video frame as a reference frame and separately compresses the current additional rendering information. Still further, the video frame compression system includes a packetizer that provides main and auxiliary data streams corresponding to the compressed current video frame and the compressed current additional rendering information, respectively. A video frame decompression system and methods of video frame compression and decompression are also provided.
1. A video frame compression system, comprising:
a rendering engine that provides a current video frame and current additional rendering information that differs from the current video frame;
a warping engine that generates a warped video frame, wherein the warped video frame is a transformation of a previous video frame that is based on the current additional rendering information; and
a video encoder that compresses the current video frame by using the warped video frame as a reference frame and separately compresses the current additional rendering information.
2. The system as recited in claim 1 further comprising a packetizer that provides main and auxiliary data streams corresponding to the compressed current video frame and the compressed current additional rendering information, respectively.
3. The system as recited in claim 1 wherein the current additional rendering information is selected from the group consisting of:
a camera projection matrix; and
a Z-depth buffer.
4. The system as recited in claim 1 wherein the video encoder conforms to the H.264/AVC Video Coding Standard.
5. A method of video frame compression, comprising:
providing a current video frame and current additional rendering information that is different data than said current video frame;
generating a warped video frame, wherein the warped video frame is a transformation of a previous video frame that is based on the current additional rendering information; and
compressing the current video frame by using the warped video frame as a reference frame and separately compressing the current additional rendering information, wherein said generating and said compressing are performed by a processor.
6. The method as recited in claim 5 further comprising packetizing the compressed current video frame and the compressed additional rendering information into main and auxiliary data streams, respectively.
7. The method as recited in claim 5 wherein the current additional rendering information is selected from the group consisting of:
a camera projection matrix; and
a Z-depth buffer.
8. The method as recited in claim 5 wherein compressing the current video frame and the current additional rendering information conforms to the H.264/AVC Video Coding Standard.
9. A video frame decompression system, comprising:
a depacketizer that provides a compressed current video frame and compressed additional rendering information;
an auxiliary video decoder that decodes the compressed additional rendering information to provide current additional rendering information;
a warping engine that reconstructs a warped video frame, wherein the warped video frame is a transformation of a previous video frame that is based on the current additional rendering information; and
a main video decoder that decodes the compressed current video frame by using the warped video frame as a reference frame to provide a current video frame.
10. The system as recited in claim 9 wherein the main and auxiliary decoders are at least portions of a same decoder.
11. The system as recited in claim 9 wherein the current additional rendering information is provided by using previous additional rendering information as a reference.
12. The system as recited in claim 9 wherein the current additional rendering information is selected from the group consisting of:
a camera projection matrix; and
a Z-depth buffer.
13. The system as recited in claim 9 wherein the main and auxiliary video decoders conform to the H.264/AVC Video Coding Standard.
14. A method of video frame decompression, comprising:
depacketizing a compressed current video frame and compressed additional rendering information;
decoding the compressed additional rendering information to provide current additional rendering information;
reconstructing a warped video frame, wherein the warped video frame is a transformation of a previous video frame that is based on the current additional rendering information; and
decoding the compressed current video frame by using the warped video frame as a reference frame to provide a current video frame, wherein said depacketizing and said reconstructuring are performed by a processor.
15. The method as recited in claim 14 wherein the current additional rendering information is provided by using previous additional rendering information as a reference.
16. The method as recited in claim 14 wherein the current additional rendering information is selected from the group consisting of:
a camera projection matrix; and
a Z-depth buffer.
17. The method as recited in claim 14 wherein the main and auxiliary video encoders conform to the H.264/AVC Video Coding Standard.