Systems and methods for transmitting video frames
Systems and methods for transmitting video frames are described. Specifically, frame rate modification techniques such as blending and/or packing processes are used to translate high frame-rate signals into low-frame rate signals, which are transmitted over limited bandwidth transmission media to a video signal receiver. Information pertaining to the blending and/or packing processes is transferred to the video signal receiver in the form of a map that is used to reconstruct the high frame-rate signals from the low-frame rate signals. The high frame-rate signals may be used by certain types of newer equipment designed to use such signals. However, legacy equipment that cannot use the high frame-rate signals may opt to use certain embodiments described herein that are designed to be backward-compatible. When backward-compatible, the video signal receiver generates suitable low frame-rate signals as well as the high frame-rate signals, thereby accommodating both legacy as well as newer equipment.
1. A method of propagating a video signal, the method comprising:
providing a high frame-rate input video bit stream to a video signal transmitter;
generating from said high frame-rate input video bit stream, a first low frame-rate video bit stream, said first low frame-rate video bit stream comprising a blended frame that is generated by executing a blending process upon a plurality of frames of said high frame-rate video bit stream, wherein executing said blending process comprises calculating an average pixel value from a plurality of corresponding pixels in said plurality of frames of said high frame-rate video bit stream;
generating from said high frame-rate input video bit stream, a second low frame-rate video bit stream, said second low frame-rate video bit stream comprising a packed frame that is generated by executing a first packing process upon said plurality of frames of said high frame-rate video bit stream, wherein executing said first packing process comprises using a Zeno packing algorithm to generate a Zeno frame from said plurality of frames of said high frame-rate video bit stream;
deriving a secondary bit stream from said first low frame-rate video bit stream, wherein deriving said secondary bit stream from said first low frame-rate video bit stream comprises generating a reconstructed blended frame by decoding said base layer signal;
generating a residual video bit stream by comparing said secondary bit stream to said second low frame-rate video bit stream, wherein said comparing comprises determining a difference signal between said second low frame-rate video bit stream and said secondary bit stream;
encoding said first low frame-rate video bit stream to generate a base layer signal;
encoding said residual video bit stream to generate an enhancement layer signal; and
transmitting said base layer signal and said enhancement layer signal out of said video signal transmitter.
2. The method of claim 1 , further comprising:
generating a decision map by executing said first packing process, wherein the decision map provides spatial and temporal resolution information about the second low frame-rate video bit stream; and
transmitting said decision map out of said video signal transmitter.
3. The method of claim 2 , further comprising:
generating a predicted Zeno frame by executing a second packing process upon said reconstructed blended frame.
4. The method of claim 3 , wherein executing said second packing process comprises using said decision map generated by executing said first packing process.
5. The method of claim 3 , further comprising:
generating a predicted Zeno frame by executing upon said reconstructed blended frame at least one of: a) a second packing process or b) a first temporal up-sampling function.
6. The method of claim 5 , wherein executing said second packing process comprises:
temporally up-sampling said decision map generated by executing said first packing process; and
using the up-sampled decision map for executing said second packing process.
7. The method of claim 2 , further comprising:
receiving in a video signal receiver, said base layer signal, said enhancement layer signal, and said decision map;
decoding said received base layer signal, the decoding comprising generating a received blended frame;
decoding said received enhancement layer signal, the decoding comprising generating a received residual bit stream; and
reconstructing said high frame-rate input video bit stream in said video signal receiver by using two or more of: a) said received blended frame or a signal derived from said received blended frame, b) said received residual bit stream or a signal derived from said received residual bit stream, and c) the received decision map or a signal derived from the received decision map.
8. A video system comprising a video signal transmitter, the video signal transmitter comprising a first processing circuit that includes a processor, the first processing circuit configured for:
receiving a high frame-rate input video bit stream and generating therefrom, a first low frame-rate video bit stream, said first low frame-rate video bit stream comprising a blended frame that is generated by executing a blending process upon a plurality of frames of said high frame-rate video bit stream, wherein executing said blending process comprises calculating an average pixel value from a plurality of corresponding pixels in said plurality of frames of said high frame-rate video bit stream;
receiving said high frame-rate input video bit stream and generating therefrom, a second low frame-rate video bit stream, said second low frame-rate video bit stream comprising a packed frame that is generated by executing a first packing process upon said plurality of frames of said high frame-rate video bit stream, wherein executing said first packing process comprises using a Zeno packing algorithm to generate a Zeno frame from said plurality of frames of said high frame-rate video bit stream;
deriving a secondary bit stream from said first low frame-rate video bit stream, wherein deriving said secondary bit stream from said first low frame-rate video bit stream comprises generating a reconstructed blended frame by decompressing said base layer signal;
generating a residual video bit stream by comparing said secondary bit stream to said second low frame-rate video bit stream, wherein said comparing comprises determining a difference signal between said second low frame-rate video bit stream and said secondary bit stream;
compressing said first low frame-rate video bit stream to generate a base layer signal;
compressing said residual video bit stream to generate an enhancement layer signal; and
transmitting said base layer signal and said enhancement layer signal out of said video signal transmitter.
9. The system of claim 8 , wherein the first processing circuit is further configured for:
generating a decision map by executing said first packing process, wherein the decision map provides spatial and temporal resolution information about the second low frame-rate video bit stream; and
transmitting said decision map out of said video signal transmitter.
10. The system of claim 8 further comprising a video signal receiver, the video signal receiver comprising a second processing circuit that includes another processor, the second processing circuit configured for:
receiving a) said base layer signal in one of a compressed or an uncompressed format, b) said enhancement layer signal in one of a compressed or an uncompressed format, and c) said decision map in one of a compressed or an uncompressed format; and
reconstructing said high frame-rate input video bit stream, in part, by executing an unpacking process using the received decision map.
11. A method of receiving a video signal, the method comprising:
receiving in a video signal receiver, an enhancement layer signal comprising at least one packed frame that is generated by executing a packing process upon a plurality of frames of a high frame-rate video bit stream, wherein executing said packing process comprises using a Zeno packing algorithm to generate a Zeno frame from said plurality of frames of the high frame-rate video bit stream;
receiving in the video signal receiver, a decision map that provides spatial and temporal resolution information of the at least one packed frame;
decoding the enhancement layer signal, the decoding comprising generating a residual bit stream;
reconstructing the high frame-rate input video bit stream in the video signal receiver, wherein the reconstructing comprises using at least two of: a) said residual bit stream, b) a signal derived from said residual bit stream, c) said decision map, or d) a signal derived from said decision map;
receiving in the video signal receiver, a base layer signal comprising at least one blended frame that is generated by executing a blending process upon said plurality of frames of said high frame-rate video bit stream, wherein executing said blending process comprises calculating an average pixel value from a plurality of corresponding pixels in said plurality of frames of said high frame-rate video bit stream; and
decoding said base layer signal, the decoding comprising generating in said video signal receiver, a received blended frame.
12. The method of claim 11 , wherein reconstructing said high frame-rate input video bit stream in said video signal receiver further comprises using at least one of a) said received blended frame or b) a signal derived from said received blended frame.