Method and system for motion-compensated frame-rate up-conversion for both compressed and decompressed video bitstreams
A video receiver is operable to receive three-dimensional (3D) video bitstreams from a video transmitter. The received 3D video bitstreams comprises a plurality of video frames and corresponding coding information. The coding information, for example, block motion vectors, block coding modes, quantization levels, and/or quantized residual data, is extracted for performing frame-rate up-conversion on the received plurality of video frames. The coding information is generated at the video transmitter via entropy decoding on a compressed 3D video from a video feed from, for example, an IP TV network. When an uncompressed 3D video is received, the video receiver is operable to perform frame-rate up-conversion on the received uncompressed 3D video using extracted block motion vectors and associated confidence-consistence measure. When a compressed 3D video is received, the video receiver is configured to perform video decompression on the received compressed 3D video prior to the frame-rate up-conversion.
1. A method for signal processing, the method comprising:
receiving, by a video transmitter, a compressed video bitstream comprising a plurality of video frames;
acquiring, by the video transmitter from a video receiver, one or more video formats supported by the video receiver;
determining, by the video transmitter, a video format for video communication between the video transmitter and the video receiver based at least in part on the one or more video formats supported by the video receiver;
generating, by the video transmitter, formatted coding information by extracting coding information from the compressed video bitstream and formatting the extracted coding information using the video format for video communication between the video transmitter and the video receiver;
determining, by the video transmitter, whether to transmit compressed or uncompressed video bitstreams to the video receiver based at least in part on the video format for video communication between the video transmitter and the video receiver;
in response to determining to transmit uncompressed video bitstreams to the video receiver, transmitting, by the video transmitter over a wireless transmission link, an uncompressed video bitstream with the formatted coding information to the video receiver for performing frame-rate up-conversion, wherein the uncompressed video bitstream is generated by decompressing the compressed video bitstream at the video transmitter; and
in response to determining to transmit compressed video bitstreams to the video receiver, transmitting, by the video transmitter over the wireless transmission link, the compressed video bitstream with the formatted coding information to the video receiver for performing the frame-rate up-conversion.
2. The method according to claim 1 , wherein the coding information comprises at least one of block motion vectors, block coding modes, quantization levels, or quantized residual data.
3. The method according to claim 1 , further comprising extracting the coding information from the received compressed video bitstream by performing entropy decoding.
4. The method according to claim 1 , wherein the compressed video bitstream is received from a video feed including one of a cable TV network, an IP TV network, a satellite broadcasting network, a mobile communication network, a video camcorder, or a camera.
5. The method according to claim 1 , wherein the performing of the frame-rate up-conversion comprises:
performing digital noise reduction filtering on a plurality of decoded video frames; and
generating a pixel motion vector for each of the plurality of filtered decoded video frames by decomposing a corresponding refined block motion vector obtained using the formatted coding information.
6. The method according to claim 5 , wherein the performing of the frame-rate up-conversion further comprises:
performing motion-compensated interpolation for each of the plurality of filtered decoded video frames using the corresponding pixel motion vector.
7. The method according to claim 1 , wherein the compressed video bitstream comprises a three-dimensional (3D) video bitstream.
8. A system for processing signals, the system comprising:
a video transmitter comprising one or more circuits, the video transmitter configured to:
receive a compressed video bitstream comprising a plurality of video frames;
acquire, from a video receiver, one or more video formats supported by the video receiver;
determine a video format for video communication between the video transmitter and the video receiver based at least in part on the one or more video formats supported by the video receiver;
generate formatted coding information by extracting coding information from the compressed video bitstream and formatting the extracted coding information using the video format for video communication between the video transmitter and the video receiver;
determine whether to transmit compressed or uncompressed video bitstreams to the video receiver based at least in part on the video format for video communication between the video transmitter and the video receiver;
in response to determining to transmit uncompressed video bitstreams to the video receiver, transmit, over a wireless transmission link, an uncompressed video bitstream with the formatted coding information to the video receiver for performing frame-rate up-conversion, wherein the uncompressed video bitstream is generated by decompressing the compressed video bitstream at the video transmitter; and
in response to determining to transmit compressed video bitstreams to the video receiver, transmit, over the wireless transmission link, the compressed video bitstream with the formatted coding information to the video receiver for performing the frame-rate up-conversion.
9. The system according to claim 8 , wherein the coding information comprises at least one of block motion vectors, block coding modes, quantization levels, or quantized residual data.
10. The system according to claim 8 , further comprising the video transmitter configured to extract the coding information from the received compressed video bitstream by performing entropy decoding.
11. The system according to claim 8 , wherein the compressed video bitstream is received from a video feed including one of a cable TV network, an IP TV network, a satellite broadcasting network, a mobile communication network, a video camcorder, or a camera.
12. The system according to claim 8 , wherein the performing of the frame-rate up-conversion comprises:
performing digital noise reduction filtering on a plurality of decoded video frames; and
generating a pixel motion vector for each of the plurality of filtered decoded video frames by decomposing a corresponding refined block motion vector obtained using the formatted coding information.
13. The system according to claim 12 , wherein the performing of the frame-rate up-conversion further comprises:
performing motion-compensated interpolation for each of the plurality of filtered decoded video frames using the corresponding pixel motion vector.
14. The system according to claim 8 , wherein the compressed video bitstream comprises a three-dimensional (3D) video bitstream.
15. A method for signal processing, the method comprising:
receiving, by a video receiver from a video transmitter via a wireless transmission link, a video bitstream with frame-rate up-conversion coding information, the frame-rate up-conversion coding information being generated by the video transmitter;
extracting, by the video receiver, the frame-rate up-conversion coding information from the video bitstream;
determining, by the video receiver, whether the received video bitstream is a compressed video bitstream or an uncompressed video bitstream;
in response to determining that the received video bitstream is a compressed video bitstream, decompressing the compressed video bitstream to generate a plurality of decoded video frames and performing frame-rate up-conversion on the plurality of decoded video frames using the frame-rate up-conversion coding information; and
in response to determining that the received video bitstream is an uncompressed video bitstream, performing the frame-rate up-conversion on a plurality of decoded video frames comprised in the uncompressed video bitstream using the frame-rate up-conversion coding information.
16. The method according to claim 15 , wherein the frame-rate up-conversion coding information comprises at least one of block motion vectors, block coding modes, quantization levels, or quantized residual data.
17. The method according to claim 15 , wherein the frame-rate up-conversion coding information is generated by the video transmitter via entropy decoding on a compressed video bitstream received from a video feed including one of a cable TV network, an IP TV network, a satellite broadcasting network, a mobile communication network, a video camcorder, or a camera.
18. The method according to claim 15 , further comprising:
performing digital noise reduction filtering on the plurality of decoded video frames; and
generating a pixel motion vector for each of the plurality of filtered decoded video frames by decomposing a corresponding refined block motion vector obtained using the frame-rate up-conversion coding information.
19. The method according to claim 18 , further comprising:
performing motion-compensated interpolation for each of the plurality of filtered decoded video frames using the corresponding pixel motion vector.
20. The method according to claim 15 , wherein the video bitstream comprises a three-dimensional (3D) video bitstream.