Method and system for adaptive rate video compression and transmission
View Patent ↗For a portion of video data, a video processing device generates a plurality of compressed video bit streams comprising different bit rates, and selects one stream per portion of video data to transmit to a display device. The streams may be generated concurrently. Bit rates are determined based on operating conditions and link performance. The selections are determined dynamically in response to received information. The streams may be compressed utilizing different compression schemes, for example, DPCM and/or transform compression. The bit rates may be dynamically adjusted by adjusting compression scheme, compression parameters, frame size, frame rate, color space and/or chroma sampling. The portion of video data may comprise contiguous horizontal rows or portions of rows of pixels, a full frame and/or a scaled frame. Information is communicated to the display device for control of decompression operations. The display device receives, decompresses, reconstructs and displays the selected bit stream.
1. A method for communication, the method comprising:
receiving, by a video processing device coupled to a display device via a communication link, video data from a video source;
generating, by the video processing device, from a portion of the video data, a plurality of compressed video bit streams each comprising a different bit rate;
selecting, by the video processing device, a first compressed video bit stream of the plurality of compressed video bit streams based on an operating condition associated with the communication link;
communicating, by the video processing device, a first sub-frame of the selected first compressed video bit stream to the display device at a first frame size and a corresponding first number of bits per pixel; and
dynamically adjusting, by the video processing device, the bit rate of the first compressed video bit stream during the communication of the first compressed video bit stream to the display device via the communication link by communicating a second sub-frame of the selected first compressed video bit stream to the display device at a second, smaller frame size and a corresponding second number of bits per pixel, responsive to one or both of a change of the operating condition associated with the communication link and a link performance of the communication link, wherein the ratio of the second number of bits per pixel to the first number of bits per pixel is greater than the ratio of the second, smaller frame size to the first frame size.
2. The method according to claim 1 , further comprising dynamically determining which of the compressed video bit streams to select in response to information received from at least one communication device that is communicatively coupled to the video processing device via the communication link.
3. The method according to claim 1 , further comprising generating the plurality of compressed video bit streams, utilizing at least one of:
a plurality of compression schemes;
a single compression scheme;
DPCM compression; and
transform compression.
4. The method according to claim 1 , wherein dynamically adjusting the bit rate of the first compressed video stream during the communication of the first compressed video stream further comprises dynamically adjusting a compression scheme, compression parameter, frame size, frame rate, color space, chroma sampling, or any combination thereof of the first compressed video stream.
5. The method according to claim 1 , wherein the portion of the video data comprises at least one of a plurality of contiguous horizontal rows of pixels, a portion of at least one row of pixels, a full frame of pixels and a scaled frame of pixels.
6. The method according to claim 1 , further comprising communicating information about the selected first compressed video bit stream, to the display device, for control of decompression operations performed by the display device.
7. The method according to claim 1 , wherein the display device is configured to receive the selected first compressed video bit stream, determine a decompression function to invert a compression function performed by the video processing device, decompress the received first video bit stream, reconstruct the video data from results of the decompression and provide the reconstructed video data to a display.
8. A system for communication, the system comprising:
one or more processors, circuits, or any combination thereof, for use in a video processing device that, during operation, is communicatively coupled to a display device via a communication link, wherein the one or more processors, one or more circuits, or any combination thereof, are configured to:
receive video data from a video source,
generate, from a portion of the video data, a plurality of compressed video bit streams each comprising a different bit rate;
select a first compressed video bit stream of the plurality of compressed video bit streams based on an operating condition associated with the communication link;
communicate a first sub-frame of the selected first compressed video bit stream to the display device at a first frame size and a corresponding first number of bits per pixel; and
communicate a second sub-frame of the selected first compressed video bit stream to the display device at a second, smaller frame size and a corresponding second number of bits per pixel, responsive to one or both of a change of the operating condition associated with the communication link and a link performance of the communication link, wherein the ratio of the second number of bits per pixel to the first number of bits per pixel is greater than the ratio of the second, smaller frame size to the first frame size.
9. The system according to claim 8 , wherein said one or more processors, one or more circuits, or any combination thereof, are further configured to dynamically determine which of the compressed video bit streams to select in response to information received from at least one communication device that is communicatively coupled to the video processing device via the communication link.
10. The system according to claim 8 , wherein said one or more processors, one or more circuits, or any combination thereof, are further configured to generate the plurality of compressed video bit streams, utilizing at least one of:
a plurality of compression schemes;
a single compression scheme;
DPCM compression; or
transform compression.
11. The system according to claim 8 , wherein said one or more processors, one or more circuits, or any combination thereof, are further configured to dynamically adjust the bit rate of the first compressed video stream during the communication of the first compressed video stream by dynamically adjusting a compression scheme, compression parameter, frame size, frame rate, color space, chroma sampling, or any combination thereof.
12. The system according to claim 8 , wherein the portion of the video data comprises at least one of a plurality of contiguous horizontal rows of pixels, a portion of one or more rows of pixels, a full frame of pixels and a scaled frame of pixels.
13. The system according to claim 8 , wherein said one or more processors, one or more circuits, or any combination thereof, are further configured to communicate information about the first compressed video bit stream, to the display device, for control of decompression operations performed by the display device.
14. The system according to claim 8 , wherein the display device is further configured to receive the selected first compressed video bit stream, determine a decompression function to invert a compression function performed by the video processing device, decompress the received first video bit stream, reconstruct the video data from results of the decompression and provide the reconstructed video data to a display.
15. The method according to claim 1 , comprising communicating a different one of the compressed video bit streams to the display device, responsive to the first compressed video bit stream not being correctly received by the display device.
16. The system according to claim 8 , wherein said one or more processors, one or more circuits, or any combination thereof, are further configured to communicate a different one of the compressed video bit streams to the display device, responsive to the first compressed video bit stream not being correctly received by the display device.
17. The method according to claim 1 , further comprising concurrently communicating the first compressed video bit stream and a second compressed video bit stream to the display device, while dynamically adjusting the bit rate of the first compressed video stream.
18. The system according to claim 8 , wherein said one or more processors, one or more circuits, or any combination thereof, are operable to concurrently communicate the first compressed video bit stream and a second compressed video bit stream to the display device, while dynamically adjusting the bit rate of the first compressed video stream.
19. A non-transitory computer-readable medium embodying a program executable in a video processing device communicatively coupled to a display device via a communication link, the program configured to at least:
receive video data from a video source;
generate, from a portion of the video data, a plurality of compressed video bit streams each comprising a different bit rate;
select a first compressed video bit stream of the plurality of compressed video bit streams based on an operating condition associated with the communication link;
communicate a first sub-frame of the selected first compressed video bit stream to the display device at a first frame size and a corresponding first number of bits per pixel; and
communicate a second sub-frame of the selected first compressed video bit stream to the display device at a second, smaller frame size and a corresponding second number of bits per pixel, responsive to one or both of a change of the operating condition associated with the communication link and a link performance of the communication link, wherein the ratio of the second number of bits per pixel to the first number of bits per pixel is greater than the ratio of the second, smaller frame size to the first frame size.
20. The non-transitory computer-readable medium according to claim 19 , wherein the program is further configured to concurrently generate at least two of the plurality of compressed video bit streams.
21. The method according to claim 1 , wherein dynamically adjusting the bit rate of the first compressed video stream during the communication of the first compressed video bit stream further comprises dynamically adjusting the bit rate on a per-slice basis within the first compressed video stream.
22. The method according to claim 21 , wherein dynamically adjusting the bit rate on a per-slice basis further comprises communicating a first slice of the first compressed video bit stream at a first number of bits per pixel, and communicating a second slice of the first compressed video bit stream at a second number of bits per pixel, the second number different from the first number.