Low latency rate control system and method
View Patent ↗An encoder within a video transmission system controls the bit allocation at a sub-frame level. A frame is divided into smaller blocks, known as rate control blocks. Rate control blocks are used as the basic unit for bit allocation. This bit allocation achieves the target bit rate desired by the system as well as meet latency constraints. The encoder uses the slice partitioning capabilities to generate the rate control blocks using one or more slices of the image frame. This feature allows the decoder to decode the rate control blocks independently and ensures that the encoded data size for each rate control block is allocated. The encoder also detects the overflow condition for the buffer and performing an operation to avoid the overflow condition based on whether the image frame is an inter-frame or a intra-frame.
1. A method for encoding an image frame within a video transmission system, the method comprising:
selecting a rate control block of the image frame, wherein the rate control block includes a plurality of macroblocks;
determining a rate control block bit rate;
designating a buffer size to correspond to the size of the rate control block;
encoding the plurality of macroblocks of the rate control block according to the bit rate; and
avoiding overflow of the buffer by alternately skipping encoding for selected inter-frame macroblocks of the rate control block and removing prediction residue from intra-frame macroblocks of the rate control block.
2. The method of claim 1 , wherein the determining step includes setting the bit rate to correspond to a size of the rate control block.
3. The method of claim 1 , further comprising partitioning the image frame into a plurality of rate control blocks.
4. The method of claim 1 , further comprising performing macroblock level rate control.
5. The method of claim 4 , further comprising determining whether the buffer is in an overflow state due to a size of the encoded plurality of macroblocks.
6. The method of claim 4 , wherein the performing macroblock level rate control includes replicating a macroblock of a previous frame.