Low latency rate control system and method
View Patent ↗An encoder within a video transmission system controls the bit allocation at a sub-frame level. A frame is divided into smaller blocks, known as rate control blocks. Rate control blocks are used as the basic unit for bit allocation. This bit allocation achieves the target bit rate desired by the system as well as meet latency constraints. The encoder uses the slice partitioning capabilities to generate the rate control blocks using one or more slices of the image frame. This feature allows the decoder to decode the rate control blocks independently and ensures that the encoded data size for each rate control block is allocated. The encoder also detects the overflow condition for the buffer and performing an operation to avoid the overflow condition based on whether the image frame is an inter-frame or an intra-frame.
1. A video transmission encoding system comprising:
a slice partitioner to ensure a rate control block within an image frame is composed of an integer number of slices from the image frame, wherein the rate control block includes a plurality of macroblocks;
an encoder to encode the plurality of macroblocks for the rate control block; and
a buffer to store encoded data for each rate control block,
wherein a bit rate for the video transmission system and a size of the buffer are set according to a parameter for the rate control block, and
wherein the encoder avoids overflow of the buffer by alternately skipping encoding for selected inter-frame macroblocks of the rate control block and removing prediction residue from intra-frame macroblocks of the rate control block.
2. The video transmission encoding system of claim 1 , wherein the parameter to set the bit rate and the size of the buffer is related to a size of the rate control block.
3. The video transmission encoding system of claim 1 , wherein the slice partitioner generates a plurality of rate control blocks from the image frame.
4. The video transmission encoding systems of claim 1 , wherein the encoder is configured to perform macroblock level rate control when the buffer is in an overflow state.
5. The video transmission encoding system of claim 1 , further comprising a decoder to decode the plurality of macroblocks of the rate control block using the bit rate.
6. A method for encoding an image frame within a video transmission, the method comprising:
selecting a rate control block from a plurality of rate control blocks;
determining an initial setting of the rate control block;
setting a size for a buffer to receive encoded data of the rate control block; and
encoding a plurality of macroblocks within the rate control block according to a bit rate corresponding to the size of the buffer, wherein encoding includes avoiding overflow of the buffer by alternately skipping encoding for selected inter-frame macroblocks of the rate control block and removing prediction residue from intra-frame macroblocks of the rate control block.
7. The method of claim 6 , further comprising partitioning the image frame into the plurality of rate control blocks.
8. The method of claim 6 , further comprising selecting a new rate control block when a last macroblock of the rate control block is encoded.
9. The method of claim 8 , further comprising setting the size of the buffer and the bit rate according to the initial setting of the new rate control block.
10. The method of claim 6 , wherein the rate control block includes one or more slices of the image frame.
11. The method of claim 6 , wherein the rate control block includes one or more slices of the image frame.