Methods and apparatus for performing real-time VVC decoding
Apparatus and methods for implementing a real-time Versatile Video Coding (VVC) decoder use multiple threads to address the limitation with existing parallelization techniques and fully utilizes the available CPU computation resource without compromising on the coding efficiency. The proposed Multi-threaded (MT) framework uses CTU level parallel processing techniques without compromising on the memory bandwidth. Picture level parallel processing separates the sequence into temporal levels by considering the picture's referencing hierarchy. Embodiments are provided using various optimization techniques to achieve real-time VVC decoding on heterogenous platforms with multi-core CPUs, for those bitstreams generated using a VVC reference encoder with a default configuration.
1 . A method of parallel decoding of video, comprising:
generating motion vectors for a coding unit;
performing inter coding unit reconstruction;
performing intra coding unit reconstruction; and
performing inverse reshaping and in-loop filter of said video,
wherein said generating and performing steps are performed concurrently on distinct portions of the video, wherein decoder motion vector refinement is used when a length of a motion vector is less than a threshold.
2 . The method of claim 1 , wherein motion vector generation is based on a left, top and/or top right neighboring coding unit.
3 . The method of claim 1 , wherein generation of motion vectors for a top right coding tree unit completes before proceeding to a current coding tree unit motion vector generation.
4 . The method of claim 1 , wherein inter coded coding unit reconstruction is performed separately from intra mode and combined inter and intra prediction mode reconstruction.
5 . The method of claim 1 , wherein a coding unit reconstruction is performed over one or more portions of the coding unit in parallel.
6 . The method of claim 1 , wherein decoder motion vector refinement is used when a length of a motion vector is less than a threshold.
7 . A device, comprising:
memory; and, one or more processors, configured to
generate motion vectors for a coding unit;
perform inter coding unit reconstruction;
perform intra coding unit reconstruction; and
perform inverse reshaping and in-loop filter of said video,
wherein the device is configured to said generate and perform concurrently on distinct portions of the video, wherein decoder motion vector refinement is used when a length of a motion vector is less than a threshold.
8 . A non-transitory computer readable medium containing data content decoded according to the method of claim 1 , for playback using a processor.
9 . A computer program product comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method of claim 1 .