Systems and methods for versatile video coding
View Patent ↗Described herein are systems, methods, and instrumentalities associated with video coding. The signaling of certain syntax elements may be moved from a slice header to a picture header and/or a layer access unit delimiter (AUD). The dependency between AUD and one or more parameter sets may be explored. Syntax elements may be signaled to enable wrap-around motion compensation for certain sub-picture(s) and specify wrap-around motion compensation offsets for the sub-picture(s).
1. A video decoding device, comprising:
a processor configured to:
obtain a video bitstream associated with a picture, wherein the picture is partitioned into multiple sub-pictures and wherein the video bitstream indicates whether respective sub-picture identifiers (IDs) of the multiple sub-pictures are signaled in the video bitstream, the video bitstream further indicating whether at least one sub-picture of the multiple sub-pictures is treated as a picture and whether wrap-around motion compensation is enabled for the at least one sub-picture;
determine the respective sub-picture IDs of the multiple sub-pictures from the video bitstream in response to determining, based on the video bitstream, that the respective sub-picture IDs are signaled in the video bitstream; and
in response to determining, based on the video bitstream, that the at least one sub-picture is treated as a picture and that wrap-around motion compensation is enabled for the at least one sub-picture:
determine a wrap-around offset applicable to the at least one sub-picture;
decode the picture associated with the bitstream based at least on the respective sub-picture IDs of the multiple sub-pictures and the determined wrap-around offset.
2. The video decoding device of claim 1 , wherein, in response to determining that the respective sub-picture IDs are not signaled in the video bitstream, the processor is configured to determine the respective sub-picture IDs of the multiple sub-pictures based on a sequence of index values that range from 0 to a total number of sub-pictures included in the picture minus 1.
3. The video decoding device of claim 1 , wherein whether the at least one sub-picture is treated as a picture and whether wrap-around motion compensation is enabled for the at least one sub-picture are indicated in a sequence parameter set of the video bitstream.
4. The video decoding device of claim 1 , wherein whether the at least one sub-picture is treated as a picture and whether wrap-around motion compensation is enabled for the at least one sub-picture are indicated in a picture parameter set of the video bitstream.
5. The video decoding device of claim 1 , wherein each of the multiple sub-pictures includes one or more slices that collectively cover a region of the picture associated with the video bitstream.
6. The video decoding device of claim 1 , wherein the picture associated with the video bitstream is partitioned into a grid comprising the multiple sub-pictures, and wherein each of the sub-picture IDs indicates a position of the corresponding sub-picture in the grid.
7. The video decoding device of claim 1 , wherein whether wrap-around motion compensation is enabled for the at least one sub-picture applies to whether horizontal wrap-around motion compensation is enabled for the at least one sub-pictures.
8. The video decoding device of claim 1 , wherein the processor being configured to decode the picture associated with the video bitstream comprises the processor being-configured to perform wrap-around motion compensation for the at least one sub-picture based on the determined wrap-around offset.
9. The video decoding device of claim 8 , wherein the wrap-around offset is used to interpolate a luma sample associated with the at least one sub-picture.
10. A method of video decoding, the method comprising:
obtaining a video bitstream associated with a picture, wherein the picture is partitioned into multiple sub-pictures and wherein the video bitstream indicates whether respective sub-picture identifiers (IDs) of the multiple sub-pictures are signaled in the video bitstream, the video bitstream further indicating whether at least one sub-picture of the multiple sub-pictures is treated as a picture and whether wrap-around motion compensation is enabled for the at least one sub-picture;
determining the respective sub-picture IDs of the multiple sub-pictures from the video bitstream in response to determining, based on the video bitstream, that the respective sub-picture IDs are signaled in the video bitstream; and
in response to determining, based on the video bitstream, that the at least one sub-picture is treated as a picture and that wrap-around motion compensation is enabled for the at least one sub-picture:
determine a wrap-around offset applicable to the at least one sub-picture;
decoding the picture associated with the bitstream based at least on the sub-picture IDs of the multiple sub-pictures and the determined wrap-around offset.
11. The method of claim 10 , further comprising, in response to determining that the respective sub-picture IDs are not signaled in the video bitstream, determining the respective sub-picture IDs of the multiple sub-pictures based on a sequence of index values that range from 0 to a total number of sub-pictures included in the picture minus 1.
12. The method of claim 10 , wherein whether the at least one sub-picture is treated as a picture and whether wrap-around motion compensation is enabled for the at least one sub-picture are indicated in a sequence parameter set of the video bitstream.
13. The method of claim 10 , wherein whether the at least one sub-picture is treated as a picture and whether wrap-around motion compensation is enabled for the at least one sub-picture are indicated in a picture parameter set of the video bitstream.
14. The method of claim 10 , wherein each of the multiple sub-pictures includes one or more slices that collectively cover a region of the picture associated with the video bitstream.
15. The method of claim 10 , wherein the picture associated with the video bitstream is partitioned into a grid comprising the multiple sub-pictures, and wherein each of the sub-picture IDs indicates a position of the corresponding sub-picture in the grid.
16. The method of claim 10 , wherein whether wrap-around motion compensation is enabled for the at least one sub-picture applies to whether horizontal wrap-around motion compensation is enabled for the at least one sub-pictures.
17. The method of claim 16 , wherein decoding the picture associated with the video bitstream comprises performing the wrap-around motion compensation for the at least one sub-picture based on the determined wrap-around offset.
18. The method of claim 17 , wherein the wrap-around offset is used to interpolate a luma sample associated with the at least one sub-picture.
19. A video encoding device, comprising:
a processor configured to:
partition a picture into multiple sub-pictures;
based on a determination to include respective sub-picture identifiers (IDs) of the multiple sub-pictures in a video bitstream:
determine the respective sub-picture IDs of the multiple sub-pictures;
include the determined sub-picture IDs of the multiple sub-pictures in the video bitstream; and
add a first indication to the video bitstream indicating that the respective sub-picture IDs of the multiple sub-pictures are signaled in the video bitstream; and
based on a determination to treat at least one sub-picture of the multiple sub-pictures as a picture and to enable wrap-around motion compensation for the at least one sub-picture:
add a second indication to the video bitstream indicating that the at least one sub-picture is treated as a picture; and
add a third indication to the video bitstream indicating that wrap-around motion compensation is enabled for the at least one sub-picture.
20. The video encoding device of claim 19 , wherein the first indication, the second indication and the third indication are added to a sequence parameter set of the video bitstream.