Method for support of scalability with adaptive picture resolution
A method and apparatus for decoding multiple semantically independent picture parts into a single video picture includes decoding unique picture order count values for each coded picture, coded slice, or coded tile in a coded video sequence, with multiple decoded pictures, cycles, and tiles belonging to a same access unit representing a frame of the video. A value representing the amount of pictures, cycles, or tiles, is then assigned to each access unit for assigning sequential access unit count values to the access units. As a result, each access unit, which represents multiple pictures, slices, or tiles to be combined into a single frame, is decoded for display processing.
1. A method for video decoding performed by at least one processor, the method comprising:
receiving a video bitstream comprising a current picture and a reference picture associated with the current picture;
determining at least one of a first picture, a first slice, and a first tile with a first value of a picture order count; and
determining at least one of a second picture, a second slice, and a second tile with a second value of the picture order count,
wherein the at least one of the first picture, the first slice, and the first tile belong to a first access unit among access units, and the at least one of the second picture, the second slice, and the second tile belong to the first access unit, wherein the first value of the picture order count and the second value of the picture order count are different, and wherein the first access unit corresponds to a time instance; and
reconstructing, to a high level syntax structure, a syntax element poc_cycle_au, wherein a value of the poc_cycle_au corresponds to a number indicating how many picture order count values are associated with the first access unit and a maximum difference between the first value of the picture order count and the second value of the picture order count in the first access unit.
2. The method of claim 1 , further comprising:
reconstructing, to the high level syntax structure, a syntax element vps_poc_cycle_au, wherein a value of vps_poc_cycle_au is indicative of all coded pictures or slices in a coded video sequence; and
reconstructing, to the high level syntax structure, a syntax element slice_poc_cycle_au, wherein a value of slice_poc_cycle_au is indicative of the poc_cycle_au of a current slice.
3. The method of claim 1 , further comprising:
based on poc_cycle_au being constant for each access unit in a coded video sequence, reconstructing, to the high level syntax structure, a vps_constant_poc_cycle_per_au equaling 1; and
based on poc_cycle_au being variable for each access unit in the coded video sequence, reconstructing, to the high level syntax structure, a vps_constant_poc_cycle_per_au equaling 0.
4. The method of claim 1 , wherein the high level syntax structure is a video parameter set or a sequence parameter set.
5. The method of claim 1 , further comprising reconstructing scalability structure information into in a video parameter set to indicate the maximum difference of the first value of the picture order count and the second value of the picture order count.
6. The method of claim 1 , further comprising:
reconstructing a temporal identifier value for each picture, slice, or tile, the temporal identifier value indicating a temporal sub-layer, wherein each coded picture, coded slice, or coded tile in a same access unit has a same temporal identifier value; and
reconstructing a spatial layer identifier value for each picture, slice, or tile, the spatial layer identifier value indicating a spatial layer.
7. The method of claim 1 , further comprising:
reconstructing scalability structure information to one of a slice header, a group of blocks (GOB) header, a tile header, and a tile group header.
8. The method of claim 1 , further comprising:
reconstructing scalability structure to one of a picture parameter set, a header parameter set, a tile parameter set, and an adaptation parameter set.
9. The method of claim 1 , further comprising:
reconstructing reference information to one of a slice header, a group of blocks (GOB) header, a tile header, and a tile group header;
reconstructing, to a location indicated in the reference information, a scalability structure corresponding to one of a picture parameter set, a header parameter set, a tile parameter set, and an adaptation parameter set.
10. A device for video decoding comprising:
at least one memory configured to store program code; and
at least one processor configured to decode the program code, the program code including:
receiving code configured to cause the at least one processor to receive a video bitstream comprising a current picture and a reference picture associated with the current picture;
first determining code configured to cause the at least one processor to determine at least one of a first picture, a first slice, and a first tile with a first value of a picture order count; and
second determining code configured to cause the at least one processor to determine at least one of a second picture, a second slice, and a second tile with a second value of the picture order count,
wherein the at least one of the first picture, the first slice, and the first tile belong to a first access unit among access units, and the at least one of the second picture, the second slice, and the second tile belong to the first access unit, wherein the first value of the picture order count and the second value of the picture order count are different, and wherein the first access unit corresponds to a time instance; and
first reconstructing code configured to cause the at least one processor to reconstruct, to a high level syntax structure, a syntax element poc_cycle_au, wherein a value of the poc_cycle_au corresponds to a number indicating how many picture order count values are associated with the first access unit and a maximum difference between the first value of the picture order count and the second value of the picture order count in the first access unit.
11. The device of claim 10 , further comprising:
second reconstructing code configured to cause the at least one processor to reconstruct, to the high level syntax structure, a syntax element of vps_poc_cycle_au, wherein the value of ps_poc_cycle_au is indicative of all coded pictures or slices in a coded video sequence; and
third reconstructing code configured to cause the at least one processor to reconstruct, to the high level syntax structure, a syntax element of slice_poc_cycle_au, wherein the value of slice_poc_cycle_au is indicative of the poc_cycle_au of a current slice.
12. The device of claim 10 , further comprising:
third reconstructing code configured to cause the at least one processor to reconstruct, to the high level syntax structure, based on poc_cycle_au being constant for each access unit in a coded video sequence, a vps_constant_poc_cycle_per_au equaling 1; and
fourth reconstructing code configured to cause the at least one processor to reconstruct, to the high level syntax structure, based on poc_cycle_au being variable across access units in the coded video sequence, a vps_constant_poc_cycle_per_au equaling 0.
13. The device of claim 10 , further comprising a third reconstructing code configured to cause the at least one processor to reconstruct scalability structure information into in a video parameter set to indicate the maximum difference of the first value of the picture order count and the second value of the picture order count.
14. The device of claim 10 , further comprising:
third reconstructing code configured to cause the at least one processor to reconstruct a temporal identifier value for each picture, slice, or tile, the temporal identifier value indicating a temporal sub-layer, wherein each coded picture, coded slice, or coded tile in a same access unit has a same temporal identifier value; and
fourth reconstructing code configured to cause the at least one processor to reconstruct a spatial layer identifier value for each picture, slice, or tile, the spatial layer identifier value indicating a spatial layer.
15. The device of claim 10 , further comprising:
third reconstructing code configured to cause the at least one processor to reconstruct scalability structure information to one of a slice header, a group of blocks (GOB) header, a tile header, and a tile group header.
16. The device of claim 10 , further comprising:
third reconstructing code configured to cause the at least one processor to reconstruct scalability structure to one of a picture parameter set, a header parameter set, a tile parameter set, and an adaptation parameter set.
17. The device of claim 10 , further comprising:
third reconstructing code configured to cause the at least one processor to reconstruct reference information to one of a slice header, a group of blocks (GOB) header, a tile header, and a tile group header;
fourth reconstructing code configured to cause the at least one processor to reconstruct, to a location indicated in the reference information, scalability structure from one of a picture parameter set, a header parameter set, a tile parameter set, and an adaptation parameter set.
18. A non-transitory computer readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by one or more processors of a device, cause one or more processors to:
receive a video bitstream comprising a current picture and a reference picture associated with the current picture;
determine at least one of a first picture, a first slice, and a first tile with a first value of a picture order count; and
determine at least one of a second picture, a second slice, and a second tile with a second value of the picture order count,
wherein the at least one of the first picture, the first slice, and the first tile belong to a first access unit among access units, and the at least one of the second picture, the second slice, and the second tile belong to the first access unit, wherein the first value of the picture order count and the second value of the picture order count are different, and wherein the first access unit corresponds to a time instance; and
reconstruct, to a high level syntax structure, a syntax element poc_cycle_au, wherein a value of the poc_cycle_au corresponds to a number indicating how many picture order count values are associated with the first access unit and a maximum difference between the first value of the picture order count and the second value of the picture order count in the first access unit.