IP Library › Granted Patent US 12,022,117
Granted Patent B2
US 12,022,117 · App. 18/121,729 · Granted Jun 25, 2024

Apparatus, a method and a computer program for video coding and decoding

Inventor: Miska Hannuksela (Tampere, FI)
Assignee: Nokia Technologies Oy
H04N19/597H04N19/119H04N19/167H04N19/177H04N19/188H04N19/46H04N19/593H04N19/70H04N19/85
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,022,117
App. No.
18/121,729
Granted
Jun 25, 2024
Kind
B2
Abstract

Four or more bitstream versions of a same content are encoded and divided into segments of independently coded tile sets representing multiple spatial regions. First and second bitstreams include independently coded tile sets encoded at a first quality. Third and fourth bitstreams include independently coded tile sets encoded at a second quality. First and third bitstreams have first random access picture interval. Second and fourth bitstreams have second random access picture interval. Independently coded tile sets are grouped into multiple groups of collocated sub-picture tracks, only one of said tile sets per group is intended to be received and/or decoded per any segment. Instruction(s) are generated for merging tile sets of different spatial locations into coded picture(s), causing a tile set originating from a random access picture to be decoded as a tile set originating from a non-random-access picture when merged with a tile set originating from a non-random-access picture.

Claims (52)

1. A method comprising:

receiving a merged bitstream;

decoding an indication that a first image segment in a coded picture at a first time instance of the merged bitstream is provided with a video coding layer network abstraction layer (VCL NAL) unit type indicative of a random access image segment;

decoding an indication that a second image segment in the coded picture is provided with a VCL NAL unit type indicative of a non-random access image segment;

decoding a picture level indication to conclude a picture type of the coded picture; and

decoding the coded picture according to its picture type.

2. The method according to claim 1 , further comprising:

decoding from the picture level indication that the picture type is a non-random access picture; and

decoding the coded picture as a non-random access picture.

3. The method according to claim 1 , further comprising:

keeping track of a decoding initialization status on an image segment basis; and

initializing the decoding based on the VCL NAL unit types of an image segment.

4. The method according to claim 3 , further comprising, responsive to image segments being uninitialized and the VCL NAL unit types of at least one image segment being indicative of non-random access image segments, omitting decoding of VCL NAL units of the at least one image segment.

5. The method according to claim 3 , further comprising

responsive to the decoding of image segments being uninitialized and the VCL NAL unit type of at least one image segment being indicative of random access image segments, decoding VCL NAL units of the at least one image segment; and

inferring the decoding of the at least one image segment to be initialized.

6. The method according to claim 3 , further comprising, responsive to the decoding of the image segment being initialized, decoding VCL NAL units of the image segment regardless of the VCL NAL unit types.

7. An apparatus comprising:

one or more processors; and

one or more memories storing instructions that, when executed by the one or more processors, cause the apparatus at least to perform:

receiving a merged bitstream;

decoding an indication that a first image segment in a coded picture at a first time instance of the merged bitstream is provided with a video coding layer network abstraction layer (VCL NAL) unit type indicative of a random access image segment;

decoding an indication that a second image segment in the coded picture is provided with a VCL NAL unit type indicative of a non-random access image segment;

decoding a picture level indication to conclude a picture type of the coded picture; and

decoding the coded picture according to its picture type.

8. The apparatus according to claim 7 , wherein the one or more memories further store instructions that, when executed by the one or more processors, cause the apparatus at least to perform:

decoding from the picture level indication that the picture type is a non-random access picture; and

decoding the coded picture as a non-random access picture.

9. The apparatus according to claim 8 , wherein the one or more memories further store instructions that, when executed by the one or more processors, cause the apparatus at least to perform:

keeping track of a decoding initialization status on an image segment basis; and

initializing the decoding based on the VCL NAL unit types of an image segment.

10. The apparatus according to claim 9 , wherein the one or more memories further store instructions that, when executed by the one or more processors, cause the apparatus at least to perform:

omitting, responsive to image segments being uninitialized and the VCL NAL unit types of at least one image segment being indicative of non-random access image segments, decoding of VCL NAL units of the at least one image segment.

11. The apparatus according to claim 9 , wherein the one or more memories further store instructions that, when executed by the one or more processors, cause the apparatus at least to perform:

responsive to the decoding of image segments being uninitialized and the VCL NAL unit type of the at least one image segment being indicative of random access image segments, decoding VCL NAL units of the at least one image segment; and

inferring the decoding of the at least one image segment to be initialized.

12. The apparatus according to claim 9 , wherein the one or more memories further store instructions that, when executed by the one or more processors, cause the apparatus at least to perform: responsive to the decoding of the image segment being initialized, VCL NAL units of the image segment regardless of the VCL NAL unit types.

13. A computer program product includes a non-transitory computer-readable storage medium bearing instructions that, when executed by an apparatus, cause the apparatus to perform at least the following:

receiving a merged bitstream;

decoding an indication that a first image segment in a coded picture at a first time instance of the merged bitstream is provided with a video coding layer network abstraction layer (VCL NAL) unit type indicative of a random access image segment;

decoding an indication that a second image segment in the coded picture is provided with a VCL NAL unit type indicative of a non-random access image segment;

decoding a picture level indication to conclude a picture type of the coded picture; and

decoding the coded picture according to its picture type.

14. The computer program product according to claim 13 , wherein the non-transitory computer-readable storage medium bears instructions that, when executed by the apparatus, cause the apparatus to perform at least the following:

decoding from the picture level indication that the picture type is a non-random access picture; and

decoding the coded picture as a non-random access picture.

15. The computer program product according to claim 14 , wherein the non-transitory computer-readable storage medium bears instructions that, when executed by the apparatus, cause the apparatus to perform at least the following:

keeping track of a decoding initialization status on an image segment basis; and

initializing the decoding based on the VCL NAL unit types of an image segment.

16. The computer program product according to claim 15 , wherein the non-transitory computer-readable storage medium bears instructions that, when executed by the apparatus, cause the apparatus to perform at least the following: responsive to image segments being uninitialized and the VCL NAL unit types of at least one image segment being indicative of non-random access image segments, omitting the decoding of VCL NAL units of the at least one image segment.

17. The computer program product according to claim 15 , wherein the non-transitory computer-readable storage medium bears instructions that, when executed by the apparatus, cause the apparatus to perform at least the following: responsive to the decoding of image segments being uninitialized and the VCL NAL unit type of at least one image segment being indicative of random access image segments, decoding VCL NAL units of the at least one image segment; and inferring the decoding of the at least one image segment to be initialized.

18. The computer program product according to claim 15 , wherein the computer-readable storage medium bears instructions that, when executed by the apparatus, cause the apparatus to perform at least the following: responsive to the decoding of the image segment being initialized, decoding VCL NAL units of the image segment regardless of the VCL NAL unit types.

Priority Claims (1)
FI 20195001 · Jan 2, 2019 · national
Continuity (2)
Continuation 17419080
Related Publication 20230276073A1 · Aug 31, 2023