Granted Patent B2

US 12,389,027 · App. 18/492,501 · Granted Aug 12, 2025

Inventors: Miska Matias Hannuksela (Tampere, FI); Kemal Ugur (Istanbul, TR)

Assignee: NOKIA TECHNOLOGIES OY

H04N19/463H04N19/30H04N19/61H04N19/70

Abstract

Claims (80)

1. A method comprising:

encoding a bitstream comprising a base layer, a first enhancement layer and a second enhancement layer;

encoding, in the bitstream, an indication of a number of bits in a prediction type mask syntax element;

encoding, in the bitstream, a first prediction type mask syntax element for a first set of prediction types that is applicable from the base layer to the second enhancement layer, wherein the first set of prediction types is a subset of all prediction types available for prediction between layers, and wherein a prediction type of the first set is represented by a distinctive bit number in a bit mask; and

encoding, in the bitstream, a second prediction type mask syntax element for a second set of prediction types that is applicable from the base layer or the first enhancement layer to the second enhancement layer, wherein the second set of prediction types is a subset of all prediction types available for prediction between layers, and wherein a prediction type of the second set is represented by a distinctive bit number in a bit mask, and

wherein said prediction types of the first set that are available for prediction between layers are adaptively selectable as at least one of the following: sample prediction, motion information prediction or filtering parameter prediction.

2. The method according to claim 1 , wherein the first prediction type mask syntax element is included in a sequence-level syntax structure.

3. The method according to claim 2 , wherein the sequence-level syntax structure comprises at least one of a sequence parameter set or a video parameter set.

4. The method according to claim 1 , further comprising:

encoding a picture of the base layer and a picture of the first enhancement layer; and

encoding a picture of said second enhancement layer using said first set of prediction types from the picture of the base layer and said second set of prediction types from the picture of the first enhancement layer.

5. The method according to claim 1 ,

wherein each of said prediction types available for prediction between layers is represented by a bit number in the first prediction type mask syntax and the second prediction type mask syntax.

6. The method according to claim 1 , wherein said indication of the first set of prediction types and said indication of the second set of prediction types are included in at least one of a sequence parameter set or a video parameter set.

7. The method according to claim 1 , further comprising encoding, in the bitstream, an indication of at least one set of prediction types that is not applicable from the base layer or the first enhancement layer to the second enhancement layer.

8. The method according to claim 1 , wherein the second enhancement layer enhances a first scalability type relative to the base layer and a second scalability type relative to the first enhancement layer, and wherein the first scalability type and second scalability type are selected from at least one of: temporal scalability, quality scalability, spatial scalability, view scalability, depth enhancements, bit-depth scalability, chroma format scalability or color gamut scalability.

9. The method according to claim 8 , wherein the prediction types available for prediction between the second enhancement layer and the base layer are dependent on the first scalability type, and wherein the prediction types available for prediction between the second enhancement layer and the first enhancement layer are dependent on the second scalability type.

10. The method according to claim 1 , wherein the first set of prediction types has a first prediction direction and the second set of prediction types has a second prediction direction, and wherein said first prediction direction and second prediction direction are one of the following: temporal prediction, inter-view prediction, inter-layer prediction or intercomponent prediction.

11. An apparatus comprising:

at least one processor and at least one memory, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform:

encoding a bitstream comprising a base layer, a first enhancement layer and a second enhancement layer;

encoding, in the bitstream, an indication of a number of bits in a prediction type mask syntax element;

encoding, in the bitstream, a first prediction type mask syntax element for a first set of prediction types that is applicable from the base layer to the second enhancement layer, wherein the first set of prediction types is a subset of all prediction types available for prediction between layers, and wherein a prediction type of the first set is represented by a distinctive bit number in a bit mask; and

encoding, in the bitstream, a second prediction type mask syntax element for a second set of prediction types that is applicable from the base layer or the first enhancement layer to the second enhancement layer, wherein the second set of prediction types is a subset of all prediction types available for prediction between layers, and wherein a prediction type of the second set is represented by a distinctive bit number in a bit mask, and

wherein said prediction types of the first set that are available for prediction between layers are adaptively selectable as at least one of the following: sample prediction, motion information prediction or filtering parameter prediction.

12. The apparatus according to claim 11 , wherein the first prediction type mask syntax element is included in a sequence-level syntax structure.

13. The apparatus according to claim 12 , wherein the sequence-level syntax structure comprises at least one of a sequence parameter set or a video parameter set.

14. The apparatus according to claim 11 , wherein the apparatus is also caused to:

encode a picture of the base layer and a picture of the first enhancement layer; and

encode a picture of said second enhancement layer using said first set of prediction types from the picture of the base layer and said second set of prediction types from the picture of the first enhancement layer.

15. The apparatus according to claim 11 ,

wherein each of said prediction types available for prediction between layers is represented by a bit number in the first prediction type mask syntax and the second prediction type mask syntax.

16. The apparatus according to claim 11 , wherein said indication of the first set of prediction types and said indication of the second set of prediction types are included in at least one of a sequence parameter set or a video parameter set.

17. The apparatus according to claim 11 , wherein the apparatus is further configured to encode, in the bitstream, an indication of at least one set of prediction types that is not applicable from the base layer or the first enhancement layer to the second enhancement layer.

18. The apparatus according to claim 11 , wherein the second enhancement layer enhances a first scalability type relative to the base layer and a second scalability type relative to the first enhancement layer, and wherein the first scalability type and second scalability type are selected from at least one of: temporal scalability, quality scalability, spatial scalability, view scalability, depth enhancements, bit-depth scalability, chroma format scalability or color gamut scalability.

19. The apparatus according to claim 18 wherein the prediction types available for prediction between the second enhancement layer and the base layer are dependent on the first scalability type, and wherein the prediction types available for prediction between the second enhancement layer and the first enhancement layer are dependent on the second scalability type.

20. The apparatus according to claim 11 , wherein the first set of prediction types has a first prediction direction and the second set of prediction types has a second prediction direction, and wherein said first prediction direction and second prediction direction are one of the following: temporal prediction, inter-view prediction, inter-layer prediction or inter-component prediction.

21. A non-transitory computer readable storage medium stored with code thereon for use by an apparatus, which when executed by a processor, causes the apparatus to perform:

encoding a bitstream comprising a base layer, a first enhancement layer and a second enhancement layer;

encoding, in the bitstream, an indication of a number of bits in a prediction type mask syntax element;

encoding, in the bitstream, a first prediction type mask syntax element for a first set of prediction types that is applicable from the base layer to the second enhancement layer, wherein the first set of prediction types is a subset of all prediction types available for prediction between layers, and wherein a prediction type of the first set is represented by a distinctive bit number in a bit mask; and

encoding, in the bitstream, a second prediction type mask syntax for a second set of prediction types that is applicable from the base layer or the first enhancement layer to the second enhancement layer, wherein the second set of prediction types is a subset of all prediction types available for prediction between layers, and wherein a prediction type of the second set is represented by a distinctive bit number in a bit mask, and

wherein said prediction types of the first set that are available for prediction between layers are adaptively selectable as at least one of the following: sample prediction, motion information prediction or filtering parameter prediction.

22. A method comprising:

decoding, from a bitstream, an indication of a number of bits in prediction type mask syntax elements;

decoding, from the bitstream, a first prediction type mask syntax element for a first set of prediction types that is applicable from a base layer to a second enhancement layer, wherein the first set of prediction types is a subset of all prediction types available for prediction between layers, and wherein a prediction type of the first set is represented by a distinctive bit number in a bit mask;

decoding, from the bitstream, a second prediction type mask syntax element for a second set of prediction types that is applicable from a first enhancement layer to the second enhancement layer, wherein the second set of prediction types is a subset of all prediction types available for prediction between layers, and wherein a prediction type of the second set is represented by a distinctive bit number in a bit mask; and

decoding the second enhancement layer using said first set of prediction types from the base layer and said second set of prediction types from the first enhancement layer,

wherein said prediction types of the first set that are available for prediction between layers are at least one of the following: sample prediction, motion information prediction, sample adaptive offset parameter prediction or intra mode information prediction.

23. The method according to claim 22 , wherein the first prediction type mask syntax element is included in a sequence-level syntax structure.

24. The method according to claim 23 , wherein the sequence-level syntax structure comprises at least one of a sequence parameter set or a video parameter set.

25. The method according to claim 22 ,

wherein each of said prediction types available for prediction between layers is represented by a bit number in the first prediction type mask syntax and the second prediction type mask syntax.

26. The method according to claim 22 , wherein said indication of the first set of prediction types and said indication of the second set of prediction types are decoded from at least one of a sequence parameter set or a video parameter set.

27. The method according to claim 22 , further comprising decoding, from the bitstream, an indication of at least one set of prediction types that is not applicable from the base layer or the first enhancement layer to the second enhancement layer.

28. The method according to claim 22 , wherein the second enhancement layer enhances a first scalability type relative to the base layer and a second scalability type relative to the first enhancement layer, and wherein the first scalability type and second scalability type are selected from at least one of: temporal scalability, quality scalability, spatial scalability, view scalability, depth enhancements, bit-depth scalability, chroma format scalability or color gamut scalability.

29. The method according to claim 28 , wherein the prediction types available for prediction between the second enhancement layer and the base layer are dependent on the first scalability type, and wherein the prediction types available for prediction between the second enhancement layer and the first enhancement layer are dependent on the second scalability type.

30. The method according to claim 22 , wherein the first set of prediction types has a first prediction direction and the second set of prediction types has a second prediction direction, and wherein said first prediction direction and second prediction direction are one of the following: temporal prediction, inter-view prediction, inter-layer prediction or inter-component prediction.

31. An apparatus comprising:

at least one processor and at least one memory, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform:

decoding, from a bitstream, an indication of a number of bits in prediction type mask syntax elements;

decoding, from the bitstream, a first prediction type mask syntax element for a first set of prediction types that is applicable from a base layer to a second enhancement layer, wherein the first set of prediction types is a subset of all prediction types available for prediction between layers, and wherein a prediction type of the first set is represented by a distinctive bit number in a bit mask;

decoding, from the bitstream, a second prediction type mask syntax element for a second set of prediction types that is applicable from a first enhancement layer to the second enhancement layer, wherein the second set of prediction types is a subset of all prediction types available for prediction between layers, and wherein a prediction type of the second set is represented by a distinctive bit number in a bit mask; and

decoding the second enhancement layer using said first set of prediction types from the base layer and said second set of prediction types from the first enhancement layer,

wherein said prediction types of the first set that are available for prediction between layers are at least one of the following: sample prediction, motion information prediction, sample adaptive offset parameter prediction or intra mode information prediction.

32. The apparatus according to claim 31 , wherein the first prediction type mask syntax element is included in a sequence-level syntax structure.

33. The apparatus according to claim 32 , wherein the sequence-level syntax structure comprises at least one of a sequence parameter set or a video parameter set.

34. The apparatus according to claim 31 ,

wherein each of said prediction types available for prediction between layers is represented by a bit number in the first prediction type mask syntax and the second prediction type mask syntax.

35. The apparatus according to claim 31 , wherein said indication of the first set of prediction types and said indication of the second set of prediction types are decoded from at least one of a sequence parameter set or a video parameter set.

36. The apparatus according to claim 31 , wherein the apparatus is further caused to decode, from the bitstream, an indication of at least one set of prediction types that is not applicable from the base layer or the first enhancement layer to the second enhancement layer.

37. The apparatus according to claim 31 , wherein the second enhancement layer enhances a first scalability type relative to the base layer and a second scalability type relative to the first enhancement layer, and wherein the first scalability type and second scalability type are selected from at least one of: temporal scalability, quality scalability, spatial scalability, view scalability, depth enhancements, bit-depth scalability, chroma format scalability or color gamut scalability.

38. The apparatus according to claim 37 , wherein the prediction types available for prediction between the second enhancement layer and the base layer are dependent on the first scalability type, and wherein the prediction types available for prediction between the second enhancement layer and the first enhancement layer are dependent on the second scalability type.

39. The apparatus according to claim 31 , wherein the first set of prediction types has a first prediction direction and the second set of prediction types has a second prediction direction, and wherein said first prediction direction and second prediction direction are one of the following: temporal prediction, inter-view prediction, inter-layer prediction or inter-component prediction.

40. A non-transitory computer readable storage medium stored with code thereon for use by an apparatus, which when executed by a processor, causes the apparatus to perform:

decoding, from a bitstream, an indication of a number of bits in prediction type mask syntax elements;

decoding, from the bitstream, a first prediction type mask syntax element for a first set of prediction types that is applicable from a base layer to a second enhancement layer, wherein the first set of prediction types is a subset of all prediction types available for prediction between layers, and wherein a prediction type of the first set is represented by a distinctive bit number in a bit mask;

decoding, from the bitstream, a second prediction type mask syntax element for a second set of prediction types that is applicable from a first enhancement layer to the second enhancement layer, wherein the second set of prediction types is a subset of all prediction types available for prediction between layers, and wherein a prediction type of the second set is represented by a distinctive bit number in a bit mask; and

decoding the second enhancement layer using said first set of prediction types from the base layer and said second set of prediction types from the first enhancement layer,

wherein said prediction types of the first set that are available for prediction between layers are at least one of the following: sample prediction, motion information prediction, sample adaptive offset parameter prediction or intra mode information prediction.

Assignments (2)

Continuity (6)

References Cited (55)