IP Library Granted Patent US 10,616,573
Granted Patent B2
US 10,616,573 · App. 14/149,322 · Granted Apr 7, 2020

Method and apparatus for video coding and decoding

Inventors: Kemal Ugur (Istanbul, TR); Miska Matias Hannuksela (Tampere, FI); Jani Lainema (Tampere, FI)
Assignee: Nokia Technologies Oy
H04N19/105H04N19/33H04N19/46H04N19/573H04N19/58H04N19/70H04N19/103H04N19/11H04N19/187H04N19/19H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,616,573
App. No.
14/149,322
Granted
Apr 7, 2020
Kind
B2
Abstract

Various methods, apparatuses and computer program products for video encoding and decoding. In some embodiments a first picture having a first resolution on a first layer is encoded without inter-layer prediction; a second picture having a second resolution on a second layer is encoded without inter-layer prediction; a third picture having the second resolution on the second layer is encoded without inter-layer prediction and without temporally referencing to pictures prior to the second picture. Further, a corresponding indication is encoded. In some embodiments one or more indications are received to determine if a switching point, referring to a picture coded using inter-layer prediction, from the first layer to the second layer exists, and if so, pictures in the first layer prior to the switching point; pictures associated with the switching point; and pictures in the second layer after the switching point may be decoded.

Claims (90)

1. A method comprising:

receiving a first indicator and a second indicator, wherein a single value of the first indicator indicates that only random access pictures (RAP) in an enhancement layer utilize inter-layer prediction and also concurrently indicates that non-RAP pictures do not utilize inter-layer prediction, and wherein the second indicator indicates that other than an access unit associated with a switching point which includes pictures from at least two layers, every other access unit includes only pictures from a single layer;

determining by using at least one of the first indicator and the second indicator if the switching point from a first layer to a second layer exists in a bit stream, the switching point referring to a picture coded using inter-layer prediction; and

if the determining indicates that such switching point exists,

decoding one or more pictures in the first layer prior to the switching point;

decoding one or more pictures associated with the switching point; and

decoding one or more pictures in the second layer after the switching point.

2. The method according to claim 1 comprising one or more of the following:

receiving the first indicator and the second indicator at a sequence level;

receiving the first indicator and the second indicator as a type of a unit at a network abstraction layer;

receiving the first indicator and the second indicator in a supplemental enhancement

information network abstraction layer unit; and

receiving the first indicator and the second indicator in a sequence parameter set.

3. The method according to claim 1 comprising:

using the first indicator to determine whether a coded video sequence is constrained to perform the adaptive resolution change operation; and using the second indicator to determine whether inter-layer scalability tools may be used.

4. The method according to claim 1 comprising one of the following:

the first layer is a base layer of a scalable video coding; and the second layer is an enhancement layer of the scalable video coding; and

the first layer is a first enhancement layer of a scalable video coding; and the second layer is another enhancement layer of the scalable video coding; and

the first layer is a first view of a multiview video coding; and the second layer is a second view of the multiview video coding.

5. The method according to claim 1 comprising using the second picture for at least one of the following: resolution change of a video presentation; quality scalability; bit-depth scalability; spatial scalability; and chroma format scalability.

6. An apparatus comprising at least one processor and at least one non-transitory computer-readable memory including computer

program code, the at least one non-transitory computer-readable memory and the computer program code configured to, with the at least one processor, cause the apparatus to:

receive a first indicator and a second indicator, wherein a single value of the first indicator indicates that only random access pictures (RAP) in an enhancement layer utilize inter-layer prediction and also concurrently indicates that non-RAP pictures do not utilize inter-layer prediction, and wherein the second indicator indicates that other than an access unit associated with a switching point which includes pictures from at least two layers, every other access unit includes only pictures from a single layer;

determine by using at least one of the first indicator and the second indicator if the switching point from a first layer to a second layer exists in a bit stream; and

if the determining indicates that such switching point exists,

decode one or more pictures in the first layer prior to the switching point;

decode one or more pictures associated with the switching point; and

decode one or more pictures in the second layer after the switching point.

7. The apparatus according to claim 6 , said at least one non-transitory computer-readable memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least the following:

receive the first indicator and the second indicator at a sequence level;

receive the first indicator and the second indicator as a type of a unit at a network abstraction layer; and

receive the first indicator and the second indicator in a supplemental enhancement information network abstraction layer unit; and

receive the first indicator and the second indicator in a sequence parameter set.

8. The apparatus according to claim 7 , said at least one non-transitory computer-readable memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least the following:

use the first indicator to determine whether a coded video sequence is constrained to perform the adaptive resolution change operation; and

use the second indicator to determine whether inter-layer scalability tools may be used.

9. The apparatus according to claim 6 , said at least one non-transitory computer-readable memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to use the second picture for at least one of the following:

resolution change of a video presentation;

quality scalability;

bit depth scalability;

spatial scalability; and

chroma format scalability.

10. A method comprising:

encoding a first picture according to a first picture type having a first resolution bitstream on a first layer without using inter-layer prediction;

encoding a second picture according to a second picture type having a second resolution bitstream on a second layer using inter-layer prediction between the first layer and the second layer and without using temporal prediction using pictures from the second layer for providing a switching point from the first layer to the second layer;

encoding a third picture according to a third picture type having the second resolution bitstream on the second layer without using inter-layer prediction and without temporally referencing to pictures prior to the second picture on the second layer; and

encoding a first indicator and a second indicator, wherein a single value of the first indicator provides an indication that non-access random access pictures (RAP) including the first and third picture types are encoded without using inter-layer prediction and also concurrently provides an indication that only RAP pictures including the second picture type are encoded using inter-layer prediction but without using temporal prediction, and wherein the second indicator provides an indication that other than an access unit associated with a switching point which includes pictures from at least two layers, every other access unit includes only pictures from a single layer.

11. The method according to claim 10 comprising one or more of the following:

signaling the first indicator and the second indicator at a sequence level;

signaling the first indicator and the second indicator by a type of a unit at a network abstraction layer;

signaling the first indicator and the second indicator in a supplemental enhancement information network abstraction layer unit;

signaling the first indicator and the second indicator in a sequence parameter set; or

signaling the first indicator and the second indicator in a video parameter set.

12. The method according to claim 10 , wherein the first indicator is further indicative of that all access units are selected from a group consisting of:

a picture of the first picture type;

a picture of the second picture type;

a picture of the third picture type; and

a picture of the first picture type and a picture of the second picture type.

13. The method according to claim 10 comprising one of the following:

the first layer is a base layer of a scalable video coding; and the second layer is an enhancement layer of the scalable video coding;

the first layer is a first enhancement layer of a scalable video coding; and the second layer is another enhancement layer of the scalable video coding; and

the first layer is a first view of a multiview video coding; and the second layer is a second view of the multiview video coding.

14. The method according to claim 10 comprising using the second picture for at least one of the following:

resolution change of a video presentation;

quality scalability;

bit-depth scalability;

spatial scalability; and

chroma format scalability.

15. An apparatus comprising at least one processor and at least one non-transitory computer-readable memory including computer program code, the at least one non-transitory computer-readable memory and the computer program code configured to, with the at least one processor, cause the apparatus to:

encode a first picture according to a first picture type having a first resolution bitstream on a first layer without using inter-layer prediction;

encode a second picture according to a second picture type having a second resolution bitstream on a second layer using inter-layer prediction between the first layer and the second layer and without using temporal prediction using pictures from the second layer for providing a switching point from the first layer to the second layer;

encode a third picture according to a third picture type having the second resolution bitstream on the second layer without using inter-layer prediction and without temporally referencing to pictures prior to the second picture on the second layer; and

encode a first indicator and a second indicator, wherein a single value of the first indicator provides an indication that non-access random access pictures (RAP) including the first and third picture types are encoded without using inter-layer prediction and also concurrently provides an indication that only RAP pictures including the second picture type are encoded using inter-layer prediction but without using temporal prediction, and wherein the second indicator provides an indication that other than an access unit associated with a switching point which includes pictures from at least two layers, every other access unit includes only pictures from a single layer.

16. The apparatus according to claim 15 , said at least one non-transitory computer-readable memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least the following:

signal the first indicator and the second indicator at a sequence level;

signal the first indicator and the second indicator by a type of a unit at a network abstraction layer;

signal the first indicator and the second indicator in a supplemental enhancement information network abstraction layer unit;

signal the first indicator and the second indicator in a sequence parameter set; or

signaling the first indicator and the second indicator in a video parameter set.

17. The apparatus according to claim 15 , wherein the first indicator is further indicative of that all access units within a scope of the indication consist of:

a picture of the first picture type;

a picture of the second picture type;

a picture of the third picture type; or

a picture of the first picture type and a picture of the second picture type.

18. The apparatus according to claim 15 , said at least one non-transitory computer-readable memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least the following:

receive by a network element encoded pictures of the first layer and the second layer for at least one access unit of a video presentation; and

determine a format in which the video presentation is to be sent to a recipient;

wherein on the basis of the determination said at least one non-transitory computer-readable memory stored with code thereon, which when executed by said at least one processor, further causes the apparatus to perform at least the following:

send only one layer of the video presentation to the recipient; or

send both the first layer and the second layer to the recipient.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2015
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 034781/0200 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2014
From: UGUR, KEMAL; HANNUKSELA, MISKA MATIAS; LAINEMA, JANI
To: NOKIA CORPORATION
Reel/Frame 032462/0947 →
Cited By (3)
US 12,425,582 US 12,445,646 US 12,501,081