IP Library › Granted Patent US 10,116,947
Granted Patent B2
US 10,116,947 · App. 14/413,154 · Granted Oct 30, 2018

Method and apparatus for coding multilayer video to include scalable extension type information in a network abstraction layer unit, and method and apparatus for decoding multilayer video

Inventors: Byeong-doo Choi (Siheung-si, KR); Jae-hyun Kim (Seoul, KR); Jeong-hoon Park (Seoul, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N19/188H04N19/176H04N19/187H04N19/30H04N19/46H04N19/597H04N19/70H04N21/236H04N21/234327
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,116,947
App. No.
14/413,154
Granted
Oct 30, 2018
Kind
B2
Abstract

A multilayer video encoding method includes encoding a multilayer video, generating network adaptive layer (NAL) units for data units included in the encoded multilayer video, and adding scalable extension type information, for a scalable extension of the multilayer video, to a video parameter set (VPS) NAL unit among the NAL units, the VPS NAL unit including VPS information that is information commonly applied to the multilayer video.

Claims (50)

1. A multilayer video encoding method comprising:

encoding a multilayer video;

generating network abstraction layer (NAL) units for data units included in the encoded multilayer video; and

adding scalable extension type information, for a scalable extension of the multilayer video, to a video parameter set (VPS) NAL unit among the NAL units, the VPS NAL unit comprising VPS information that is information applied to the multilayer video; and

outputting an encoded scalable video bitstream including the encoded multilayer video and the generated NAL units with added scalable extension type information;

wherein the adding of the scalable extension type information comprises adding, to a header of the VPS NAL unit: 1) a scalable extension type table index indicating a scalable extension type table among scalable extension type tables including combinations of scalable extension types that are applicable to the multilayer video; and 2) a plurality of sub-layer indexes indicating specific scalable extension types included in a combination among the combinations of the scalable extension types included in the scalable extension type table indicated by the scalable extension type table index.

2. The multilayer video encoding method of claim 1 , wherein the generating of the NAL units comprises:

generating a slice segment NAL unit including encoded information in units of slices for slice units included in the multilayer video;

generating a picture parameter set (PPS) NAL unit including information about a PPS that is applied to pictures included in the multilayer video;

generating a sequence parameter set (SPS) NAL unit including information about an SPS that is applied to an image sequence of a predetermined layer included in the multilayer video; and

generating the VPS NAL unit including information about the VPS that is applied to the multilayer video which is a set of image sequences of the predetermined layer.

3. The multilayer video encoding method of claim 2 ,

wherein the PPS NAL unit further includes another layer index indicating a combination among the combinations of the scalable extension types included in the scalable extension type table indicated by the scalable extension type table index in order to indicate a scalable extension type applied to the PPS NAL unit.

4. The multilayer video encoding method of claim 2 ,

wherein the SPS NAL unit further includes another layer index indicating a combination among the combinations of the scalable extension types included in the scalable extension type table indicated by the scalable extension type table index in order to indicate a scalable extension type applied to the SPS NAL unit.

5. The multilayer video encoding method of claim 1 , wherein the scalable extension type information comprises at least one of temporal scalability, qualitative scalability, spatial scalability, and view information.

6. The multilayer video encoding method of claim 1 , wherein the scalable extension type information is the scalable extension type table index indicating the scalable extension type table among the scalable extension type tables including the combinations of scalable extension types that are applicable to the multilayer video,

wherein the scalable extension type table is included in a supplemental enhancement information (SEI) message to be transmitted.

7. A multilayer video encoding apparatus comprising:

a processor, and

a memory storing a program which causes the processor to:

encode a multilayer video; and

generate network abstraction layer (NAL) units for data units included in the encoded multilayer video,

add scalable extension type information, for scalable extension of the multilayer video, to a video parameter set (VPS) NAL unit among the NAL units, the VPS NAL unit including VPS information that is information applied to the multilayer video; and

output an encoded scalable video bitstream including the encoded multilayer video and the generated NAL units with added scalable extension type information;

wherein the processor is configured to add the scalable extension type information by adding, to a header of the VPS NAL unit: 1) a scalable extension type table index indicating a scalable extension type table among scalable extension type tables including combinations of scalable extension types that are applicable to the multilayer video; and 2) a plurality of sub-layer indexes indicating specific scalable extension types included in a combination among the combinations of the scalable extension types included in the scalable extension type table indicated by the scalable extension type table index.

8. A multilayer video decoding method comprising:

receiving network abstraction layer (NAL) units that are generated by dividing an encoded multilayer video according to data units;

obtaining a video parameter set (VPS) NAL unit from among the received NAL units, the VPS NAL unit including VPS information that is information applied to the multilayer video; and

obtaining scalable extension type information for scalable extension of the multilayer video from the VPS NAL unit; and

decoding the encoded multilayer video according to the scalable type information; and

outputting the decoded multilayer video;

wherein the obtaining of the scalable extension type information comprises obtaining, from a header of the VPS NAL unit; 1) a scalable extension type table index indicating a scalable extension type table among scalable extension type tables including combinations of scalable extension types that are applicable to the multilayer video; and 2) a plurality of sub-layer indexes indicating specific scalable extension types included in a combination among the combinations of the scalable extension types included in the scalable extension type table indicated by the scalable extension type table index.

9. The multilayer video decoding method of claim 8 , wherein the NAL units comprise, for slice units included in the multilayer video, a slice segment NAL unit including encoded information of a slice unit, a picture parameter set (PPS) NAL unit including information about PPS information that is applied to pictures included in the multilayer video, a sequence parameter set (SPS) NAL unit including information about SPS information that is applied to an image sequence of a predetermined layer included in the multilayer video, and the VPS NAL unit,

wherein the slice segment NAL unit, the PPS NAL unit, the SPS NAL unit, and the VPS NAL unit are identified based on a NAL unit identifier included in a header of the NAL unit.

10. The multilayer video decoding method of claim 8 , wherein the obtaining of the scalable extension type information further comprises:

obtaining another layer index indicating a combination among the combinations of the scalable extension types included in the scalable extension type table indicated by the scalable extension type table index from a PPS NAL unit including information about a PPS that is applied to pictures included in the multilayer video, and determining a scalable extension type applied to the pictures by using the obtained layer index.

11. The multilayer video decoding method of claim 8 , wherein the obtaining of the scalable extension type information further comprises:

obtaining another layer index indicating a combination among the combinations of the scalable extension types included in the scalable extension type table indicated by the scalable extension type table index from a SPS NAL unit including information about an SPS that is applied to image sequences of a predetermined layer included in the multilayer video, and determining a scalable extension type applied to the image sequence of the predetermined layer by using the obtained layer index.

12. The multilayer video decoding method of claim 8 , wherein the scalable extension type information comprises the scalable extension type table indicating the scalable extension type table among the scalable extension type tables including the combinations of scalable extension types that are applicable to the multilayer video,

wherein the scalable extension type table is included in a supplemental enhancement information (SEI) message to be received.

13. A multilayer video decoding apparatus comprising:

a processor, and

a memory storing a program which causes the processor to:

receive network abstraction layer (NAL) units that are generated by dividing a multilayer video according to data units;

obtain a video parameter set (VPS) NAL unit among the NAL units, the VPS NAL unit including VPS information that is information applied to the multilayer video;

obtain from the VPS NAL unit scalable extension type information for scalable extension of the multilayer video;

decode the encoded multilayer video according to the scalable type information; and

output the decoded multilayer video;

wherein the processor is configured to obtain the scalable extension type information by obtaining, from a header of the VPS NAL unit: 1) a scalable extension type table index indicating a scalable extension type table among scalable extension type tables including combinations of scalable extension types that are applicable to the multilayer video; and 2) a plurality of sub-layer indexes indicating specific scalable extension types included in a combination among the combinations of the scalable extension types included in the scalable extension type table indicated by the scalable extension type table index.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2015
From: CHOI, BYEONG-DOO; KIM, JAE-HYUN; PARK, JEONG-HOON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 034744/0739 →
Continuity (2)
Provisional Application 61668666 · Jul 6, 2012
Related Publication 20150172679A1 · Jun 18, 2015