IP Library Granted Patent US 10,075,736
Granted Patent B2
US 10,075,736 · App. 15/710,985 · Granted Sep 11, 2018

Method and apparatus for encoding/decoding images

Inventors: Hendry Hendry (Seoul, KR); Yongjoon Jeon (Seoul, KR); Chulkeun Kim (Seoul, KR); Sangoh Jeong (Seoul, KR); Byeongmoon Jeon (Seoul, KR); Jungsun Kim (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N19/70H04N19/188H04N19/31H04N19/44H04N19/46H04N19/50H04N21/2387
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,075,736
App. No.
15/710,985
Granted
Sep 11, 2018
Kind
B2
Abstract

Disclosed are a method and apparatus for encoding/decoding images. The image-decoding method comprises the steps of: receiving a bit stream including information regarding an NAL unit type; and checking whether or not the NAL unit in the bit stream is a reference picture based on said information regarding an NAL unit type and decoding the NAL unit. The information regarding an NAL unit type indicates whether the NAL unit is a reference reading picture or not a reference reading picture.

Claims (50)

1. A decoding apparatus for image decoding, the apparatus comprising:

a decoder configured to receive a bitstream, to acquire network abstraction layer (NAL) unit type information from the bitstream, to determine a NAL unit type of a leading picture as one of NAL unit types, based on the NAL unit type information, wherein the leading picture precedes an associated random access point picture in output order, to configure a reference picture set, including RefPicSetStCurrBefore, RefPicSetStCurrAfter and RefPicSetLtCurr, for inter prediction with regard to a picture which follows the leading picture in decoding order, based on the NAL unit type of the leading picture, and to perform the inter prediction on at least one block in the picture based on the reference picture set; and

a memory to store pictures included in the reference picture set,

wherein the NAL unit types includes a first NAL unit type representing referenced decodable leading picture and a second NAL unit type representing non-referenced decodable leading picture, and

wherein the leading picture with the second NAL unit type is not included in any of the RefPicSetStCurrBefore, the RefPicSetStCurrAfter and the RefPicSetLtCurr of the picture with a same value of a temporal identifier.

2. The apparatus of claim 1 , wherein the NAL unit types further includes a third NAL unit type representing referenced skipped leading picture, and a fourth NAL unit type representing non-referenced skipped leading picture, and

wherein when the NAL unit type of the leading picture is the second NAL unit type or the fourth NAL unit type, the leading picture is not configured in any of the RefPicSetStCurrBefore, the RefPicSetStCurrAfter and the RefPicSetLtCurr of the picture with a same value of a temporal identifier.

3. The apparatus of claim 1 , wherein the NAL unit types further includes a third NAL unit type representing referenced skipped leading picture, and a fourth NAL unit type representing non-reference skipped leading picture, and

wherein when the NAL unit type of the leading picture is the second NAL unit type or the fourth NAL unit type, the leading picture cannot be used for inter prediction of subsequent pictures of the same temporal layer in the decoding order.

4. The apparatus of claim 3 , wherein the leading picture of which NAL unit type is the first NAL unit type or the third NAL unit type is included in the reference picture set, and

wherein the leading picture is a picture which follows the random access point picture in the decoding order and precedes the random access point picture in the output order.

5. The apparatus of claim 3 , wherein when the NAL unit type of the leading is the second NAL unit type or the fourth NAL unit type, the leading picture can be used for inter prediction of subsequent pictures of higher temporal layers.

6. The apparatus of claim 1 , wherein the random access point picture in which random access occurs is an instantaneous decoding refresh (IDR) picture, and

wherein the NAL unit type of the leading picture is the first NAL unit type or the second NAL unit type.

7. The apparatus of claim 2 , wherein the random access point picture in which random access occurs is a clean random access (CRA) picture or a broken link access (BLA) picture, and

wherein when the NAL unit type of the leading picture is the second NAL unit type or the fourth NAL unit type, the leading picture is not output.

8. The apparatus of claim 1 , wherein the random access point picture in which random access occurs is an instantaneous decoding refresh (IDR) picture, a clean random access (CRA) picture, or a broken link access (BLA) picture, and

wherein each picture stored in the memory is marked as a non-referenced picture.

9. The apparatus of claim 2 , wherein when random access occurs in the random access point picture and the NAL unit type of the leading picture is the second NAL unit type or the fourth NAL unit type, the leading picture is removable without having an effect on the decoding of other pictures of the same temporal layer.

10. An encoding apparatus for image encoding, the apparatus comprising:

an encoder configured to determine a NAL unit type of a leading picture as one of NAL unit types, to generate NAL unit type information based on the determined NAL unit type, wherein the leading picture precedes an associated random access point picture in output order, to configure a reference picture set, including RefPicSetStCurrBefore, RefPicSetStCurrAfter and RefPicSetLtCurr, for inter prediction with regard to a picture which follows the leading picture in decoding order, based on the NAL unit type of the leading picture, and to perform the inter prediction on at least one block in the picture based on the reference picture set, to generate residual information based on a result of the inter prediction, and to encode video information including the NAL unit type information and the residual information to generate a bitstream; and

a memory configured to store pictures included in the reference picture set,

wherein the NAL unit types includes a first NAL unit type representing referenced decodable leading picture and a second NAL unit type representing non-referenced decodable leading picture, and

wherein the leading picture with the second NAL unit type is not included in any of the RefPicSetStCurrBefore, the RefPicSetStCurrAfter and the RefPicSetLtCurr of the picture with a same value of a temporal identifier.

11. The apparatus of claim 10 , wherein the NAL unit types further includes a third NAL unit type representing referenced skipped leading picture, and a fourth NAL unit type representing non-referenced skipped leading picture, and

wherein when the NAL unit type of the leading picture is the second NAL unit type or the fourth NAL unit type, the leading picture is not configured in any of the RefPicSetStCurrBefore, the RefPicSetStCurrAfter and the RefPicSetLtCurr of the picture with a same value of a temporal identifier.

12. The apparatus of claim 10 , wherein the NAL unit types further includes a third NAL unit type representing referenced skipped leading picture, and a fourth NAL unit type representing non-reference skipped leading picture, and

wherein when the NAL unit type of the leading picture is the second NAL unit type or the fourth NAL unit type, the leading picture cannot be used for inter prediction of subsequent pictures of the same temporal layer in the decoding order.

13. The apparatus of claim 12 , wherein the leading picture of which NAL unit type is the first NAL unit type or the third NAL unit type is included in the reference picture set, and

wherein the leading picture is a picture which follows the random access point picture in the decoding order and precedes the random access point picture in the output order.

14. The apparatus of claim 12 , wherein when the NAL unit type of the leading is the second NAL unit type or the fourth NAL unit type, the leading picture can be used for inter prediction of subsequent pictures of higher temporal layers.

15. The apparatus of claim 10 , wherein the random access point picture in which random access occurs is an instantaneous decoding refresh (IDR) picture, and

wherein the NAL unit type of the leading picture is the first NAL unit type or the second NAL unit type.

16. The apparatus of claim 11 , wherein the random access point picture in which random access occurs is a clean random access (CRA) picture or a broken link access (BLA) picture, and

wherein when the NAL unit type of the leading picture is the second NAL unit type or the fourth NAL unit type, the leading picture is not output.

17. A non-transitory decoder-readable storage medium storing instructions which, when executed by a processor, cause the processor to:

receive a bitstream generated by an encoder;

acquire NAL unit type information from the bitstream;

determine a NAL unit type of a leading picture as one of NAL unit types, based on the NAL unit type information, wherein the leading picture precedes an associated random access point picture in output order;

configure a reference picture set, including RefPicSetStCurrBefore, RefPicSetStCurrAfter and RefPicSetLtCurr, for inter prediction with regard to a picture which follows the leading picture in decoding order, based on the NAL unit type of the leading picture;

perform the inter prediction on at least one block in the picture based on the reference picture set; and

store pictures included in the reference picture set,

wherein the NAL unit types includes a first NAL unit type representing referenced decodable leading picture and a second NAL unit type representing non-referenced decodable leading picture, and

wherein the leading picture with the second NAL unit type is not included in any of the RefPicSetStCurrBefore, the RefPicSetStCurrAfter and the RefPicSetLtCurr of the picture with a same value of a temporal identifier.

18. The non-transitory decoder-readable storage medium of claim 17 , wherein the NAL unit types further includes a third NAL unit type representing referenced skipped leading picture, and a fourth NAL unit type representing non-referenced skipped leading picture, and

wherein when the NAL unit type of the leading picture is the second NAL unit type or the fourth NAL unit type, the leading picture is not configured in any of the RefPicSetStCurrBefore, the RefPicSetStCurrAfter and the RefPicSetLtCurr of the picture with a same value of a temporal identifier.

19. The non-transitory decoder-readable storage medium of claim 17 , wherein the NAL unit types further includes a third NAL unit type representing referenced skipped leading picture, and a fourth NAL unit type representing non-reference skipped leading picture, and

wherein when the NAL unit type of the leading picture is the second NAL unit type or the fourth NAL unit type, the leading picture cannot be used for inter prediction of subsequent pictures of the same temporal layer in the decoding order.

20. The non-transitory decoder-readable storage medium of claim 19 , wherein the leading picture of which NAL unit type is the first NAL unit type or the third NAL unit type is included in the reference picture set, and

wherein the leading picture is a picture which follows the random access point picture in the decoding order and precedes the random access point picture in the output order.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2017
From: HENDRY, HENDRY; YONGJOON, JEON; KIM, CHULKEUN; JEONG, SANGOH; JEON, BYEONGMOON; KIM, JUNGSUN
To: LG ELECTRONICS INC.
Reel/Frame 043648/0733 →
Continuity (3)
Continuation 14427815
Provisional Application 61700335 · Sep 13, 2012
Related Publication 20180054631A1 · Feb 22, 2018