IP Library Granted Patent US 9,398,293
Granted Patent B2
US 9,398,293 · App. 14/148,000 · Granted Jul 19, 2016

Gradual decoding refresh with temporal scalability support in video coding

Inventors: Ye-Kui Wang (San Diego, CA); Adarsh Krishnan Ramasubramonian (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04N19/00533H04N19/107H04N19/31H04N19/44H04N19/70H04N19/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,398,293
App. No.
14/148,000
Granted
Jul 19, 2016
Kind
B2
Abstract

An example method of decoding video data includes receiving, in a message associated with a picture, information indicating a refreshed region of the picture, determining whether the picture comprises a last picture in a gradual decoder refresh (GDR) set, determining whether the picture comprises a recovery point picture, and responsive to determining that the picture comprises the last picture in the GDR set and the recovery point picture, determining that the message indicates that the entire picture belongs to the refreshed region of the picture.

Claims (78)

1. A method of decoding video data, the method comprising:

receiving, from an encoded video bitstream, a recovery point supplemental enhancement information (SEI) message indicative of a recovery point;

receiving, from the encoded video bitstream, at least one region refresh SEI message associated with a picture, the at least one region refresh SEI message comprising information indicating a refreshed region of the picture, the information including a refreshed_region_flag syntax element having a value of 1;

determining, using a value of a recovery picture order count (POC) value included in the recovery point SEI message that indicates the recovery point, whether the picture comprises a recovery point picture that is available for random access decoding;

responsive to determining that the picture comprises the recovery point picture that is available for random access decoding, determining that the picture comprises a last picture, in decoding order, among a gradual decoder refresh (GDR) set of pictures, and an entirety of the picture belongs to the refreshed region of the picture; and

decoding the picture based on the determination that the entirety of the picture belongs to the refreshed region of the picture.

2. The method of claim 1 , further comprising determining that the refreshed region of the picture comprises a set of coding tree units (CTUs) in all slice segments of an access unit that are associated with the at least one region refresh SEI message.

3. The method of claim 1 , further comprising determining, based on the picture being the recovery point picture and the last picture, in decoding order, among the GDR set of pictures, that the entirety of the picture is one of correct in content or approximately correct in content.

4. The method of claim 1 , further comprising determining, based on the refreshed_region_flag syntax element having the value of 1, that slice segments associated with the at least one region refresh SEI message belong to the refreshed region of the picture.

5. A device for decoding video data, the device comprising:

a memory configured to store the video data; and

a video coder configured to:

receive, from an encoded video bitstream, a recovery point supplemental enhancement information (SEI) message indicative of a recovery point;

receive, from the encoded video bitstream, at least one region refresh SEI message associated with a picture of the encoded video data, the at least one region refresh SEI message comprising information indicating a refreshed region of the picture, the information including a refreshed_region_flag syntax element having a value of 1;

determine, using a value of a recovery picture order count (POC) value included in the recovery point SEI message that indicates the recovery point, whether the picture comprises a recovery point picture that is available for random access decoding;

responsive to the determination that the picture comprises the recovery point picture that is available for random access decoding, determine that the picture comprises a last picture, in decoding order, among a gradual decoder refresh (GDR) set of pictures, and an entirety of the picture belongs to the refreshed region of the picture; and

decode the picture based on the determination that the entirety of the picture belongs to the refreshed region of the picture.

6. The device of claim 5 , wherein the video coder is further configured to determine that the refreshed region of the picture comprises a set of coding tree units (CTUs) in all slice segments of an access unit that are associated with the at least one region refresh SEI message.

7. The device of claim 5 , wherein the video coder is further configured to determine, based on the picture being the recovery point picture and the last picture, in decoding order, among the GDR set of pictures, that the entirety of the picture is one of correct in content or approximately correct in content.

8. The device of claim 5 , wherein the video coder is further configured to determine, based on the refreshed_region_flag syntax element having the value of 1, that slice segments associated with the at least one region refresh SEI message belong to the refreshed region of the picture.

9. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause a processor of a video coding device to:

receive, from an encoded video bitstream, a recovery point supplemental enhancement information (SEI) message indicative of a recovery point;

receive, from the encoded video bitstream, at least one region refresh SEI message associated with a picture, the at least one region refresh SEI message comprising information indicating a refreshed region of the picture, the information including a refreshed_region_flag syntax element having a value of 1;

determine, using a value of a recovery picture order count (POC) value included in the recovery point SEI message that indicates the recovery point, whether the picture comprises a recovery point picture that is available for random access decoding;

responsive to the determination that the picture comprises the recovery point picture that is available for random access decoding, determine that the picture comprises a last picture, in decoding order, among a gradual decoder refresh (GDR) set of pictures, and an entirety of the picture belongs to the refreshed region of the picture; and

decode the picture based on the determination that the entirety of the picture belongs to the refreshed region of the picture.

10. The non-transitory computer-readable storage medium of claim 9 , having stored thereon further instructions that, when executed, cause the processor of the video coding device to determine that the refreshed region of the picture comprises a set of coding tree units (CTUs) in all slice segments of an access unit that are associated with the at least one region refresh SEI message.

11. The non-transitory computer-readable storage medium of claim 9 , having stored thereon further instructions that, when executed, cause the processor of the video coding device to determine, based on the picture being the recovery point picture and the last picture, in decoding order, among the GDR set of pictures, determine that the entirety of the picture is one of correct in content or approximately correct in content.

12. The non-transitory computer-readable storage medium of claim 9 , having stored thereon further instructions that, when executed, cause the processor of the video coding device to determine, based on the refreshed_region_flag syntax having the value of 1, that slice segments associated with the at least one region refresh SEI message belong to the refreshed region of the picture.

13. A device for decoding video data, the device comprising:

means for receiving, from an encoded video bitstream, a recovery point supplemental enhancement information (SEI) message indicative of a recovery point;

means for receiving, from the encoded video bitstream, at least one region refresh SEI message associated with a picture, the at least one region refresh SEI message comprising information indicating a refreshed region of the picture, the information including a refreshed_region_flag syntax element having a value of 1;

means for determining, using a value of a recovery picture order count (POC) value included in the recovery point SEI message that indicates the recovery point, whether the picture comprises a recovery point picture that is available for random access decoding;

means for determining, responsive to determining that the picture comprises the recovery point picture that is available for random access decoding, that the picture comprises a last picture, in decoding order, among a gradual decoder refresh (GDR) set of pictures, and an entirety of the picture belongs to the refreshed region of the picture; and

means for decoding the picture based on the determination that the entirety of the picture belongs to the refreshed region of the picture.

14. The device of claim 13 , further comprising means for determining that the refreshed region of the picture comprises a set of coding tree units (CTUs) in all slice segments of an access unit that are associated with the at least one region refresh SEI message.

15. The device of claim 13 , further comprising determining, based on the picture being the recovery point picture and the last picture, in decoding order, among the GDR set of pictures, determine that the entirety of the picture is one of correct in content or approximately correct in content.

16. The device of claim 13 , further comprising means for determining, based on the refreshed_region_flag syntax element having the value of 1, that slice segments associated with the at least one region refresh SEI message belong to the refreshed region of the picture.

17. The method of claim 1 , further comprising determining, based on the picture being the recovery point picture and the last picture, in decoding order, among the GDR set of pictures, that each region refresh SEI message associated with an access unit includes a respective refreshed_region_flag syntax element having a value of 1, the access unit including the at least one region refresh SEI message.

18. The device of claim 5 , wherein the video coder is further configured to determine, based on the picture being the recovery point picture and the last picture, in decoding order, among the GDR set of pictures, that each region refresh SEI message associated with an access unit includes a respective refreshed_region_flag syntax element having a value of 1, the access unit including the at least one region refresh SEI message.

19. The device of claim 5 , further comprising a display device configured to display at least a portion of the video data.

20. The device of claim 5 , further comprising at least one of:

one or more integrated circuits;

one or more microprocessors;

one or more digital signal processors (DSPs);

one or more field programmable gate arrays (FPGAs);

a desktop computer;

a laptop computer;

a tablet computer;

a phone;

a television;

a camera;

a display device;

a digital media player;

a video game console;

a video game device;

a video streaming device; or

a wireless communication device.

21. The non-transitory computer-readable storage medium of claim 9 , having stored thereon further instructions that, when executed, cause the processor of the video coding device to determine, based on the picture being the recovery point picture and the last picture, in decoding order, among the GDR set of pictures, that each region refresh SEI message associated with an access unit includes a respective refreshed_region_flag syntax element having a value of 1, the access unit including the at least one region refresh SEI message.

22. The device of claim 13 , further comprising means for determining, based on the picture being the recovery point picture and the last picture, in decoding order, among the GDR set of pictures, that each region refresh SEI message associated with an access unit includes a respective refreshed_region_flag syntax element having a value of 1, the access unit including the at least one region refresh SEI message.

23. The device of claim 13 , further comprising means for displaying at least a portion of the video data.

24. The device of claim 13 , further comprising at least one of:

one or more integrated circuits;

one or more microprocessors;

one or more digital signal processors (DSPs);

one or more field programmable gate arrays (FPGAs);

a desktop computer;

a laptop computer;

a tablet computer;

a phone;

a television;

a camera;

a display device;

a digital media player;

a video game console;

a video game device;

a video streaming device; or

a wireless communication device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 17, 2014
From: WANG, YE-KUI; RAMASUBRAMONIAN, ADARSH KRISHNAN
To: QUALCOMM INCORPORATED
Reel/Frame 032230/0590 →
Continuity (2)
Provisional Application 61479880 · Jan 7, 2013
Related Publication 20140192897A1 · Jul 10, 2014