IP Library Granted Patent US 9,866,852
Granted Patent B2
US 9,866,852 · App. 14/743,327 · Granted Jan 9, 2018

Video coding using end of sequence network abstraction layer units

Inventors: Adarsh Krishnan Ramasubramonian (San Diego, CA); Fnu Hendry (Poway, CA); Ye-Kui Wang (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04N19/188H04N19/105H04N19/159H04N19/187H04N19/30H04N19/70H04N19/172
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,866,852
App. No.
14/743,327
Granted
Jan 9, 2018
Kind
B2
Abstract

Techniques and systems are provided for decoding and processing video data. For example, a method of decoding video data includes accessing an encoded video bitstream comprising multiple layers. The encoded video bitstream includes multiple access units, with a first access unit including an end of sequence network abstraction layer unit. A second access unit includes an intra random access point picture and is a next subsequent access unit in decoding order following the first access unit. The method further includes reinitializing decoding at the second access unit based on the second access unit being the next subsequent access unit in decoding order following the end of sequence network abstraction layer unit of the first access unit.

Claims (54)

1. A method of decoding video data, the method comprising:

accessing an encoded video bitstream comprising multiple layers, the encoded video bitstream including multiple access units, wherein a first access unit includes an end of sequence network abstraction layer unit, and wherein a second access unit includes an intra random access point picture and is a next subsequent access unit in decoding order following the first access unit;

deriving a reinitialization flag to be a value indicating that decoding is to be reinitialized at the second access unit, wherein the reinitialization flag is derived to be the value based on the second access unit being the next subsequent access unit in decoding order following the end of sequence network abstraction layer unit of the first access unit; and

reinitializing decoding at the second access unit based on the derived value of the reinitialization flag.

2. The method of claim 1 , further comprising reinitializing decoding of each of the multiple layers at the second access unit based on the second access unit being the next subsequent access unit in decoding order following the end of sequence network abstraction layer unit of the first access unit.

3. The method of claim 1 , wherein the first access unit includes the end of sequence network abstraction layer unit in a base layer of the encoded video bitstream and the second access unit includes the intra random access point picture in the base layer, and wherein decoding is reinitialized at the second access unit based on the second access unit including the intra random access point picture in the base layer and being the next subsequent access unit in decoding order following the end of sequence network abstraction layer unit of the first access unit.

4. The method of claim 1 , wherein the intra random access point picture of the second access unit includes an instantaneous decoding refresh picture.

5. The method of claim 1 , wherein the intra random access point picture of the second access unit includes a clean random access picture.

6. The method of claim 1 , wherein a flag of the second access unit is set to a value when the second access unit is the next subsequent access unit in decoding order following the end of sequence network abstraction layer unit of the first access unit, the value indicating that the decoding is to be reinitialized at the second access unit.

7. The method of claim 6 , wherein the flag includes a NoClrasOutputFlag and the value is a value of 1.

8. The method of claim 1 , wherein reinitializing the decoding at the second access unit includes discarding one or more random access skipped leading pictures or one or more cross-layer random access skipped leading pictures associated with the second access unit.

9. An apparatus comprising:

a memory configured to store video data; and

a processor configured to:

access an encoded video bitstream comprising multiple layers from the memory, the encoded video bitstream including multiple access units, wherein a first access unit includes an end of sequence network abstraction layer unit, and wherein a second access unit includes an intra random access point picture and is a next subsequent access unit in decoding order following the first access unit;

derive a reinitialization flag to be a value indicating that decoding is to be reinitialized at the second access unit, wherein the reinitialization flag is derived to be the value based on the second access unit being the next subsequent access unit in decoding order following the end of sequence network abstraction layer unit of the first access unit; and

reinitialize decoding at the second access unit based on the value of the reinitialization flag.

10. The apparatus of claim 9 , wherein the processor is configured to reinitialize decoding of each of the multiple layers at the second access unit based on the second access unit being the next subsequent access unit in decoding order following the end of sequence network abstraction layer unit of the first access unit.

11. The apparatus of claim 9 , wherein the first access unit includes the end of sequence network abstraction layer unit in a base layer of the encoded video bitstream and the second access unit includes the intra random access point picture in the base layer, and wherein decoding is reinitialized at the second access unit based on the second access unit including the intra random access point picture in the base layer and being the next subsequent access unit in decoding order following the end of sequence network abstraction layer unit of the first access unit.

12. The apparatus of claim 9 , wherein the intra random access point picture of the second access unit includes at least one or more of an instantaneous decoding refresh picture or a clean random access picture.

13. The apparatus of claim 9 , wherein a flag of the second access unit is set to a value when the second access unit is the next subsequent access unit in decoding order following the end of sequence network abstraction layer unit of the first access unit, the value indicating that the decoding is to be reinitialized at the second access unit.

14. The apparatus of claim 9 , wherein reinitializing the decoding at the second access unit includes discarding one or more random access skipped leading pictures or one or more cross-layer random access skipped leading pictures associated with the second access unit.

15. A method of processing video data, the method comprising:

obtaining a first encoded video bitstream comprising multiple layers, the first encoded video bitstream including multiple access units;

obtaining a second encoded video bitstream comprising multiple layers, the second encoded video bitstream including multiple access units;

generating a third encoded video bitstream by combining access units in the first encoded video bitstream with access units in the second encoded video bitstream, and by inserting an end of sequence network abstraction layer unit into a first access unit of the first encoded video bitstream, wherein a second access unit of the second encoded video bitstream includes an intra random access point picture and is a next subsequent access unit in decoding order following the first access unit with the end of sequence network abstraction layer unit; and

transmitting the third encoded video bitstream, wherein the second access unit being the next subsequent access unit in decoding order following the end of sequence network abstraction layer unit of the first access unit causes decoding of the third encoded video bitstream to be reinitialized at the second access unit.

16. The method of claim 15 , further comprising:

determining that the third encoded video bitstream is to be decoded, the third encoded bitstream including the access units in the first encoded video bitstream up to and inclusive of the first access unit, followed by the access units in the second encoded video bitstream starting from and inclusive of the second access unit;

determining that decoding of the second encoded video bitstream is to be reinitialized at the second access unit including the intra random access point picture; and

generating the third encoded video bitstream by combining the access units in the first encoded video bitstream up to and inclusive of the first access unit with the access units in the second encoded video bitstream starting from and inclusive of the second access unit, and by inserting the end of sequence network abstraction layer unit into the first access unit.

17. The method of claim 15 , wherein the first encoded video bitstream and the second encoded video bitstream are a same encoded video bitstream, and wherein the second access unit is a subsequent access unit in decoding order following the first access unit in the same encoded video bitstream.

18. The method of claim 15 , wherein decoding of each layer of multiple layers of the third encoded video bitstream is reinitialized at the second access unit based on the second access unit being the next subsequent access unit in decoding order following the end of sequence network abstraction layer unit of the first access unit.

19. The method of claim 15 , wherein the end of sequence network abstraction layer unit is inserted into the first access unit in a base layer of the third encoded video bitstream and the second access unit includes the intra random access point picture in the base layer, and wherein the second access unit including the intra random access point picture in the base layer and being the next subsequent access unit in decoding order following the end of sequence network abstraction layer unit of the first access unit causes decoding of the third encoded video bitstream to be reinitialized at the second access unit.

20. The method of claim 15 , wherein the intra random access point picture of the second access unit includes an instantaneous decoding refresh picture.

21. The method of claim 15 , wherein the intra random access point picture of the second access unit includes a clean random access picture.

22. The method of claim 15 , wherein a flag of the second access unit is set to a value when the second access unit is the next subsequent access unit in decoding order following the end of sequence network abstraction layer unit of the first access unit, the value indicating that the decoding is to be reinitialized at the second access unit.

23. The method of claim 22 , wherein the flag includes a NoClrasOutputFlag and the value is a value of 1.

24. The method of claim 15 , wherein reinitializing the decoding at the second access unit includes discarding one or more random access skipped leading pictures or one or more cross-layer random access skipped leading pictures associated with the second access unit.

25. An apparatus comprising:

a memory configured to store video data;

a processor configured to:

obtain a first encoded video bitstream comprising multiple layers from the memory, the first encoded video bitstream including multiple access units;

obtain a second encoded video bitstream comprising multiple layers from the memory, the second encoded video bitstream including multiple access units; and

generate a third encoded video bitstream by combining access units in the first encoded video bitstream with access units in the second encoded video bitstream, and by inserting an end of sequence network abstraction layer unit into a first access unit of the first encoded video bitstream, wherein a second access unit of the second encoded video bitstream includes an intra random access point picture and is a next subsequent access unit in decoding order following the first access unit with the end of sequence network abstraction layer unit; and

a transmitter configured to transmit the third encoded video bitstream, wherein the second access unit being the next subsequent access unit in decoding order following the end of sequence network abstraction layer unit of the first access unit causes decoding of the third encoded video bitstream to be reinitialized at the second access unit.

26. The apparatus of claim 25 , wherein the processor is configured to:

determine that the third encoded video bitstream is to be decoded, the third encoded bitstream including the access units in the first encoded video bitstream up to and inclusive of the first access unit, followed by the access units in the second encoded video bitstream starting from and inclusive of the second access unit;

determine that decoding of the second encoded video bitstream is to be reinitialized at the second access unit including the intra random access point picture; and

generate the third encoded video bitstream by combining the access units in the first encoded video bitstream up to and inclusive of the first access unit with the access units in the second encoded video bitstream starting from and inclusive of the second access unit, and by inserting the end of sequence network abstraction layer unit into the first access unit.

27. The apparatus of claim 25 , wherein the first encoded video bitstream and the second encoded video bitstream are a same encoded video bitstream, and wherein the second access unit is a subsequent access unit in decoding order following the first access unit in the same encoded video bitstream.

28. The apparatus of claim 25 , wherein decoding of each layer of multiple layers of the third encoded video bitstream is reinitialized at the second access unit based on the second access unit being the next subsequent access unit in decoding order following the end of sequence network abstraction layer unit of the first access unit.

29. The apparatus of claim 25 , wherein the end of sequence network abstraction layer unit is inserted into the first access unit in a base layer of the third encoded video bitstream and the second access unit includes the intra random access point picture in the base layer, and wherein the second access unit including the intra random access point picture in the base layer and being the next subsequent access unit in decoding order following the end of sequence network abstraction layer unit of the first access unit causes decoding of the third encoded video bitstream to be reinitialized at the second access unit.

30. The apparatus of claim 25 , wherein the intra random access point picture of the second access unit includes at least one or more of an instantaneous decoding refresh picture or a clean random access picture.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2015
From: RAMASUBRAMONIAN, ADARSH KRISHNAN; HENDRY, FNU; WANG, YE-KUI
To: QUALCOMM INCORPORATED
Reel/Frame 035944/0616 →
Continuity (2)
Provisional Application 62015197 · Jun 20, 2014
Related Publication 20150373345A1 · Dec 24, 2015