H.264/AVC based approach to scalable video compression
View Patent ↗A scalable video compression method and apparatus for encoding an input frame sequence having temporally sequential frames includes partitioning each of the frames of the input frame sequence into a top field and a bottom field to form a base layer sequence of fields and an enhancement layer sequence of fields. The base layer sequence and the enhancement layer sequence each comprise temporally alternating top and bottom fields of the partitioned frames of the input frame sequence. The base layer sequence and the enhancement layer sequence are encoded, wherein at least one field of the enhancement layer sequence is encoded in dependence upon at least one of the fields of the base layer sequence.
1. A method for decoding comprising:
decoding a base layer bitstream into a decoded base layer sequence of fields;
decoding an enhancement layer bitstream into a decoded enhancement layer sequence of fields, at least one field of the decoded enhancement layer sequence of fields decoded in dependence upon at least one of the fields of the decoded base layer sequence, wherein each given field of the decoded base layer sequence comprises one of the top and bottom fields of a corresponding frame of a frame sequence, and a temporally corresponding field of the decoded enhancement layer sequence comprises the other of the top and bottom fields of the corresponding frame of the frame sequence;
combining the decoded base layer sequence and the decoded enhancement layer sequence to form a decoded frame sequence, wherein each given frame of the decoded frame sequence comprises a field of the decoded base layer sequence which corresponds temporally to the given frame and a field of the decoded enhancement layer sequence which corresponds temporally to the given frame; and
outputting the decoded frame sequence.
2. The method of claim 1 , wherein each field of the decoded enhancement layer sequence is decoded in dependence upon at least one of the fields of the decoded base layer sequence.
3. The method of claim 1 , wherein the step of decoding a base layer bitstream is independent of the enhancement layer bitstream.
4. The method of claim 1 , wherein the base layer bitstream and the enhancement layer bitstream are each encoded in a H.264/AVC format.
5. The method of claim 1 , wherein the decoded base layer sequence and the decoded enhancement layer sequence each comprise a 1080I @60 Hz sequence, and the decoded frame sequence comprises a 1080P @60 Hz sequence.
6. The method of claim 1 , wherein the enhancement layer bitstream comprises at least one encoded P-picture, and the step of decoding an enhancement layer bitstream comprises the step of decoding the at least one encoded P-picture to form a corresponding field of the decoded enhancement layer sequence using the temporally corresponding field of the decoded base layer sequence as a reference.
7. The method of claim 1 , wherein the enhancement layer bitstream comprises a plurality of encoded P-pictures, and the step of decoding an enhancement layer bitstream comprises the step of decoding each of the plurality of encoded P-pictures to form a corresponding field of the decoded enhancement layer sequence using the temporally corresponding field of the decoded base layer sequence as a reference.
8. The method of claim 1 , wherein the enhancement layer bitstream comprises at least one encoded P-picture, and the step of decoding an enhancement layer bitstream comprises the step of decoding the at least one encoded P-picture to form a corresponding field of the decoded enhancement layer sequence using a non-temporally corresponding field of the decoded base layer sequence as a reference.
9. The method of claim 1 , wherein the enhancement layer bitstream comprises at least one encoded B-picture, and the step of decoding an enhancement layer bitstream comprises the step of decoding the at least one encoded B-picture to form a corresponding field of the decoded enhancement layer sequence using the temporally corresponding field of the decoded base layer sequence as a reference.
10. The method of claim 1 , wherein the enhancement layer bitstream comprises a plurality of encoded B-pictures, and the decoding an enhancement layer bitstream comprises the step of decoding each of the plurality of encoded B-pictures to form a corresponding field of the decoded enhancement layer sequence using the temporally corresponding field of the decoded base layer sequence as a reference.
11. An apparatus for decoding comprising:
a base layer decoder responsive to an encoded base layer bitstream to generate a decoded base layer sequence;
an enhancement layer decoder responsive to an encoded enhancement layer bitstream to generate a decoded enhancement layer sequence, wherein at least one field of the decoded enhancement layer sequence is decoded in dependence upon at least one of the fields of the decoded base layer sequence, each given field of the decoded base layer sequence comprising one of the top and bottom fields of a corresponding frame of a frame sequence, and a temporally corresponding field of the enhancement layer sequence comprising the other of the top and bottom fields of the corresponding frame of the frame sequence; and
a combiner to combine the decoded base layer sequence and the decoded enhancement layer sequence to form a decoded frame sequence, wherein each given frame of the decoded frame sequence comprises a field of the decoded base layer sequence which corresponds temporally to the given frame and a field of the decoded enhancement layer sequence which corresponds temporally to the given frame.
12. The apparatus of claim 11 , wherein each field of the decoded enhancement layer sequence is decoded in dependence upon at least one of the fields of the decoded base layer sequence.
13. The apparatus of claim 11 , wherein the base layer bitstream is decoded independently of the enhancement layer bitstream.
14. The apparatus of claim 11 , wherein base layer bitstream and the enhancement layer bitstream are each encoded in a H.264/AVC format.
15. The apparatus of claim 11 , wherein the decoded base layer sequence and the decoded enhancement layer sequence each comprise a 1080I @60 Hz sequence, and the decoded frame sequence comprises a 1080P @60 Hz sequence.
16. The apparatus of claim 11 , wherein the encoded enhancement layer bitstream comprises at least one P-picture, and the enhancement layer decoder decodes the at least one P-picture to form a corresponding field of the decoded enhancement layer sequence using the temporally corresponding field of the decoded base layer sequence as a reference.
17. The apparatus of claim 11 , wherein the encoded enhancement layer bitstream comprises a plurality of P-pictures, and the enhancement layer decoder decodes each of the plurality of P-pictures to form a corresponding field of the decoded enhancement layer sequence using the temporally corresponding field of the decoded base layer sequence as a reference.
18. The apparatus of claim 11 , wherein the encoded enhancement layer bitstream comprises at least one P-picture, and the enhancement layer decoder decodes the at least one P-picture to form a corresponding field of the decoded enhancement layer sequence using a non-temporally corresponding field of the decoded base layer sequence as a reference.
19. The apparatus of claim 11 , wherein the encoded enhancement layer bitstream comprises at least one B-picture, and the enhancement layer decoder decodes the at least one B-picture to form a corresponding field of the decoded enhancement layer sequence using the temporally corresponding field of the decoded base layer sequence as a reference.
20. The apparatus of claim 11 , wherein the encoded enhancement layer bitstream comprises a plurality of B-pictures, and the enhancement layer decoder decodes each of the plurality of B-pictures to form a corresponding field of the decoded enhancement layer sequence using the temporally corresponding field of the decoded base layer sequence as a reference.