Single-loop motion-compensation fine granular scalability
View Patent ↗A video coding technique having motion compensation for bi-directional predicted frames (B-frames) and predicted frames (P-frames). The video coding technique involves a single-loop prediction-based base layer which includes base layer B- and/or P-frames that are generated from “extended” or “enhanced” base layer reference frames during base layer coding.
1. A method of coding video, comprising the steps of:
encoding an uncoded video to generate extended base layer reference frames, each of the extended base layer reference frames including a base layer reference frame and at least a portion of an associated enhancement layer reference frame;
predicting base layer frames from the extended base layer reference frames; and
generating frame residuals from the uncoded video and the base layer frames.
2. A method of coding video according to claim 1 , further comprising the step of coding the frame residuals with a scalable codec to generate enhancement layer frames.
3. A method of coding video according to claim 1 , further comprising the step of coding the frame residuals with a fine granular scalable codec to generate fine granular scalable enhancement layer frames.
4. A method of coding video according to claim 1 , wherein the base layer frames include base layer B-frames.
5. A method of coding video according to claim 4 , wherein the base layer frames further include P-frames.
6. A method of coding video according to claim 1 , wherein the base layer frames include P-frames. frames.
7. A method of decoding a compressed video having a base layer stream and an enhancement layer stream, the method comprising the steps of:
decoding the base layer and enhancement layer streams to generate extended base layer reference frames, each of the extended base layer reference frames including a base layer reference frame and at least a portion of an associated enhancement layer reference frame; and
predicting base layer frames from the extended base layer reference frames.
8. A method of decoding video according to claim 7 , wherein the decoding step further generates enhancement layer frames; and further comprising the step of generating an enhanced video from the base layer frames and the enhancement layer frames.
9. A method of decoding video according to claim 7 , wherein the base layer frames include B-frames.
10. A method of decoding video according to claim 9 , wherein the base layer frames further include P-frames.
11. A method of decoding video according to claim 7 , wherein the base layer frames include P-frames.
12. A method of decoding video according to claim 7 , further comprising the step of generating a video from the base layer frames.
13. A memory medium for encoding video, the memory medium comprising:
code for encoding an uncoded video to generate extended base layer reference frames, each of the extended base layer reference frames including a base layer reference frame and at least a portion of an associated enhancement layer reference frame;
code for predicting base layer frames from the extended base layer reference frames; and
code for generating frame residuals from the uncoded video and the base layer frames.
14. A memory medium for encoding video according to claim 13 , further comprising code for scalable encoding the frame residuals.
15. A memory medium for encoding video according to claim 13 , further comprising code for fine granular scalable encoding the frame residuals.
16. A memory medium for encoding video according to claim 13 , wherein the base layer frames include B-frames.
17. A memory medium for encoding video according to claim 16 , wherein the base layer frames further include P-frames.
18. A memory medium for encoding video according to claim 13 , wherein the base layer frames include P-frames.
19. A memory medium for decoding a compressed video having a base layer stream and an enhancement layer stream, the memory medium comprising:
code for decoding extended base layer reference frames from the base layer and enhancement layer streams, each of the extended base layer reference frames including a base layer reference frame and at least a portion of an associated enhancement layer reference frame; and
code for predicting base layer frames from the extended base layer reference frames.
20. A memory medium for decoding a compressed video according to claim 19 , wherein the code for decoding extended base layer reference frames further generates enhancement layer frames; and further comprising code for generating an enhanced video from the base layer frames and the enhancement layer frames.
21. A memory medium for decoding a compressed video according to claim 19 , wherein the base layer frames include B-frames.
22. A memory medium for decoding a compressed video according to claim 21 , wherein the base layer frames further include P-frames.
23. A memory medium for decoding a compressed video according to claim 19 , wherein the base layer frames include P-frames.
24. A memory medium for decoding a compressed video according to claim 19 , further comprising code for generating a video from the base layer frames.
25. An apparatus for coding video, the apparatus comprising:
means for encoding an uncoded video to generate extended base layer reference frames, each of the extended base layer reference frames including a base layer reference frame and at least a portion of an associated enhancement layer reference frame;
means for predicting base layer frames from the extended base layer reference frames; and
means for generating frame residuals from the uncoded video and the base layer frames.
26. An apparatus for coding video according to claim 25 , further comprising means for scalable encoding the frame residuals.
27. An apparatus for coding video according to claim 25 , further comprising code for fine granular scalable encoding the frame residuals.
28. An apparatus for coding video according to claim 25 , wherein the base layer frames include B-frames.
29. An apparatus for coding video according to claim 28 , wherein the base layer frames further include P-frames.
30. An apparatus for coding video according to claim 25 , wherein the base layer frames include P-frames.
31. An apparatus for decoding a compressed video having a base layer stream and an enhancement layer stream, the apparatus comprising:
means for decoding extended base layer reference frames from the base layer and enhancement layer streams, each of the extended base layer reference frames including a base layer reference frame and at least a portion of an associated enhancement layer reference frame; and
means for predicting base layer frames from the extended base layer reference frames.
32. An apparatus for decoding a compressed video according to claim 31 , wherein the means for decoding extended base layer reference frames further generates enhancement layer frames; and further comprising means for generating an enhanced video from the base layer frames and the enhancement layer frames.
33. An apparatus for decoding a compressed video according to claim 31 , wherein the base layer frames include B-frames.
34. An apparatus for decoding a compressed video according to claim 33 , wherein the base layer frames further include P-frames.
35. An apparatus for decoding a compressed video according to claim 31 , wherein the base layer frames include P-frames.