System and method for implementing low-complexity multi-view video coding
A system and method for implementing low complexity multi-view video coding. According to various embodiments, single-loop decoding is applied to multi-view video coding. For N coded views, where only M of the N views are to be displayed, only those M views are required to be fully decoded and stored to a decoded picture buffer (DPB) when needed. Pictures of other views are only partially decoded or simply parsed and do not have to be stored into the DPB. Various embodiments also provide for an encoder that encodes multi-view video bitstreams in accordance with the single-loop decoding concept, as well as a decoder that utilizes single-loop decoding to decode and output on a subset of the encoded views from a multi-view bitstream.
1. A method, comprising:
encoding a plurality of multiview video picture sequences into a bitstream of coded pictures, wherein the multiview video comprises a plurality of views of a scene;
encoding signal information including a signal element into the bitstream, said signal element indicating that display of a subset M of N coded views requires full decoding of the subset M views only, said subset M views comprising target views within the bitstream, wherein the signal information includes an additional signal element indicating inter-view prediction, wherein the interview prediction comprises a prediction associated with a first view of the multiview video picture sequence based on a second view of the multiview video picture sequence; and
encoding constrainedly intra-coded blocks for inter-view prediction in support of said target views.
2. The method of claim 1 , wherein each of the plurality of picture sequences represents a sequence of pictures taken from a particular view.
3. The method of claim 2 , wherein the signal element is encoded in a multiview video coding (MVC) sequence parameter set (SPS) extension.
4. The method of claim 1 , wherein for picture sequences depended upon by the subset of the plurality of picture sequences, only constrainedly intra-coded blocks are to be decoded for inter-view prediction.
5. The method of claim 4 , wherein non-constrainedly intra-coded blocks are to be parsed to the extent that is known that the non-constrainedly intra-coded blocks are not needed for inter-view prediction.
6. The method of claim 1 , wherein the signal element indicates a maximum decoding level for a particular picture sequence.
7. The method of claim 1 , wherein the signal element indicates a maximum number of reference frames and a required decoded picture buffer size when the subset of the plurality of picture sequences are decoded for playback.
8. The method of claim 1 , wherein the additional signal element indicates inter-view prediction of a block coding mode.
9. The method of claim 1 , wherein the additional signal element indicates inter-view prediction of motion information.
10. The method of claim 1 , wherein the additional signal element indicates inter-view prediction of residual information.
11. The method of claim 1 , wherein the additional signal element indicates inter-view prediction of motion compensation.
12. The method of claim 1 , wherein the signal information includes a dependency_id value, the dependency_id value corresponding to one of the plurality of picture sequences.
13. The method of claim 1 , wherein the signal information includes an indication of whether the bitstream comprises either a multiview bitstream or a scalable video coding bitstream.
14. A computer program product comprising a non-transitory computer readable storage medium having computer coded instructions stored therein, said instructions when executed by a processor causing an apparatus to perform:
encoding a plurality of multiview video picture sequences into a bitstream of coded pictures, wherein the multiview video comprises a plurality of views of a scene;
encoding signal information including a signal element into a bitstream, said signal element indicating that display of a subset M of N coded views requires full decoding of the subset M views only, said subset M views comprising target views within the bitstream, wherein the signal information includes an additional signal element indicating inter-view prediction, wherein the interview prediction comprises a prediction associated with a first view of the multiview video picture sequence based on a second view of the multiview video picture sequence; and
encoding constrainedly intra-coded blocks for inter-view prediction in support of said target views.
15. An encoding apparatus, comprising:
a processor; and
a memory communicatively connected to the processor, the memory storing computer coded instructions which, when executed by the processor, cause the apparatus to:
encode a plurality of picture sequences into coded pictures representing a multiview video coded bitstream, wherein the multiview video comprises a plurality of views of a scene;
encode a signal element into the bitstream, said signal element indicating that display of a subset M of N coded views requires full decoding of the subset M views only, said subset M views comprising target views within the bitstream, wherein the signal information includes an additional signal element indicating inter-view prediction, wherein the interview prediction comprises a prediction associated with a first view of the multiview video picture sequence based on a second view of the multiview video picture sequence; and
encode constrainedly intra-coded blocks for inter-view prediction in support of said target views.
16. The encoding apparatus of claim 15 , wherein each of the plurality of picture sequences represents a sequence of pictures taken from a particular view.
17. The encoding apparatus of claim 15 , wherein the signal element is encoded in a multiview video coding (MVC) sequence parameter set (SPS) extension.
18. The encoding apparatus of claim 15 , wherein for picture sequences depended upon by the subset of the plurality of picture sequences, only constrainedly intra-coded blocks are to be decoded for inter-view prediction.
19. The encoding apparatus of claim 18 , wherein non-constrainedly intra-coded blocks are to be parsed to the extent that is known that the non-constrainedly intra-coded blocks are not needed for inter-view prediction.
20. The encoding apparatus of claim 15 , wherein the signal element indicates a maximum decoding level for a particular picture sequence.
21. The encoding apparatus of claim 15 , wherein the signal element indicates a maximum number of reference frames and a required decoded picture buffer size when the subset of the plurality of picture sequences are decoded for playback.
22. The encoding apparatus of claim 15 , wherein the additional signal element indicates inter-view prediction of a block coding mode.
23. The encoding apparatus of claim 15 , wherein the additional signal element indicates inter-view prediction of motion information.
24. The encoding apparatus of claim 15 , wherein the additional signal element indicates inter-view prediction of residual information.
25. The encoding apparatus of claim 15 , wherein the additional signal element indicates inter-view prediction of motion compensation.
26. The encoding apparatus of claim 15 , wherein the signal information includes a dependency_id value, the dependency_id value corresponding to one of the plurality of picture sequences.
27. The encoding apparatus of claim 15 , wherein the signal information includes an indication of whether the bitstream comprises either a multiview bitstream or a scalable video coding bitstream.
28. A method of decoding a plurality of sequences, comprising:
decoding signal information including a signal element from the bitstream, the signal element indicating that, for the display of a subset of a plurality of picture sequences, only pictures from the subset of the plurality of picture sequences need to be fully decoded, wherein the plurality of picture sequences represents a multiview video coded bitstream, wherein the multiview video comprises a plurality of views of a scene, wherein the signal information includes an additional signal element indicating inter-view prediction, wherein the interview prediction comprises a prediction associated with a first view of the multiview video picture sequence based on a second view of the multiview video picture sequence; and
selectively decoding the plurality of picture sequences in accordance with the indication provided by the decoded signal element.
29. The method of claim 28 , wherein each of the plurality of picture sequences represents a sequence of pictures taken from a particular view.
30. The method of claim 28 , wherein the signal element is encoded in a multiview video coding (MVC) sequence parameter set (SPS) extension.
31. The method of claim 28 , wherein for picture sequences depended upon by the subset of the plurality of picture sequences, only constrainedly intra-coded blocks are decoded for inter-view prediction.
32. The method of claim 31 , wherein non-constrainedly intra-coded blocks are parsed to the extent that is known that the non-constrainedly intra-coded blocks are not needed for inter-view prediction.
33. The method of claim 28 , wherein the signal element indicates a maximum decoding level for a particular picture sequence.
34. The method of claim 28 , wherein the signal element indicates a maximum number of reference frames and a required decoded picture buffer size when the subset of the plurality of picture sequences are decoded for playback.
35. The method of claim 28 , wherein the additional signal element indicates inter-view prediction of a block coding mode.
36. The method of claim 28 , wherein the additional signal element indicates inter-view prediction of motion information.
37. The method of claim 28 , wherein the additional signal element indicates inter-view prediction of residual information.
38. The method of claim 28 , wherein the additional signal element indicates inter-view prediction of motion compensation.
39. The method of claim 28 , wherein the signal information includes a dependency_id value, the dependency_id value corresponding to one of the plurality of picture sequences.
40. The method of claim 28 , wherein the signal information includes an indication of whether the bitstream comprises either a multiview bitstream or a scalable video coding bitstream.
41. The method of claim 28 , further comprising:
storing fully decoded pictures in a decoded picture buffer; and
discarding pictures that are neither from the subset of the plurality of picture sequences nor depended upon by any of the subset of the plurality of picture sequences are discarded.
42. A computer program product, embodied in a non-transitory computer-readable medium, for decoding a plurality of sequences, comprising:
computer code for decoding signal information including a signal element from the bitstream, the signal element indicating that, for the display of a subset of a plurality of picture sequences, only pictures from the subset of the plurality of picture sequences need to be fully decoded, wherein the plurality of picture sequences represents a multiview video coded bitstream, wherein the multiview video comprises a plurality of views of a scene, wherein the signal information includes an additional signal element indicating inter-view prediction, wherein the interview prediction comprises a prediction associated with a first view of the multiview video picture sequence based on a second view of the multiview video picture sequence; and
computer code for selectively decoding the plurality of picture sequences in accordance with the indication provided by the decoded signal element.
43. A decoding apparatus, comprising:
a processor; and
a memory unit communicatively connected to the processor and including:
computer code for decoding signal information including a signal element from the bitstream, the signal element indicating that, for the display of a subset of a plurality of picture sequences, only pictures from the subset of the plurality of picture sequences need to be fully decoded, wherein the plurality of picture sequences represents a multiview video coded bitstream, wherein the multiview video comprises a plurality of views of a scene, wherein the signal information includes an additional signal element indicating inter-view prediction, wherein the interview prediction comprises a prediction associated with a first view of the multiview video picture sequence based on a second view of the multiview video picture sequence; and
computer code for selectively decoding the plurality of picture sequences in accordance with the indication provided by the decoded signal element.
44. The decoding apparatus of claim 43 , wherein each of the plurality of picture sequences represents a sequence of pictures taken from a particular view.
45. The decoding apparatus of claim 43 , wherein the signal element is encoded in a multiview video coding (MVC) sequence parameter set (SPS) extension.
46. The decoding apparatus of claim 43 , wherein for picture sequences depended upon by the subset of the plurality of picture sequences, only constrainedly intra-coded blocks are to be decoded for inter-view prediction.
47. The encoding apparatus of claim 46 , wherein non-constrainedly intra-coded blocks are to be parsed to the extent that is known that the non-constrainedly intra-coded blocks are not needed for inter-view prediction.
48. The decoding apparatus of claim 43 , wherein the signal element indicates a maximum decoding level for a particular picture sequence.
49. The decoding apparatus of claim 43 , wherein the signal element indicates a maximum number of reference frames and a required decoded picture buffer size when the subset of the plurality of picture sequences are decoded for playback.
50. The decoding apparatus of claim 43 , wherein the additional signal element indicates inter-view prediction of a block coding mode.
51. The decoding apparatus of claim 43 , wherein the additional signal element indicates inter-view prediction of motion information.
52. The decoding apparatus of claim 43 , wherein the additional signal element indicates inter-view prediction of residual information.
53. The decoding apparatus of claim 43 , wherein the additional signal element indicates inter-view prediction of motion compensation.
54. The decoding apparatus of claim 43 , wherein the signal information includes a dependency_id value, the dependency_id value corresponding to one of the plurality of picture sequences.
55. The decoding apparatus of claim 43 , wherein the signal information includes an indication of whether the bitstream comprises either a multiview bitstream or a scalable video coding bitstream.
56. The decoding apparatus of claim 43 , wherein the memory unit further comprises:
computer code for storing fully decoded pictures in a decoded picture buffer; and
computer code for discarding pictures that are neither from the subset of the plurality of picture sequences nor depended upon by any of the subset of the plurality of picture sequences are discarded.