IP Library Granted Patent US 8,780,999
Granted Patent B2
US 8,780,999 · App. 12/709,323 · Granted Jul 15, 2014

Assembling multiview video coding sub-BITSTREAMS in MPEG-2 systems

Inventors: Ying Chen (San Diego, CA); Marta Karczewicz (San Diego, CA); Peisong Chen (San Diego, CA)
Assignee: QUALCOMM Incorporated
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,780,999
App. No.
12/709,323
Granted
Jul 15, 2014
Kind
B2
Abstract

A demultiplexer may assemble view components of sub-bitstreams. In one example, an apparatus comprises a demultiplexer that produces a multiview video coding (MVC) standard compliant bitstream from a received bitstream comprising a primary sub-bitstream and an embedded sub-bitstream. To produce the MVC standard compliant bitstream, the demultiplexer determines whether a view component of the primary sub-bitstream has a view order index that is greater than a view order index of a view component of the embedded sub-bitstream, and to add the view component from the sub-bitstream for which the view order index is lower to the produced bitstream. The received bitstream may comprise delimiter network abstraction layer (NAL) units between each view component to differentiate the view components. The apparatus may further comprise a video decoder to decode the bitstream produced by the demultiplexer.

Claims (80)

1. A method comprising:

producing, with a client device, a multiview video coding (MVC) standard compliant bitstream from a received bitstream comprising a primary sub-bitstream and an embedded sub-bitstream of the primary sub-bitstream, wherein producing the MVC standard compliant bitstream comprises:

determining whether a view component of the primary sub-bitstream has a view order index that is greater than a view order index of a view component of the embedded sub-bitstream;

when the view order index of the view component of the primary sub-bitstream is greater than the view order index of the view component of the embedded sub-bitstream, adding the view component of the embedded sub-bitstream to the produced bitstream; and

when the view order index of the view component of the primary sub-bitstream is not greater than the view order index of the view component of the embedded sub-bitstream, adding the view component of the primary sub-bitstream to the produced bitstream; and

outputting the produced bitstream to a video decoder.

2. The method of claim 1 , further comprising:

determining that the primary sub-bitstream has no remaining view components; and

adding all remaining view components of the embedded sub-bitstream to the produced bitstream.

3. The method of claim 1 , further comprising:

determining that the embedded sub-bitstream has no remaining view components; and

adding all remaining view components of the primary sub-bitstream to the produced bitstream.

4. The method of claim 1 , wherein adding the view component of the embedded sub-bitstream to the produced bitstream comprises:

retrieving network abstraction layer (NAL) units from the embedded sub-bitstream until a delimiter NAL unit is reached in the embedded sub-bitstream; and

adding each of the retrieved NAL units, excluding the delimiter NAL unit, to the produced bitstream.

5. The method of claim 1 , wherein adding the view component of the primary sub-bitstream to the produced bitstream comprises:

retrieving network abstraction layer (NAL) units from the primary sub-bitstream until a delimiter NAL unit is reached in the primary sub-bitstream; and

adding each of the retrieved NAL units, excluding the delimiter NAL unit, to the produced bitstream.

6. The method of claim 1 , further comprising:

producing a hierarchy layer index list comprising an ordered representation of the view components of the received bitstream according to the view order indexes of the view components; and

wherein outputting the produced bitstream to the video decoder comprises outputting the hierarchy layer index to the video decoder.

7. The method of claim 1 , wherein producing the MVC standard compliant bitstream comprises producing the MVC standard compliant bitstream without comparing view identifiers of views included in the primary sub-bitstream and view identifiers of views included in the embedded sub-bitstream.

8. An apparatus comprising:

an input interface that receives a bitstream comprising a primary sub-bitstream and an embedded sub-bitstream of the primary sub-bitstream;

a demultiplexer that produces a multiview video coding (MVC) standard compliant bitstream from the received bitstream, wherein to produce the MVC standard compliant bitstream, the demultiplexer determines whether a view component of the primary sub-bitstream has a view order index that is greater than a view order index of a view component of the embedded sub-bitstream, add the view component of the embedded sub-bitstream to the produced bitstream when the view order index of the view component of the primary sub-bitstream is greater than the view order index of the view component of the embedded sub-bitstream, and add the view component of the primary sub-bitstream to the produced bitstream when the view order index of the view component of the primary sub-bitstream is not greater than the view order index of the view component of the embedded sub-bitstream; and

a video decoder that decodes the bitstream produced by the demultiplexer.

9. The apparatus of claim 8 , wherein the demultiplexer adds all remaining view components of the embedded sub-bitstream to the produced bitstream upon determining that the primary sub-bitstream has no remaining view components.

10. The apparatus of claim 8 , wherein the demultiplexer adds all remaining view components of the primary sub-bitstream to the produced bitstream upon determining that the embedded sub-bitstream has no remaining view components.

11. The apparatus of claim 8 , wherein to add the view component of the embedded sub-bitstream to the produced bitstream, the demultiplexer retrieves network abstraction layer (NAL) units from the embedded sub-bitstream until a delimiter NAL unit is reached in the embedded sub-bitstream, and then to add each of the retrieved NAL units, excluding the delimiter NAL unit, to the produced bitstream.

12. The apparatus of claim 8 , wherein to add the view component of the primary sub-bitstream to the produced bitstream, the demultiplexer retrieves network abstraction layer (NAL) units from the primary sub-bitstream until a delimiter NAL unit is reached in the primary sub-bitstream, and to add each of the retrieved NAL units, excluding the delimiter NAL unit, to the produced bitstream.

13. The apparatus of claim 8 , wherein the demultiplexer further produces a hierarchy layer index list comprising an ordered representation of the view components of the received bitstream according to the view order indexes of the view components, and outputs the hierarchy layer index to the video decoder as part of the produced bitstream.

14. The apparatus of claim 8 , wherein to the demultiplexer produces the MVC standard compliant bitstream without comparing view identifiers of views included in the primary sub-bitstream and view identifiers of views included in the embedded sub-bitstream.

15. The apparatus of claim 8 , wherein the apparatus comprises at least one of:

an integrated circuit;

a microprocessor, and

a wireless communication device that includes the video encoder.

16. An apparatus comprising:

means for producing a multiview video coding (MVC) standard compliant bitstream from a received bitstream comprising a primary sub-bitstream and an embedded sub-bitstream of the primary sub-bitstream, comprising:

means for determining whether a view component of the primary sub-bitstream has a view order index that is greater than a view order index of a view component of the embedded sub-bitstream,

means for adding the view component of the embedded sub-bitstream to the produced bitstream when the view order index of the view component of the primary sub-bitstream is greater than the view order index of the view component of the embedded sub-bitstream, and

means for adding the view component of the primary sub-bitstream to the produced bitstream when the view order index of the view component of the primary sub-bitstream is not greater than the view order index of the view component of the embedded sub-bitstream; and

means for outputting the produced bitstream to a video decoder.

17. The apparatus of claim 16 , further comprising:

means for determining that the primary sub-bitstream has no remaining view components; and

means for adding all remaining view components of the embedded sub-bitstream to the produced bitstream.

18. The apparatus of claim 16 , further comprising:

means for determining that the embedded sub-bitstream has no remaining view components; and

means for adding all remaining view components of the primary sub-bitstream to the produced bitstream.

19. The apparatus of claim 16 , wherein the means for adding the view component of the embedded sub-bitstream to the produced bitstream comprises:

means for retrieving network abstraction layer (NAL) units from the embedded sub-bitstream until a delimiter NAL unit is reached in the embedded sub-bitstream; and

means for adding each of the retrieved NAL units, excluding the delimiter NAL unit, to the produced bitstream.

20. The apparatus of claim 16 , wherein the means for adding the view component of the primary sub-bitstream to the produced bitstream comprises:

means for retrieving network abstraction layer (NAL) units from the primary sub-bitstream until a delimiter NAL unit is reached in the primary sub-bitstream; and

means for adding each of the retrieved NAL units, excluding the delimiter NAL unit, to the produced bitstream.

21. The apparatus of claim 16 , further comprising:

means for producing a hierarchy layer index list comprising an ordered representation of the view components of the received bitstream according to the view order indexes of the view components; and

wherein the means for outputting the produced bitstream to the video decoder comprises means for outputting the hierarchy layer index to the video decoder.

22. The apparatus of claim 16 , wherein the means for producing the MVC standard compliant bitstream comprises means for producing the MVC standard compliant bitstream without comparing view identifiers of views included in the primary sub-bitstream and view identifiers of views included in the embedded sub-bitstream.

23. A non-transitory computer-readable storage medium encoded with instructions for causing a processor of a client device to:

produce a multiview video coding (MVC) standard compliant bitstream from a received bitstream comprising a primary sub-bitstream and an embedded sub-bitstream of the primary sub-bitstream, wherein the instructions to produce the MVC standard compliant bitstream comprise instructions to:

determine whether a view component of the primary sub-bitstream has a view order index that is greater than a view order index of a view component of the embedded sub-bitstream;

when the view order index of the view component of the primary sub-bitstream is greater than the view order index of the view component of the embedded sub-bitstream, add the view component of the embedded sub-bitstream to the produced bitstream; and

when the view order index of the view component of the primary sub-bitstream is not greater than the view order index of the view component of the embedded sub-bitstream, add the view component of the primary sub-bitstream to the produced bitstream; and

output the produced bitstream from the client device to a video decoder.

24. The non-transitory computer-readable storage medium of claim 23 , further comprising instructions to:

determine that the primary sub-bitstream has no remaining view components; and

add all remaining view components of the embedded sub-bitstream to the produced bitstream.

25. The non-transitory computer-readable storage medium of claim 23 , further comprising instructions to:

determine that the embedded sub-bitstream has no remaining view components; and

add all remaining view components of the primary sub-bitstream to the produced bitstream.

26. The non-transitory computer-readable storage medium of claim 23 , wherein the instructions to add the view component of the embedded sub-bitstream to the produced bitstream comprise instructions to:

retrieve network abstraction layer (NAL) units from the embedded sub-bitstream until a delimiter NAL unit is reached in the embedded sub-bitstream; and

add each of the retrieved NAL units, excluding the delimiter NAL unit, to the produced bitstream.

27. The non-transitory computer-readable storage medium of claim 23 , wherein the instructions to add the view component of the primary sub-bitstream to the produced bitstream comprise instructions to:

retrieve network abstraction layer (NAL) units from the primary sub-bitstream until a delimiter NAL unit is reached in the primary sub-bitstream; and

add each of the retrieved NAL units, excluding the delimiter NAL unit, to the produced bitstream.

28. The non-transitory computer-readable storage medium of claim 23 , further comprising instructions to:

produce a hierarchy layer index list comprising an ordered representation of the view components of the received bitstream according to the view order indexes of the view components,

wherein the instructions to output the produced bitstream to the video decoder comprise instructions to output the hierarchy layer index to the video decoder.

29. The non-transitory computer-readable storage medium of claim 23 , wherein the instructions to produce the MVC standard compliant bitstream comprise instructions to produce the MVC standard compliant bitstream without comparing view identifiers of views included in the primary sub-bitstream and view identifiers of views included in the embedded sub-bitstream.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2010
From: CHEN, YING; KARCZEWICZ, MARTA; CHEN, PEISONG
To: QUALCOMM INCORPORATED
Reel/Frame 023965/0714 →
Continuity (3)
Provisional Application 61221449 · Jun 29, 2009
Provisional Application 61186613 · Jun 12, 2009
Related Publication 20100316134A1 · Dec 16, 2010