IP Library › Granted Patent US 9,344,737
Granted Patent B2
US 9,344,737 · App. 14/839,326 · Granted May 17, 2016

Reference picture list construction for multi-view and three-dimensional video coding

Inventors: Ying Chen (San Diego, CA); Ye-Kui Wang (San Diego, CA); Li Zhang (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04N19/50H04N13/0048H04N13/0445H04N19/00569H04N19/124H04N19/44H04N19/597H04N19/91
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,344,737
App. No.
14/839,326
Granted
May 17, 2016
Kind
B2
Abstract

A video encoder generates, based on a reference picture set of a current view component, a reference picture list for the current view component. The reference picture set includes an inter-view reference picture set. The video encoder encodes the current view component based at least in part on one or more reference pictures in the reference picture list. In addition, the video encoder generates a bitstream that includes syntax elements indicating the reference picture set of the current view component. A video decoder parses, from the bitstream, syntax elements indicating the reference picture set of the current view component. The video decoder generates, based on the reference picture set, the reference picture list for the current view component. In addition, the video decoder decodes at least a portion of the current view component based on one or more reference pictures in the reference picture list.

Claims (70)

1. A method for multiview video decoding, the method comprising:

generating a first reference picture list for a current view component of a current view of video data such that each view component of a first inter-view reference picture set is included in the first reference picture list before any view component of a second inter-view reference picture set,

the first inter-view reference picture set consisting of view components that are not from the current view, the view components of the first inter-view reference picture set being from a same access unit as the current view component, the view components of the first inter-view reference picture set being usable by the current view component for inter-view prediction reference, each view component of the first inter-view reference picture set having a view identifier less than a view identifier of the current view component,

the second inter-view reference picture set consisting of view components that are not from the current view, the view components of the second inter-view reference picture set being from the same access unit as the current view component, the view components of the second inter-view reference picture set being usable by the current view component for inter-view prediction reference, each view component of the second inter-view reference picture set having a view identifier greater than the view identifier of the current view component;

generating a second reference picture list for the current view component such that each view component of the second inter-view reference picture set is included in the second reference picture list before any view component of the first inter-view reference picture set; and

decoding at least a portion of the current view component based on one or more reference pictures in the first reference picture list and the second reference picture list.

2. The method of claim 1 , wherein:

generating the first reference picture list comprises including, in the first reference picture list, each view component of a first subset of a reference picture set of the current view component before any view component of the first inter-view reference picture set; and

generating the second reference picture list comprises including, in the second reference picture list, each view component of a second subset of the reference picture set of the current view component before any view component of the second inter-view reference picture set,

the first subset consisting of short-term reference view components that are prior to the current view component in both decoding order and output order, the second subset consisting of short-term reference view components that are prior to the current view component in decoding order and that succeed the current view component in output order.

3. The method of claim 2 , wherein:

generating the first reference picture list comprises including, in the first reference picture list, each view component of the second subset of the reference picture set of the current view component after any view component of the first inter-view reference picture set; and

generating the second reference picture list comprises including, in the second reference picture list, each view component of the first subset of the reference picture set of the current view component after any view component of the second inter-view reference picture set.

4. The method of claim 1 , wherein:

generating the first reference picture list comprises including a long term reference picture subset in the first reference picture list such that each view component of the first inter-view reference picture set is before any view component of the long term reference picture subset, the long term reference picture subset consisting of long-term reference view components that are prior to the current view component in decoding order; and

generating the second reference picture list comprises including the long term reference picture subset in the second reference picture list such that each view component of the second inter-view reference picture set is before any view component of the long term reference picture subset.

5. The method of claim 1 , further comprising obtaining, from a bitstream, syntax elements specifying the view identifiers of the view components of the first inter-view reference picture set, the view identifiers of the view components of the second inter-view reference picture set, and the view identifier of the current view component.

6. A method for multiview video encoding, the method comprising:

generating a first reference picture list for a current view component of a current view of video data such that each view component of a first inter-view reference picture set is included in the first reference picture list before any view component of a second inter-view reference picture set,

the first inter-view reference picture set consisting of view components that are not from the current view, the view components of the first inter-view reference picture set being from a same access unit as the current view component, the view components of the first inter-view reference picture set being usable by the current view component for inter-view prediction reference, each view component of the first inter-view reference picture set having a view identifier less than a view identifier of the current view component,

the second inter-view reference picture set consisting of view components that are not from the current view, the view components of the second inter-view reference picture set being from the same access unit as the current view component, the view components of the second inter-view reference picture set being usable by the current view component for inter-view prediction reference, each view component of the second inter-view reference picture set having a view identifier greater than the view identifier of the current view component;

generating a second reference picture list for the current view component such that each view component of the second inter-view reference picture set is included in the second reference picture list before any view component of the first inter-view reference picture set; and

encoding at least a portion of the current view component based on one or more reference pictures in the first reference picture list and the second reference picture list.

7. The method of claim 6 , wherein:

generating the first reference picture list comprises including, in the first reference picture list, each view component of a first subset of a reference picture set of the current view component before any view component of the first inter-view reference picture set; and

generating the second reference picture list comprises including, in the second reference picture list, each view component of a second subset of the reference picture set of the current view component before any view component of the second inter-view reference picture set,

the first subset consisting of short-term reference view components that are prior to the current view component in both decoding order and output order, the second subset consisting of short-term reference view components that are prior to the current view component in decoding order and that succeed the current view component in output order.

8. The method of claim 7 , wherein:

generating the first reference picture list comprises including, in the first reference picture list, each view component of the second subset of the reference picture set of the current view component after any view component of the first inter-view reference picture set; and

generating the second reference picture list comprises including, in the second reference picture list, each view component of the first subset of the reference picture set of the current view component after any view component of the second inter-view reference picture set.

9. The method of claim 6 , wherein:

generating the first reference picture list comprises including a long term reference picture subset in the first reference picture list such that each view component of the first inter-view reference picture set is before any view component of the long term reference picture subset, the long term reference picture subset consisting of long-term reference view components that are prior to the current view component in decoding order; and

generating the second reference picture list comprises including the long term reference picture subset in the second reference picture list such that each view component of the second inter-view reference picture set is before any view component of the long term reference picture subset.

10. The method of claim 6 , further comprising including, in a bitstream, syntax elements specifying the view identifiers of the view components of the first inter-view reference picture set, the view identifiers of the view components of the second inter-view reference picture set, and the view identifier of the current view component.

11. A video coding device comprising:

one or more data storage media configured to store video data; and

one or more processors configured to:

generate a first reference picture list for a current view component of a current view of the video data such that each view component of a first inter-view reference picture set is included in the first reference picture list before any view component of a second inter-view reference picture set,

the first inter-view reference picture set consisting of view components that are not from the current view, the view components of the first inter-view reference picture set being from a same access unit as the current view component, the view components of the first inter-view reference picture set being usable by the current view component for inter-view prediction reference, each view component of the first inter-view reference picture set having a view identifier less than a view identifier of the current view component,

the second inter-view reference picture set consisting of view components that are not from the current view, the view components of the second inter-view reference picture set being from the same access unit as the current view component, the view components of the second inter-view reference picture set being usable by the current view component for inter-view prediction reference, each view component of the second inter-view reference picture set having the view identifier greater than a view identifier of the current view component; and

generate a second reference picture list for the current view component such that each view component of the second inter-view reference picture set is included in the second reference picture list before any view component of the first inter-view reference picture set.

12. The video coding device of claim 11 , wherein the one or more processors are configured to:

include, in the first reference picture list, each view component of a first subset of a reference picture set of the view component picture before any view component of the first inter-view reference picture set; and

include, in the second reference picture list, each view component of a second subset of the reference picture set of the current view component before any view component of the second inter-view reference picture set,

the first subset consisting of short-term reference view components that are prior to the current view component in both decoding order and output order, the second subset consisting of short-term reference view components that are prior to the current view component in decoding order and that succeed the current view component in output order.

13. The video coding device of claim 12 , wherein the one or more processors are configured to:

include, in the first reference picture list, each view component of the second subset of the reference picture set of the current view component after any view component of the first inter-view reference picture set; and

include, in the second reference picture list, each view component of the first subset of the reference picture set of the current view component after any view component of the second inter-view reference picture set.

14. The video coding device of claim 11 , wherein the one or more processors are configured to:

include a long term reference picture subset in the first reference picture list such that each view component of the first inter-view reference picture set is before any view component of the long term reference picture subset, the long term reference picture subset consisting of long-term reference view components that are prior to the current view component in decoding order; and

include the long term reference picture subset in the second reference picture list such that each view component of the second inter-view reference picture set is before any view component of the long term reference picture subset.

15. The video coding device of claim 11 , wherein the one or more processors are configured to obtain, from a bitstream, syntax elements specifying the view identifiers of the view components of the first inter-view reference picture set, the view identifiers of the view components of the second inter-view reference picture set, and the view identifier of the current view component.

16. The video coding device of claim 11 , wherein the video coding device comprises at least one of:

an integrated circuit;

a microprocessor; or

a wireless handset.

17. The video coding device of claim 11 , wherein the one or more processors are configured to decode at least a portion of the current view component based on one or more reference pictures in the first reference picture list and the second reference picture list.

18. The video coding device of claim 17 , further comprising a display configured to display decoded video data, including the current view component.

19. The video coding device of claim 11 , wherein the one or more processors are configured to encode at least a portion of the current view component based on one or more reference pictures in the first reference picture list and the second reference picture list.

20. The video coding device of claim 19 , further comprising a camera configured to capture the video data.

21. A video coding device comprising:

means for generating a first reference picture list for a current view component of a current view of video data such that each view component of a first inter-view reference picture set is included in the first reference picture list before any view component of a second inter-view reference picture set,

the first inter-view reference picture set consisting of view components that are not from the current view, the view components of the first inter-view reference picture set being from a same access unit as the current view component, the view components of the first inter-view reference picture set being usable by the current view component for inter-view prediction reference, each view component of the first inter-view reference picture set having a view identifier less than a view identifier of the current view component,

the second inter-view reference picture set consisting of view components that are not from the current view, the view components of the second inter-view reference picture set being from the same access unit as the current view component, the view components of the second inter-view reference picture set being usable by the current view component for inter-view prediction reference, each view component of the second inter-view reference picture set having a view identifier greater than the view identifier of the current view component; and

means for generating a second reference picture list for the current view component such that each view component of the second inter-view reference picture set is included in the second reference picture list before any view component of the first inter-view reference picture set.

22. A non-transitory computer-readable data storage medium having instructions stored thereon that, when executed, cause a video coding device to:

generate a first reference picture list for a current view component of a current view of video data such that each view component of a first inter-view reference picture set is included in the first reference picture list before any view component of a second inter-view reference picture set,

the first inter-view reference picture set consisting of view components that are not from the current view, the view components of the first inter-view reference picture set being from a same access unit as the current view component, the view components of the first inter-view reference picture set being usable by the current view component for inter-view prediction reference, each view component of the first inter-view reference picture set having a view identifier less than a view identifier of the current view component,

the second inter-view reference picture set consisting of view components that are not from the current view, the view components of the second inter-view reference picture set being from the same access unit as the current view component, the view components of the second inter-view reference picture set being usable by the current view component for inter-view prediction reference, each view component of the second inter-view reference picture set having a view identifier greater than the view identifier of the current view component; and

generate a second reference picture list for the current view component such that each view component of the second inter-view reference picture set is included in the second reference picture list before any view component of the first inter-view reference picture set.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2015
From: CHEN, YING; WANG, YE-KUI; ZHANG, LI
To: QUALCOMM INCORPORATED
Reel/Frame 036451/0105 →
Continuity (3)
Continuation 13720622 · Dec 19, 2012
Provisional Application 61578178 · Dec 20, 2011
Related Publication 20150373315A1 · Dec 24, 2015