IP Library › Granted Patent US 9,258,559

Granted Patent B2

US 9,258,559 · App. 13/720,622 · Granted Feb 9, 2016

Reference picture list construction for multi-view and three-dimensional video coding

Inventors: Ying Chen (San Diego, CA); Ye-Kui Wang (San Diego, CA); Li Zhang (San Diego, CA)

Assignee: QUALCOMM Incorporated

H04N19/00569 H04N13/0048 H04N19/50 H04N19/597

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 9,258,559
App. No.: 13/720,622
Granted: Feb 9, 2016
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

A video encoder generates, based on a reference picture set of a current view component, a reference picture list for the current view component. The reference picture set includes an inter-view reference picture set. The video encoder encodes the current view component based at least in part on one or more reference pictures in the reference picture list. In addition, the video encoder generates a bitstream that includes syntax elements indicating the reference picture set of the current view component. A video decoder parses, from the bitstream, syntax elements indicating the reference picture set of the current view component. The video decoder generates, based on the reference picture set, the reference picture list for the current view component. In addition, the video decoder decodes at least a portion of the current view component based on one or more reference pictures in the reference picture list.

Claims (70)

1. A method for multiview video decoding, the method comprising:

generating a reference picture list for a current view component of a current view of video data to include, in the following order, each view component of a first subset of a reference picture set of the current view component, each view component of an inter-view reference picture set of the reference picture set of the current view component, each view component of a second subset of the current view component, and each view component of a third subset of the reference picture set of the current view component,

the first subset consisting of short-term reference view components that are prior to the current view component in both decoding order and output order, the second subset consisting of short-term reference view components that are prior to the current view component in decoding order and that succeed the current view component in output order, the third subset consisting of long-term reference view components that are prior to the current view component in decoding order,

the inter-view reference picture set consisting of view components that are not from the current view, the view components of the inter-view reference picture set being from a same access unit as the current view component, the view components of the inter-view reference picture set being usable by the current view component for inter-view prediction reference; and

decoding at least a portion of the current view component based on one or more reference pictures in the reference picture list.

2. The method of clam 1 , wherein the reference picture set further includes a fourth subset, a fifth subset, and a sixth subset, the fourth subset comprising short-term reference view components that are prior to the current view component in both decoding order and output order that are usable in inter prediction of one or more view components that follow the current view component and that are not used in inter prediction of the current view component, the fifth subset comprising short-term reference view components that are prior to the current view component in decoding order and succeed the current view component in output order that are usable in inter prediction of one or more view components following the current view component and that are not used in inter prediction of the current view component, the sixth subset comprising long-term reference view components that are prior to the current view component in decoding order that are usable in inter prediction of one or more view components following the current view component in decoding order and that are not used in inter prediction of the current view component.

3. The method of claim 1 , further comprising performing a reference picture list modification process that changes a position in the reference picture list of an inter-view reference view component.

4. The method of claim 1 , wherein the inter-view reference picture set is signaled in a sequence level and shared by all view components in the current view.

5. The method of claim 1 , further comprising parsing, from a slice header, syntax elements indicating the reference picture set of the current view component of the access unit.

6. A method for video encoding, the method comprising:

generating a reference picture list for a current view component of a current view of video data to include, in the following order, each view component of a first subset of a reference picture set of the current view component, each reference view component of an inter-view reference picture set of the current view component, each view component of a second subset of the reference picture set of the current view component, and each view component of a third subset of the reference picture set of the current view component,

encoding the current view component based at least in part on one or more reference pictures in the reference picture list.

7. The method of claim 6 , wherein the reference picture set further comprises a fourth subset, a fifth subset, and a sixth subset, the fourth subset comprising short-term reference view components that are prior to the current view component in both decoding order and output order that are usable in inter prediction of one or more view components that follow the current view component and that are not used in inter prediction of the current view component, the fifth subset comprising short-term reference view components that are prior to the current view component in decoding order and succeed the current view component in output order that are usable in inter prediction of one or more view components following the current view component and that are not used in inter prediction of the current view component, the sixth subset comprising long-term reference view components that are prior to the current view component in decoding order that are usable in inter prediction of one or more view components following the current view component in decoding order and that are not used in inter prediction of the current view component.

8. The method of claim 6 , further comprising performing a reference picture list modification process that changes a position in the reference picture list of an inter-view reference view component.

9. The method of claim 6 , further comprising signaling the inter-view reference picture set in a sequence level, wherein the inter-view reference picture set is shared by all view components in the current view.

10. The method of claim 6 , further comprising generating a slice header that includes syntax elements indicating the reference picture set.

11. A video decoding device that comprises:

a storage medium configured to store video data; and

one or more processors configured to:

generate a reference picture list for a current view component of a current view of the video data to include, in the following order, each view component of a first subset of a reference picture set of the current view component, each view component of an inter-view reference picture set of the reference picture set of the current view component, followed by each view component of a second subset of the current view component, and followed by each view component of a third subset of the reference picture set of the current view component,

decode at least a portion of the current view component based on one or more reference pictures in the reference picture list.

12. The video decoding device of clam 11 , wherein the reference picture set further includes a fourth subset, a fifth subset, and a sixth subset, the fourth subset comprising short-term reference view components that are prior to the current view component in both decoding order and output order that are usable in inter prediction of one or more view components that follow the current view component and that are not used in inter prediction of the current view component, the fifth subset comprising short-term reference view components that are prior to the current view component in decoding order and succeed the current view component in output order that are usable in inter prediction of one or more view components following the current view component and that are not used in inter prediction of the current view component, the sixth subset comprising long-term reference view components that are prior to the current view component in decoding order that are usable in inter prediction of one or more view components following the current view component in decoding order and that are not used in inter prediction of the current view component.

13. The video decoding device of claim 11 , wherein the one or more processors are configured to perform a reference picture list modification process that changes a position in the reference picture list of an inter-view reference view component.

14. The video decoding device of claim 11 , wherein the inter-view reference picture set is signaled in a sequence level and shared by all view components in the current view.

15. The video decoding device of claim 11 , wherein the one or more processors are configured to parse, from a slice header, syntax elements indicating the reference picture set of the current view component of the access unit.

16. The video decoding device of claim 11 , wherein the video decoding device comprises at least one of:

an integrated circuit;

a microprocessor; or

a wireless handset.

17. The video decoding device of claim 11 , further comprising a display configured to display decoded video data.

18. A video encoding device that comprises:

a storage medium configured to store video data; and

one or more processors configured to:

generate a reference picture list for a current view component of a current view of the video data to include, in the following order, each view component of a first subset of a reference picture set of the current view component, each reference view component of an inter-view reference picture set of the current view component, each view component of a second subset of the reference picture set of the current view component, and each view component of a third subset of the reference picture set of the current view component,

encode the current view component based on one or more reference pictures in the reference picture list.

19. The video encoding device of claim 18 , wherein the reference picture set further includes a fourth subset, a fifth subset, and a sixth subset, the fourth subset comprising short-term reference view components that are prior to the current view component in both decoding order and output order that are usable in inter prediction of one or more view components that follow the current view component and that are not used in inter prediction of the current view component, the fifth subset comprising short-term reference view components that are prior to the current view component in decoding order and succeed the current view component in output order that are usable in inter prediction of one or more view components following the current view component and that are not used in inter prediction of the current view component, the sixth subset comprising long-term reference view components that are prior to the current view component in decoding order that are usable in inter prediction of one or more view components following the current view component in decoding order and that are not used in inter prediction of the current view component.

20. The video encoding device of claim 18 , wherein the one or more processors are configured to perform a reference picture list modification process that changes a position in the reference picture list of an inter-view reference view component.

21. The video encoding device of claim 18 , wherein the one or more processors are configured to signal the inter-view reference picture set in a sequence level, wherein the inter-view reference picture set is shared by all view components in the current view.

22. The video encoding device of claim 18 , wherein the one or more processors are configured to generate a slice header that includes syntax elements indicating the reference picture set.

23. The video encoding device of claim 18 , wherein the video encoding device comprises at least one of:

an integrated circuit;

a microprocessor; or

a wireless handset.

24. The video encoding device of claim 18 , further comprising a camera configured to capture the video data.

25. A video decoding device comprising:

means for generating a reference picture list for a current view component of a current view of video data to include, in the following order, each view component of a first subset of a reference picture set of the current view component, each view component of an inter-view reference picture set of the reference picture set of the current view component, each view component of a second subset of the current view component, and each view component of a third subset of the reference picture set of the current view component,

means for decoding at least a portion of the current view component based on one or more reference pictures in the reference picture list.

26. A video encoding device comprising:

means for generating a reference picture list for a current view component of a current view of video data to include, in the following order, each view component of a first subset of a reference picture set of the current view component, each reference view component of an inter-view reference picture set of the current view component, each view component of a second subset of the reference picture set of the current view component, and each view component of a third subset of the reference picture set of the current view component,

means for encoding the current view component based on one or more reference pictures in the reference picture list.

27. A non-transitory computer-readable storage medium that stores computer-executable instructions that, when executed by one or more processors of a video decoding device, configure the video decoding device to:

generate a reference picture list for a current view component of a current view of video data to include, in the following order, each view component of a first subset of a reference picture set of the current view component, each view component of an inter-view reference picture set of the reference picture set of the current view component, each view component of a second subset of the current view component, and each view component of a third subset of the reference picture set of the current view component,

decode at least a portion of the current view component based on one or more reference pictures in the reference picture list.

28. A non-transitory computer-readable storage medium that stores computer-executable instructions that, when executed by one or more processors of a video encoding device, configure the video encoding device to:

generate a reference picture list for a current view component of a current view of video data to include, in the following order, each view component of a first subset of a reference picture set of the current view component, each reference view component of an inter-view reference picture set of the current view component, each view component of a second subset of the reference picture set of the current view component, and each view component of a third subset of the reference picture set of the current view component,

encode the current view component based on one or more reference pictures in the reference picture list.

Assignments (1)

ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2013

From: CHEN, YING; WANG, YE-KUI; ZHANG, LI

To: QUALCOMM INCORPORATED

Reel/Frame 029805/0337 →

Continuity (2)

Provisional Application 61578178 · Dec 20, 2011

Related Publication 20130155184A1 · Jun 20, 2013