IP Library › Granted Patent US 10,341,638
Granted Patent B2
US 10,341,638 · App. 14/758,413 · Granted Jul 2, 2019

Method and apparatus of depth to disparity vector conversion for three-dimensional video coding

Inventors: Jian-Liang Lin (Su'ao Township Yilan County, TW); Yi-Wen Chen (Taichung, TW)
Assignee: MediaTek Inc.
H04N13/161H04N19/105H04N19/52H04N19/597
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,341,638
App. No.
14/758,413
Granted
Jul 2, 2019
Kind
B2
Abstract

A method and apparatus using a single converted DV (disparity vector) from the depth data for a conversion region are disclosed. Embodiments according to the present invention receive input data and depth data associated with a conversion region of a current picture in a current dependent view. The conversion region is checked to determine whether it is partitioned into multiple motion prediction sub-blocks. If the conversion region is partitioned into multiple motion prediction sub-blocks, then a single converted DV from the depth data associated with the conversion region is determined and each of the multiple motion prediction sub-blocks of the conversion region is processed according to a first coding tool using the single converted DV. If the conversion region is not partitioned into multiple motion prediction sub-blocks, the conversion region is processed according to the first coding tool or a second coding tool using the single converted DV.

Claims (35)

1. A method for three-dimensional or multi-view video coding, the method comprising:

receiving input data associated with a conversion region of a current picture in a current dependent view, wherein the conversion region comprises a grid of pixels;

receiving depth data for the grid of pixels associated with the conversion region;

determining the conversion region is partitioned into multiple motion prediction sub-blocks;

determining a single converted DV (disparity vector) from the depth data associated with the conversion region based on at least (a) first depth data associated with a first motion prediction sub-block from the multiple motion prediction sub-blocks, and (b) second depth data associated with a second motion prediction sub-block from the multiple motion prediction sub-blocks; and

processing each of the multiple motion prediction sub-blocks of the conversion region using the single converted DV.

2. The method of claim 1 , further comprising:

receiving input data associated with a second conversion region of the current picture, wherein the second conversion region comprises a second grid of pixels;

receiving second depth data for the second grid of pixels associated with the second conversion region;

determining the second conversion region is not partitioned into multiple motion prediction sub-blocks; and

processing the second conversion region using the single converted DV.

3. The method of claim 2 , wherein:

processing the second conversion region comprises performing motion vector prediction (MVP) in Inter mode, performing MVP in Skip or Direct mode, or both.

4. The method of claim 3 , wherein the conversion region is a 16.times.16 macroblock (MB).

5. The method of claim 2 , wherein:

processing the second conversion region comprises performing motion vector prediction (MVP) in Inter or Merge mode, performing MVP in Skip mode, or both.

6. The method of claim 5 , wherein the conversion region corresponds to a Coding Unit (CU), a Largest CU (LCU), a coding tree unit (CTU), or a Motion Estimation Region (MER), and wherein the motion prediction sub-block corresponds to a Prediction Unit (PU).

7. The method of claim 2 , wherein: processing the second conversion region comprises performing one or more of motion vector prediction (MVP) candidate derivation in Inter mode, MVP candidate derivation in Skip mode, MVP candidate derivation in Direct mode, direction-separated motion vector predictor, priority based MVP candidate derivation in the Skip mode or the Direct mode, inter-view candidate derivation in Merge mode, the inter-view candidate derivation in the Skip mode, inter-view motion prediction, inter-view disparity prediction, block-based view synthesis prediction, and inter-view residual prediction.

8. The method of claim 1 , wherein the single converted DV is determined from a maximum depth value of more than two samples in a depth block associated with the conversion region.

9. The method of claim 8 , wherein the single converted DV is determined from the maximum depth value of more than two samples in the depth block associated with the conversion region.

10. An apparatus for three-dimensional or multi-view video coding, the apparatus comprising one or more electronic circuits, wherein said one or more electronic circuits are configured to:

receive input data associated with a conversion region of a current picture in a current dependent view, wherein the conversion region comprises a grid of pixels;

receive depth data for the grid of pixels associated with the conversion region;

determine the conversion region is partitioned into multiple motion prediction sub-blocks;

determine a single converted DV (disparity vector) from the depth data associated with the conversion region based on at least (a) first depth data associated with a first motion prediction sub-block from the multiple motion prediction sub-blocks, and (b) second depth data associated with a second motion prediction sub-block from the multiple motion prediction sub-blocks; and

process each of the multiple motion prediction sub-blocks of the conversion region using the single converted DV.

11. The apparatus of claim 10 , wherein said one or more electronic circuits are further configured to:

receive input data associated with a second conversion region of the current picture, wherein the second conversion region comprises a second grid of pixels;

receive second depth data for the second grid of pixels associated with the second conversion region;

determine the second conversion region is not partitioned into multiple motion prediction sub-blocks; and

process the second conversion region using the single converted DV.

12. The method of claim 1 , wherein processing each of the multiple motion prediction sub-blocks of the conversion region using the single converted DV comprises performing motion vector prediction (MVP) in Inter mode.

13. The method of claim 1 , wherein processing each of the multiple motion prediction sub-blocks of the conversion region using the single converted DV comprises performing motion vector prediction (MVP) in Inter or Merge mode.

14. The method of claim 1 , wherein processing each of the multiple motion prediction sub-blocks of the conversion region using the single converted DV comprises performing one or more of motion vector prediction (MVP) candidate derivation in Inter mode, MVP candidate derivation in Skip mode, MVP candidate derivation in Direct mode, direction-separated motion vector predictor, priority based MVP candidate derivation in the Skip mode or the Direct mode, inter-view candidate derivation in Merge mode, the inter-view candidate derivation in the Skip mode, inter-view motion prediction, inter-view disparity prediction, block-based view synthesis prediction, and inter-view residual prediction.

15. The method of claim 1 , wherein determining the single converted DV from the depth data associated with the conversion region comprises determining the single converted DV from depth data associated with more than two of the multiple motion prediction sub-blocks.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2015
From: LIN, JIAN-LIANG; CHEN, YI-WEN
To: MEDIATEK INC.
Reel/Frame 035928/0844 →
Continuity (2)
Provisional Application 61749455 · Jan 7, 2013
Related Publication 20150358598A1 · Dec 10, 2015