IP Library › Granted Patent US 9,699,462
Granted Patent B2
US 9,699,462 · App. 14/588,646 · Granted Jul 4, 2017

System and method for estimating view synthesis distortion

Inventors: Zhouye Gu (Santa Clara, CA); Jianhua Zheng (Beijing, CN); Nam Ling (San Jose, CA); Chen-Xiong Zhang (Plano, TX)
Assignees: Futurewei Technologies, Inc.; Santa Clara University
H04N19/136H04N19/154H04N19/503
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,699,462
App. No.
14/588,646
Granted
Jul 4, 2017
Kind
B2
Abstract

System and method embodiments are provided for achieving improved View Synthesis Distortion (VSD) calculation and more accurate distortion estimation of encoded video frames. An embodiment method includes obtaining a depth map value for a video frame and determining a weighting factor for depth distortion in accordance with the depth map value. The weighting factor maps a pixel range of the depth map value to an output function having higher values for closer image objects and lower values for farther image objects. The VSD for the video frame is then calculated as a function of absolute horizontal texture gradients weighted by a depth distortion value and the weighting factor determined in accordance with the depth map value.

Claims (38)

1. A method by a processor for estimating view synthesis distortion (VSD) for video coding, the method comprising:

obtaining a depth map value for a video frame;

determining a weighting factor for depth distortion in accordance with the depth map value; and

calculating, for the video frame, the VSD as a function of absolute horizontal texture gradients weighted by a depth distortion value and the weighting factor determined in accordance with the depth map value.

2. The method of claim 1 , wherein the weighting factor has a larger value when the depth map value has a corresponding larger value indicating a closer image object, and has a smaller value when the depth map value has a corresponding smaller value indicating a farther image object.

3. The method of claim 1 , wherein the weighting factor is a nonlinear function of the depth map value.

4. The method of claim 1 , wherein the weighting factor is a piecewise linear or nonlinear function of the depth map value.

5. The method of claim 1 , wherein the weighting factor is a look-up table with the depth map value as input.

6. The method of claim 1 , wherein the depth distortion value is calculated based on the depth map value and a reconstructed depth map value after compression of the video frame.

7. The method of claim 1 , wherein the weighting factor is determined in accordance with the video frame, and wherein the method further includes varying the weighting factor based on the video frame under consideration.

8. The method of claim 1 , wherein the function for calculating the VSD is determined in accordance with the video frame, and wherein the method further includes varying the function for calculating the VSD based on the video frame under consideration.

9. The method of claim 1 , wherein the processor is part of a video encoder or decoder in one of a user device and a network device.

10. A method by a processor for estimating view synthesis distortion (VSD) for video coding, the method comprising:

obtaining a depth map value for a video frame;

determining a weighting factor, wherein the weighting factor maps a pixel range of the depth map value to an output function having higher values for closer image objects and lower values for farther image objects; and

calculating the VSD as a product of a term for horizontal texture distortion and a term for depth distortion weighted by the weighting factor.

11. The method of claim 10 , wherein the weighting factor is a piecewise linear function, g(s D (x,y)), obtained as:

g ( s D ( x,y )) =d, if s D ( x,y ) ≧e,

g ( s D ( x,y ))=( s D ( x,y )− a ) /b+c, if f<s D ( x,y ) <e, and

g ( s D ( x,y ))=1, if s D ( x,y ) ≦f,

and wherein a, b, c, d, e, and f are variables selected appropriately to determine a suitable mapping between the pixel range of the depth map value to the output function of the weighting factor.

12. The method of claim 10 , wherein the weighting factor is obtained based on a logarithm function of the depth map value.

13. The method of claim 10 , wherein the weighting factor is obtained as max(alog b (S D (x,y)+e)+c,d) where S D (x,y) is the depth map value, and wherein a, b, e, c, and d are variables selected appropriately to determine a suitable mapping between the pixel range of the depth map value to the output function of the weighting factor.

14. The method of claim 10 , wherein the weighting factor is obtained as max((S D (x,y)−a)/c, b) where S D (x,y) is the depth map value, and wherein a, c, and b are variables selected appropriately to determine a suitable mapping between the pixel range of the depth map value to the output function of the weighting factor.

15. The method of claim 10 , wherein the weighting factor is obtained as:

f ( S D ( x,y )) =d if S D ( x,y ) >e, and

f ( S D ( x,y ))=max(( S D ( x,y )−α) /c, b ) if S D ( x,y ) <=e,

and wherein a, b, c, d, and e are variables selected appropriately to determine a suitable mapping between the pixel range of the depth map value to the output function of the weighting factor.

16. The method of claim 10 , wherein the weighting factor is calculated by a mapping of predetermined pixel ranges of the depth map value to weighting factor values.

17. The method of claim 10 , wherein the processor is located at one of a user device and a network device.

18. An apparatus for estimating view synthesis distortion (VSD), the apparatus comprising:

at least one processor;

a non-transitory computer readable storage medium storing programming for execution by the at least one processor, the programming including instructions to:

obtain a depth map value for a video frame;

determine a weighting factor for depth distortion in accordance with the depth map value; and

calculate, for the video frame, the VSD as a function of a sum of absolute horizontal texture gradients weighted by a depth distortion value and the weighting factor for depth distortion determined in accordance with the depth map value.

19. The apparatus of claim 18 , wherein the weighting factor has a larger value when the depth map value has a corresponding larger value indicating a closer image object, and has a smaller value when the depth map value has a corresponding smaller value indicating a farther image object.

20. The apparatus of claim 18 , wherein the apparatus is located at one of a user device and a network device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 17, 2015
From: ZHANG, CHEN-XIONG; ZHENG, JIANHUA
To: FUTUREWEI TECHNOLOGIES, INC.
Reel/Frame 035850/0360 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 17, 2015
From: GU, ZHOUYE; LING, NAM
To: SANTA CLARA UNIVERSITY
Reel/Frame 035851/0400 →
Continuity (2)
Provisional Application 61923500 · Jan 3, 2014
Related Publication 20150195540A1 · Jul 9, 2015