Granted Patent B2

US 9,530,192 · App. 13/173,264 · Granted Dec 27, 2016

Abstract

Claims (27)

1. A method for improving a stereo image including a left view image and a right view image, comprising:

using a digital processor to automatically analyze the stereo image to determine an original stereo quality score responsive to relative positions of corresponding points in the left view image and the right view image;

specifying a set of one or more candidate modifications to the stereo image;

determining revised stereo quality scores based on each of the candidate modifications to the stereo image;

generating a plurality of iterated revised stereo quality scores and a new set of modifications until either the iterated revised stereo quality score does not change or until an iteration limit is reached;

selecting a particular candidate modification that produces a revised stereo quality score which indicates a higher quality level than the original stereo quality score;

forming an output stereo image corresponding to the selected particular candidate modification; and

storing the output stereo image in a processor-accessible memory.

2. The method of claim 1 wherein the candidate modifications include applying a geometric transform to the left view image or the right view image or both.

3. The method of claim 2 wherein the geometric transform includes a translation, a rotation or a scaling operation.

4. The method of claim 2 wherein different geometric transforms are applied to different image regions.

5. The method of claim 1 wherein the set of one or more candidate modifications are determined using an iterative optimization process.

6. The method of claim 1 wherein each candidate modification is specified using one or more parameters.

7. The method of claim 6 wherein the set of one or more candidate modifications correspond to a systematic sampling of the one or more parameters.

8. The method of claim 7 wherein the systematic sampling involves selecting random values for the one or more parameters according to a predefined distribution.

9. The method of claim 7 wherein the systematic sampling involves selecting values for the one or more parameters according to a regular pattern.

10. The method of claim 1 wherein the selected particular candidate modification is the candidate modification that produces the revised stereo quality score corresponding to the highest quality level among the one or more candidate modifications.

11. The method of claim 1 wherein the process of determining the stereo quality score includes:

extracting a set of features from the stereo image, wherein the features include a set of motion vectors between corresponding points in the left view image and the right view image;

determining the stereo quality score using a classifier responsive to the set of features.

12. The method of claim 11 wherein the classifier is trained using a training set of stereo images having reference stereo quality scores determined by human observers.

13. The method of claim 11 wherein the set of motion vectors are determined by tracking a set of interest points between the left view image and the right view image.

14. The method of claim 13 wherein the set of interest points are tracked using a Kanade-Lucas-Tomasi feature tracking algorithm.

15. The method of claim 11 wherein the set of features further includes one or more features incorporating epipolar geometry characteristics determined from the set of motion vectors.

16. The method of claim 11 wherein the set of features further includes one or more features determined by applying statistical calculations to the set of motion vectors.

17. The method of claim 11 wherein the classifier is a support vector machine classifier.

18. The method of claim 1 further including displaying the stereo image pair using a stereo image display system.

Assignments (13)