IP Library Granted Patent US 8,571,350
Granted Patent B2
US 8,571,350 · App. 13/030,124 · Granted Oct 29, 2013

Image processing system with image alignment mechanism and method of operation thereof

Inventors: Dennis Adams (Madison, WI); Dale Emmons (Madison, WI)
Assignee: Sony Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,571,350
App. No.
13/030,124
Granted
Oct 29, 2013
Kind
B2
Abstract

A method of operation of an image processing system includes: identifying a feature point on a first image; determining a matching point on a second image with the matching point corresponding to the feature point; calculating an offset component between the feature point and the matching point with the offset component having a vertical offset; identifying a correction field for updating the first image and the second image, with the correction field having a vertical adjustment, a zoom adjustment, a rotational adjustment, and a keystone adjustment; and updating the first image and the second image using the correction field for minimizing the offset component for displaying an aligned image on a device.

Claims (80)

1. A method of operation of an image processing system comprising:

identifying a feature point on a first image;

determining a matching point on a second image with the matching point corresponding to the feature point;

calculating an offset component between the feature point and the matching point with the offset component having a vertical offset;

identifying a correction field for updating the first image and the second image, with the correction field having a vertical adjustment, a zoom adjustment, a rotational adjustment, a keystone adjustment, or a combination thereof;

updating the first image and the second image using the correction field for minimizing the offset component for displaying an aligned image on a device;

calculating an average in-cell displacement between a plurality of the vertical offset belonging to a further plurality of the feature point and the matching point within a grid-cell; and

calculating an average grid displacement between the plurality of the average in-cell displacement from the grid-cell; and

wherein:

updating the first image and the second image includes minimizing the average grid displacement.

2. The method as claimed in claim 1 further comprising:

dividing the first image using a grid having the grid-cell;

identifying a cell population limit for updating the first image; and

wherein:

updating the first image includes updating the first image having a plurality of the feature point within the grid-cell exceeding the cell population limit.

3. The method as claimed in claim 1 further comprising:

dividing the second image using a grid having the grid-cell;

identifying a cell population limit for updating the second image; and

wherein:

updating the second image includes updating the second image having a plurality of the matching point within the grid-cell exceeding the cell population limit.

4. The method as claimed in claim 1 further comprising:

determining a confidence threshold for updating the first image; and

wherein:

calculating the offset component includes calculating a confidence vector between the feature point and the matching point; and

updating the first image and the second includes comparing the confidence vector to the confidence threshold.

5. The method as claimed in claim 1 wherein identifying the correction field includes comparing the offset component while varying the correction field.

6. A method of operation of an image processing system comprising:

identifying a feature point on a first image;

determining a confidence threshold for updating the first image;

determining a matching point on a second image, with the matching point corresponding to the feature point;

dividing the first image and the second image using a grid having a grid-cell;

identifying a cell population limit for updating the first image and the second image;

calculating an offset component between the feature point and the matching point, with the offset component having a vertical offset and a confidence vector;

identifying a correction field for adjusting the first image and the second image, with the correction field having a vertical adjustment, a zoom adjustment, a rotational adjustment, a keystone adjustment, or a combination thereof;

updating the first image and the second image for minimizing the offset component and the confidence vector is greater than the confidence threshold, with the first image having a plurality of the feature point within the grid-cell and the second image having a further plurality of the matching point within the grid-cell, both pluralities exceeding the cell population limit;

calculating an average in-cell displacement between a plurality of the vertical offset belonging to a further plurality of the feature point and the matching point within the grid-cell; and

calculating an average grid displacement between a plurality of the average in-cell displacement from the grid-cell; and

wherein:

updating the first image and the second image includes minimizing the average grid displacement.

7. The method as claimed in claim 6 further comprising:

determining a variance threshold for updating the first image and the second image; and

wherein:

updating the first image and the second image includes minimizing the offset component belonging to the feature point and the matching point within the variance threshold of the average in-cell displacement.

8. The method as claimed in claim 6 further comprising:

calculating an image width of the first image for updating the first image; and

wherein:

calculating the offset component includes calculating a horizontal offset between the feature point and the matching point; and

updating the first image includes adjusting the first image having the feature point yielding the horizontal offset greater than 1% of the image width.

9. The method as claimed in claim 6 further comprising:

calculating an image width of the second image for updating the second image and the second image; and

wherein:

calculating the offset component includes calculating a horizontal offset between the feature point and the matching point; and

updating the second image includes adjusting the second image having the matching point yielding the horizontal offset greater than 1% of the image width.

10. An image processing system comprising:

a feature module for identifying a feature point on a first image;

a matching module, coupled to the feature module, for determining a matching point on a second image, with the matching point corresponding to the feature point;

an offset calculation module, coupled to the matching module, for calculating an offset component between the feature point and the matching point, with the offset component having a vertical offset;

a field identification module, coupled to the offset calculation module, for identifying a correction field for adjusting the first image and the second image, with the correction field having a vertical adjustment, a zoom adjustment, a rotational adjustment, a keystone adjustment, or a combination thereof;

an image update module, coupled to the field identification module, for updating the first image and the second image for minimizing the offset component for displaying an aligned image on a device;

a threshold module, coupled to the image update module, for determining a confidence threshold and a cell population limit for updating the first image and the second image;

an image divider module, coupled to the matching module, for dividing the first image and the second image using a grid having a grid-cell;

a texture compensation module, coupled to the image update module, for updating the first image having a plurality of the feature point within the grid-cell and second image having a further plurality of the matching point within the grid-cell exceeding the cell population limit;

a confidence module, coupled to the offset calculation module, for calculating the offset component having a confidence vector between the feature point and the matching point;

a confidence comparator module, coupled to the confidence module, for comparing the confidence vector to the confidence threshold;

an in-cell average module, coupled to the image update module, calculating an average in-cell displacement between a plurality of the vertical offset belonging to a further plurality of the feature point and the matching point within the grid-cell; and

a grid average module, coupled to the in-cell average module, for calculating an average grid displacement between the plurality of the average in-cell displacement from the grid-cell; and

wherein:

the image update module is for minimizing the average grid displacement.

11. The system as claimed in claim 10 wherein the image update module is for comparing the offset component while varying the correction field.

12. The system as claimed in claim 10 wherein:

the threshold module is for determining a variance threshold for updating the first image and the second image; and

the image update module is for minimizing the offset component belonging to the feature point and the matching point within the variance threshold of the average in-cell displacement.

13. The system as claimed in claim 10 further comprising:

an image measurement module, coupled to the feature module, for calculating an image width of the first image for updating the first image;

a horizontal offset module, coupled to the calculation module, for calculating a horizontal offset between the feature point and the matching point; and

a width comparator module, coupled to the horizontal offset module, for adjusting the first image having the feature point yielding the horizontal offset greater than 1% of the image width.

14. The system as claimed in claim 10 further comprising:

an image measurement module, coupled to the feature module, for calculating an image width of the second image for updating the second image;

a horizontal offset module, coupled to the calculation module, for calculating a horizontal offset between the feature point and the matching point; and

a width comparator module, coupled to the horizontal offset module, for adjusting the second image having the matching point yielding the horizontal offset greater than 1% of the image width.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICANT NUMBER 9047066 PREVIOUSLY RECORDED ON REEL 045352 FRAME 0687. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 3, 2018
From: SONY CORPORATION
To: SONY INTERACTIVE ENTERTAINMENT LLC
Reel/Frame 045828/0848 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 26, 2018
From: SONY CORPORATION
To: SONY INTERACTIVE ENTERTAINMENT LLC
Reel/Frame 045352/0687 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2011
From: ADAMS, DENNIS; EMMONS, DALE
To: SONY CORPORATION
Reel/Frame 025923/0628 →
Continuity (3)
Provisional Application 61377266 · Aug 26, 2010
Provisional Application 61412378 · Nov 10, 2010
Related Publication 20120051665A1 · Mar 1, 2012