IP Library Granted Patent US 7,126,616
Granted Patent B2
US 7,126,616 · App. 10/167,375 · Granted Oct 24, 2006

Method and system for processing a non-linear two dimensional spatial transformation

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,126,616
App. No.
10/167,375
Filed
Jun 12, 2002
Granted
Oct 24, 2006
Kind
B2
Art Unit
2672
USPC
345/645
Abstract

An image transformation method for translating a non-linear 2D geometrical transformation into two separable 1D geometrical transformations first determines the inverse of the 2D geometrical transformation to form an inverse 2D geometrical transformation. Then the method converts the inverse 2D geometrical transformation into an analytical inverted 2D geometrical transformation and separates the analytical inverse 2D geometrical transformation into first and second 1D geometrical transformations. The method then represents said inverse 2D geometrical transformation and first and second 1D geometrical transformations as tensor spline surfaces and then compares an evaluation of said first and second 1D geometrical transformations at each pixel with an evaluation of the analytical inverse 2D geometrical transformation at each pixel. If the error evaluation does not meet a predetermined level of performance then the separation and transformation steps are repeated. Since the method involves one-dimensional spatial transform processing it results in reduced calculations, efficient memory access, and ability to process data in a real-time environment. In-addition, since the method provides a compact representation of the spatial transforms, it can be scaled for a particular level of precision.

Claims (32)

1. An electronic method for non-linear two-dimensional (2D) digital image transformation of an input image having a plurality of input pixels onto an output image having a plurality of output pixels, said method comprising:

(a) determining the inverse of the non-linear 2D geometrical transformation to form an inverse 2D geometrical transformation;

(b) converting the inverse 2D geometrical transformation into an analytical inverted 2D geometrical transformation;

(c) separating the analytical inverse 2D geometrical transformation into a first and second 1D geometrical transformations;

(d) representing said first and second 1D geometrical transformations as transformation surfaces;

(e) approximating said surfaces of (d) with offset polynomials and target increment polynomials for hardware implementation; and

(f) comparing an evaluation of said first and second 1D geometrical transformations at each pixel with an evaluation of the analytical inverse 2D geometrical transformation at each pixel and repeating steps (c), (d) and (e) until said evaluation meets a predetermined level of performance.

2. The method of claim 1 , further comprising the step of performing a geometric transformation on the inverse map, between steps (b) and (c).

3. The method of claim 1 , wherein said inverse 2D geometrical transformation must be defined on a uniform point mapping grid.

4. The method of claim 1 , wherein said inverse 2D geometrical transformation is applied in combination with a scaling map.

5. An electronic system for non-linear two-dimensional (2D) digital image transformation of an input image having a plurality of input pixels onto an output image having a plurality of output pixels, said system comprising:

(a) a processor to determine the inverse of the non-linear 2D geometrical transformation to form an inverse 2D geometrical transformation;

(b) a converter, coupled to said processor, to convert the inverse 2D geometrical transformation into an analytical inverted 2D geometrical transformation;

(c) a separator, coupled to said converter, to separate the analytical inverse 2D geometrical transformation into first and second 1D geometrical transformations;

(d) a surface function estimator, coupled to said separator, to represent said first and second 1D geometrical transformations as transformation surfaces;

(e) a fitting stage, coupled to said surface function estimator, to approximate said surfaces of (d) with offset polynomials and target increment polynomials for hardware implementation; and,

(f) an error analysis stage, coupled to said filling stage, to compare an evaluation of said first and second 1D geometrical transformations at each pixel with an evaluation of the analytical inverse 2D geometrical transformation at each pixel and to repeat steps (c), (d) and (e) until said evaluation meets a predetermined level of performance.

6. The image transformation system of claim 5 , further comprising a geometrical module coupled to the processor for performing a geometric transformation on the inverse map.

7. The image transformation system of claim 5 , wherein said inverse 2D geometrical transformation must be defined on a uniform point mapping grid.

8. The image transformation system of claim 5 , wherein said inverse 2D geometrical transformation is applied in combination with a scaling map.

9. The method of claim 1 , wherein the offset and target increment polynomials are sampled on a uniform grid for economic hardware implementation, and wherein at each given position, said polynomials are interpolated to estimated the value of these polynomials at the given position.

10. The method of claim 1 , wherein each 1D geometrical transformation in (d) is divided into segments and for each segment, the transformation is computed separately.

11. The method of claim 10 , wherein the degree of the offset polynomials and the degree of the target increment polynomials in each segment is determined according to the complexity of the geometrical transformation in that segment.

12. The method of claim 1 used for optical and geometric distortion correction of an image acquisition system.

13. The method of claim 1 used for optical and geometric distortion correction of an image display system.

14. The method of claim 1 used for optical and geometric distortion correction of a combined image acquisition and image display system.

15. The system of claim 5 , further adapted to sample the offset and target increment polynomials on a uniform grid for economic hardware implementation, at each given position, adapted to interpolate said polynomials to estimate the value of these polynomials at the given position.

16. The system of claim 5 , further adapted to divide each 1D geometrical transformation in (d) into segments and for each segment, to compute the transformation separately.

17. The system of claim 16 , further adapted to determine the degree of the offset polynomials and the degree of the target increment polynomials in each segment according to the complexity of the geometrical transformation in that segment.

18. The system of claim 5 adapted for optical and geometric distortion correction of an image acquisition system.

19. The system of claim 1 adapted for optical and geometric distortion correction of an image display system.

20. The system of claim 1 adapted for optical and geometric distortion correction of a combined image acquisition and image display system.

Assignments (11)
RELEASE OF SECURITY INTEREST Recorded Mar 4, 2023
From: EAST WEST BANK
To: GEO SEMICONDUCTOR INC.
Reel/Frame 062955/0700 →
SECURITY INTEREST Recorded Jul 26, 2022
From: GEO SEMICONDUCTOR INC.
To: EAST WEST BANK
Reel/Frame 060925/0979 →
RELEASE OF SECURITY INTEREST Recorded Jul 23, 2022
From: CRESCENT COVE CAPITAL II, LP
To: GEO SEMICONDUCTOR, INC.
Reel/Frame 060840/0079 →
RELEASE OF SECURITY INTEREST Recorded May 31, 2019
From: ROADMAP GEO LP III
To: GEO SEMICONDUCTOR INC.
Reel/Frame 049334/0793 →
RELEASE OF SECURITY INTEREST Recorded May 31, 2019
From: SCOTT LAKE HOLDINGS INC.
To: GEO SEMICONDUCTOR INC.
Reel/Frame 050340/0516 →
SECURITY INTEREST Recorded May 31, 2019
From: GEO SEMICONDUCTOR INC.
To: CRESCENT COVE CAPITAL II, LP
Reel/Frame 049337/0040 →
RELEASE OF SECURITY INTEREST Recorded May 30, 2019
From: 180 DEGREE CAPITAL CORP.
To: GEO SEMICONDUCTOR INC.
Reel/Frame 049320/0777 →
RELEASE OF SECURITY INTEREST Recorded May 24, 2019
From: BISHOPSGATE HOLDINGS CORPORATION
To: GEO SEMICONDUCTOR INC.
Reel/Frame 049286/0365 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NO. FROM US12027189 TO PCTUS1227189 PREVIOUSLY RECORDED ON REEL 044958 FRAME 0828. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Mar 1, 2018
From: GEO SEMICONDUCTOR INC.
To: ROADMAP GEO LP III, AS ADMINISTRATIVE AGENT
Reel/Frame 045482/0808 →
SECURITY INTEREST Recorded Dec 26, 2017
From: GEO SEMICONDUCTOR INC.
To: ROADMAP GEO LP III, AS ADMINISTRATIVE AGENT
Reel/Frame 044958/0828 →
SECURITY INTEREST Recorded Dec 20, 2017
From: GEO SEMICONDUCTOR INC.
To: SCOTT LAKE HOLDINGS INC.
Reel/Frame 044957/0529 →