Granted Patent B2

US 7,064,770 · App. 10/939,044 · Granted Jun 20, 2006

Abstract

Claims (34)

1. A digital signal processing method for optimized hardware and software implementation of single-pass digital image resampling with an anisotropic filter to transform a two-dimensional video input image having an input pixel coordinate space and input digital pixel data, into an output image having an output pixel coordinate space and output digital pixel data, said method comprising:

(a) obtaining two-dimensional video input digital image data for an output pixel;

(b) mapping the output pixel coordinates onto the input image coordinate space to determine a mapped coordinate position;

(c) determining the Jacobian matrix of the output pixel coordinates with respect to the input coordinates at the mapped coordinate position determined in (b);

(d) determining major and minor radii and the orientation of the major radius to uniquely determine an ellipse around the mapped coordinate position determined in (b), formed by two row vectors of the determined Jacobian matrix in (c);

(e) extending and adjusting the radii of said ellipse based on a required image quality and a required processing speed;

(f) determining a footprint based on the result of (e) in the input image coordinate space around said mapped coordinate position determined in (b), to include input pixels participating in the filtering;

(g) transforming the ellipse of (d) into a circle having a radius of one unit to facilitate distance calculation of the included input pixels from the center of the circle;

(h) determining coefficients of the anisotropic filter for all input pixels in the footprint from a circularly symmetric profile as a function of the distance in (g);

(i) determining the value of the output pixel by accumulating values of the input pixels inside the footprint with coefficients determined in (h); and

saving the value of the output pixel.

2. The method of claim 1 , wherein the radii and the orientation of said ellipse are characterized via a 2×2 matrix, and wherein at least one element of said matrix is forced to be zero.

3. The method of claim 2 , wherein pre-calculated values of non-zero elements of said 2×2 matrix in a subset of output pixels are surface pre-fitted, and wherein the matrix elements for an output pixel are evaluated from the fitting parameters during resampling.

4. The method of claim 1 , wherein the major radius of said ellipse is aligned alongside an edge orientation perpendicular to the direction of the greatest intensity variation in the mapped input pixel position, and the lengths of the radii depend on the strength of the edge characterized by the confidence level of the edge orientation estimate.

5. The method of claim 1 wherein an elliptical footprint is used, and wherein the method uses a two-dimensional resampling filter with elliptical frequency response controlled by a matrix derived from said Jacobian matrix.

6. The method of claim 1 wherein a fixed size rectangular footprint is used, and wherein the method uses a two-dimensional resampling filter with elliptical frequency response controlled by a matrix derived from said Jacobian matrix.

7. The method of claim 1 , further combining profiles of sharpening and resampling components of the filter, to produce a detail enhanced output image.

8. A digital signal processing system for optimized hardware and software implementation of single-pass digital image resampling with an anisotropic filter to transform a two-dimensional video input image having an input pixel coordinate space and input digital pixel data, into an output image having an output pixel coordinate space and output digital pixel data, said system comprising the following stages:

(a) an input interface for obtaining two-dimensional video input digital image data for an output pixel;

(b) a coordinates generator for mapping the output pixel coordinates onto the input image coordinate space to determine a mapped coordinate position;

(c) a local scale estimator, coupled to said input interface and said coordinate generator, for determining the Jacobian matrix of the output pixel coordinates with respect to the input coordinates at the mapped coordinate position;

(d) said local scale estimator, being further adapted for determining the major and minor radii and the orientation of the major radius to uniquely determine an ellipse around the mapped coordinate position, formed by two row vectors of the determined Jacobian matrix in (c);

(e) said local scale estimator, being further adapted to extend and adjust the radii of said ellipse based on a required image quality and a required processing speed;

(f) a footprint generator, coupled to said local scale estimator and said coordinates generator, for determining a footprint in the input image coordinate space around the mapped coordinate position, to include input pixels participating in the filtering;

(g) a filter coefficients generator, coupled to said footprint generator and said local scale estimator, to transform the ellipse of (d) into a circle having a radius of one unit to facilitate distance calculation of the included input pixels from the center of the circle;

(h) said filter coefficient generator, being further adapted to determine coefficients of the anisotropic filter for input pixels in the footprint from a circularly symmetric profile as a function of the distance in (g);

(i) a filter, coupled to said filter coefficient generator and said footprint generator, to determine the value of the output pixel by accumulating values of the input pixels inside the footprint with coefficients determined in (h); and

(j) an output interface, coupled to said filter, to save the value of the output pixel.

9. The system of claim 8 , wherein said local scale estimator is adapted to characterize the radii and the orientation of said ellipse via a 2×2 matrix, and wherein at least one element of said 2×2 matrix is forced to be zero.

10. The system of claim 9 , wherein pre-calculated values of non-zero elements of said 2×2 matrix in a subset of output pixels are surface pre-fitted and said local scale estimator is adapted to evaluate the matrix elements for an output pixel from the fitting parameters during resampling.

11. The system of claim 8 , wherein said local scale estimator is adapted to align the major radius of said ellipse alongside an edge orientation perpendicular to the direction of the greatest intensity variation in the mapped input pixel position, and set the lengths of the radii based on the strength of the edge characterized by the confidence level of the edge orientation estimate.

12. The system of claim 8 , wherein said footprint generator is adapted to use an elliptical footprint and said filter coefficients generator is adapted to use a two-dimensional resampling filter with elliptical frequency response controlled by a matrix derived from said Jacobian matrix.

13. The system of claim 8 , wherein said footprint generator is adapted to use a fixed size rectangular footprint and said filter coefficients generator is adapted to use a two-dimensional resampling filter with elliptical frequency response controlled by a matrix derived from said Jacobian matrix.

14. The system of claim 8 , wherein said filter coefficients generator is adapted to combine profiles of sharpening and resampling components of the resampling filter to produce a detail enhanced output image.

Assignments (14)