IP Library › Granted Patent US 12,322,115
Granted Patent B2
US 12,322,115 · App. 17/935,277 · Granted Jun 3, 2025

Control algorithm to precisely evaluate edge quality from imagery

Inventors: Sai Vishnu Aluru (Commerce Township, MI); Michael Cervoni (Lake Orion, MI); Jonathan Patrick Agnew (Clarkston, MI); Logan Elliot Stack (Royal Oak, MI)
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
G06T7/13G06T5/10G06V10/60G06V10/761G06T2207/20056G06T2207/20132G06T2207/30168G06T2207/30268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,322,115
App. No.
17/935,277
Granted
Jun 3, 2025
Kind
B2
Abstract

A method for evaluating edge quality in an image includes receiving an image from a camera of a vehicle, detecting an edge in the image captured by the camera, fitting a polynomial curve to the edge in the image captured by the camera, executing a numerical optimizer to determine a minimum distance from each pixel in the image of the edge to the polynomial curve, determining a modulation transfer function (MTF) value using the minimum distance, determining whether the MTF value is greater than predetermined threshold, and providing an alert in response to determining that the MTF value is not greater than the predetermined threshold.

Claims (60)

1. A method for evaluating edge quality in an image, comprising:

receiving an image from a camera of a vehicle, wherein the image includes image data;

detecting an edge in the image captured by the camera;

fitting a polynomial curve to the edge in the image captured by the camera;

executing a numerical optimizer to determine a minimum distance from each pixel in the image of the edge to the polynomial curve;

determining a modulation transfer function (MTF) value using the minimum distance;

determining whether the MTF value is greater than predetermined threshold;

providing an alert in response to determining that the MTF value is not greater than the predetermined threshold;

pixel binning a plurality of pixels of the edge in the image to generate a plurality of super pixels;

determining an average luminance value for each of the plurality of super pixels;

executing an adjusted pixel binning using the average luminance value for each of the plurality of super pixels;

storing the image data in response to determining that the MTF value is greater than predetermined threshold; and

determining an edge spread function of the edge using the plurality of super pixels.

2. The method of claim 1 , further comprising determining a line spread function of the edge using the edge spread function, wherein the line spread function is a first derivative of the edge spread function.

3. The method of claim 2 , wherein determining the MTF value using the minimum distance includes determining the MTF value using the line spread function, wherein the MTF is a Fast Fourier transform of the line spread function.

4. The method of claim 1 , wherein detecting the edge in the image captured by the camera includes using a Canny edge detector to detect the edge in the image.

5. The method of claim 1 , wherein detecting the edge in the image captured by the camera includes using a Sobel edge detector to detect the edge in the image.

6. The method of claim 1 , further comprising cropping the image such that the edge is centered in the image, wherein the cropping is performed before fitting the polynomial curve to the edge of the image.

7. A tangible, non-transitory, machine-readable medium, comprising machine-readable instructions, that when executed by a processor, cause the processor to:

receive an image from a camera of a vehicle, wherein the image includes image data;

detect an edge in the image captured by the camera;

fit a polynomial curve to the edge in the image captured by the camera;

execute a numerical optimizer to determine a minimum distance from each pixel in the image of the edge to the polynomial curve;

determine a modulation transfer function (MTF) value using the minimum distance;

determine whether the MTF value is greater than predetermined threshold;

provide an alert in response to determining that the MTF value is not greater than the predetermined threshold;

pixel bin a plurality of pixels of the edge in the image to generate a plurality of super pixels;

determine an average luminance value for each of the plurality of super pixels;

execute an adjusted pixel binning using the average luminance value for each of the plurality of super pixels;

store the image data in response to determining that the MTF value is greater than predetermined threshold; and

determine an edge spread function using the plurality of super pixels.

8. The tangible, non-transitory, machine-readable medium of claim 7 , further comprising machine-readable instructions, that when executed by the processor, causes the processor to:

determine a line spread function using the edge spread function, wherein the line spread function is a first derivative of the edge spread function.

9. The tangible, non-transitory, machine-readable medium of claim 8 , further comprising machine-readable instructions, that when executed by the processor, causes the processor to:

determine the MTF value using the line spread function.

10. The tangible, non-transitory, machine-readable medium of claim 9 , wherein the MTF is a Fast Fourier transform of the line spread function.

11. The tangible, non-transitory, machine-readable medium of claim 7 , further comprising machine-readable instructions, that when executed by the processor, causes the processor to:

use a Canny edge detector to detect the edge in the image.

12. The tangible, non-transitory, machine-readable medium of claim 7 , further comprising machine-readable instructions, that when executed by the processor, causes the processor to:

use a Sobel edge detector to detect the edge in the image.

13. The tangible, non-transitory, machine-readable medium of claim 7 , further comprising machine-readable instructions, that when executed by the processor, causes the processor to:

crop the image such that the edge is centered in the image, wherein the cropping is performed before fitting the polynomial curve to the edge of the image.

14. A method for evaluating edge quality in an image, comprising:

receiving an image from a camera of a vehicle, wherein the image includes image data;

detecting an edge in the image captured by the camera;

fitting a polynomial curve to the edge in the image captured by the camera;

cropping the image such that the edge is centered in the image, wherein the cropping is performed before fitting the polynomial curve to the edge of the image;

executing a numerical optimizer to determine a minimum distance from each pixel in the image of the edge to the polynomial curve;

determining a modulation transfer function (MTF) value using the minimum distance;

determining whether the MTF value is greater than predetermined threshold;

providing an alert in response to determining that the MTF value is not greater than the predetermined threshold;

pixel binning a plurality of pixels of the edge in the image to generate a plurality of super pixels;

determining an average luminance value for each of the plurality of super pixels;

executing an adjusted pixel binning using the average luminance value for each of the plurality of super pixels;

storing the image data in response to determining that the MTF value is greater than predetermined threshold;

determining an edge spread function of the edge using the plurality of super pixels; and

determining a line spread function of the edge using the edge spread function, wherein the line spread function is a first derivative of the edge spread function.

15. The method of claim 14 , wherein determining the MTF value using the minimum distance includes determining the MTF value using the line spread function, wherein the MTF is a Fast Fourier transform of the line spread function.

16. The method of claim 14 , wherein detecting the edge in the image captured by the camera includes using a Canny edge detector to detect the edge in the image.

17. The method of claim 14 , wherein detecting the edge in the image captured by the camera includes using a Sobel edge detector to detect the edge in the image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2022
From: ALURU, SAI VISHNU; CERVONI, MICHAEL; AGNEW, JONATHAN PATRICK; STACK, LOGAN ELLIOT
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 061221/0685 →
Continuity (1)
Related Publication 20240104743A1 · Mar 28, 2024
References Cited (7)
US 10067029B2 · Cardei · 2018 [cited by examiner]
US 20140195138A1 · Stelzig · 2014 [cited by examiner]
US 20180075588A1 · Hosoda · 2018 [cited by examiner]
US 20180342082A1 · Lewis · 2018 [cited by examiner]
US 20240073405A1 · Shigematsu · 2024 [cited by examiner]
Islam, Md Rashidul, et al. “A convolutional neural network for end to end structural prediction and lane detection for autonomous vehicle.” 2021 5th International Conference on Electrical Engineering and Information Com… [cited by examiner]
Xu, C., Cao, J., Yong, A., Zhang, Z., & Liu, H. (2022). Study on Sharpness Evaluation Method of Vehicle Imaging System. In Interdisciplinary Research for Printing and Packaging (pp. 113-120). Singapore: Springer Singapo… [cited by examiner]
Cited By (2)
US 12,412,277 US 12,638,764