IP Library › Granted Patent US 12,700,074
Granted Patent B2
US 12,700,074 · App. 18/559,741 · Granted Aug 4, 2026

Method, data processing system, computer program product and computer readable medium for determining image sharpness

Inventors: Péter Dániel Kozma (Budapest, HU); Mátyás Léránt-Nyeste (Budapest, HU)
Assignee: aiMotive Kft.
G06T7/0002G06T7/344G06T11/26G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,700,074
App. No.
18/559,741
Filed
Nov 8, 2023
Granted
Aug 4, 2026
Kind
B2
Art Unit
2668
USPC
382/108
Abstract

The invention is a method for determining whether an input image is sufficiently sharp, comprising the steps of providing a blur score threshold value, inputting the input image to an image processing system, generating, by the image processing system, a two-dimensional frequency spectrum of the input image, generating a one-dimensional frequency spectrum from the two-dimensional frequency spectrum, fitting a straight line on the one-dimensional frequency spectrum, and determining a blur score value based on a residual of the fitting, and considering the input image as sufficiently sharp based on a comparison of the blur score value with the blur score threshold value. The invention further relates to a data processing system, a computer program product and a computer readable medium carrying out the above method.

Claims (39)

1 . A method for determining whether an input image is sufficiently sharp, comprising the steps of

providing a blur score threshold value,

inputting the input image to an image processing system,

generating, by the image processing system, a two-dimensional frequency spectrum of the input image,

generating a one-dimensional frequency spectrum from the two-dimensional frequency spectrum,

fitting a straight line on the one-dimensional frequency spectrum, and

determining a blur score value based on a residual of the fitting, and considering the input image as sufficiently sharp based on a comparison of the blur score value with the blur score threshold value,

wherein providing the blur score threshold value comprises making a decision on the basis of empirical data between a first scenario and a second scenario, wherein in said first scenario, the blur score threshold value is a predetermined value, and in said second scenario, the blur score threshold value is determined by the following steps:

generating a blurred image from the input image,

generating, by an image processing system, a further two-dimensional frequency spectrum of the blurred image,

generating a further one-dimensional frequency spectrum from the further two-dimensional frequency spectrum, and

fitting a further straight line on the further one-dimensional frequency spectrum, wherein the blur score threshold value is based on a residual of the fitting.

2 . The method according to claim 1 , characterized in that the one-dimensional frequency spectrum is generated from a two-dimensional amplitude spectrum of the two-dimensional frequency spectrum.

3 . The method according to claim 2 , characterized by calculating a logarithm of the two-dimensional amplitude spectrum, wherein the one-dimensional frequency spectrum is generated from the logarithm of the two-dimensional amplitude spectrum.

4 . The method according to claim 2 , characterized in that the one-dimensional frequency spectrum is a histogram having bins corresponding to frequency ranges of the two-dimensional frequency spectrum and histogram values for each bin, wherein each histogram value is an average amplitude or an integrated amplitude within the corresponding frequency range.

5 . The method according to claim 1 , characterized in that the two-dimensional frequency spectrum is centralized, and the one-dimensional frequency spectrum is generated by radial averaging.

6 . The method according to claim 1 , characterized in that the two-dimensional frequency spectrum of the input image is generated by a two-dimensional Fourier-transform or a two-dimensional wavelet transform.

7 . The method according to claim 1 , characterized in that the straight line is fitted by a linear regression method.

8 . The method according to claim 1 , characterized in that in the second scenario the blurred image is generated by a blurring having a blur parameter, and the blur parameter is determined by the following steps:

taking a sharp image,

generating a series of blurred images based on the sharp image by applying a series of subsequent blurring,

calculating a blur score value for each one of the series of blurred images, and

selecting the blur parameter corresponding to a minimum of the blur score values of the series of the blurred images.

9 . The method according to claim 1 , characterized in that the blurred image is generated by a Gaussian blurring.

10 . The method according to claim 8 , characterized in that the further two-dimensional frequency spectrum is generated the same way as the two-dimensional frequency spectrum, the further one-dimensional frequency spectrum is generated the same way as the one-dimensional frequency spectrum, and the further straight line is fitted the same way as the straight line.

11 . The method according to claim 1 , characterized in that the comparison of the blur score value and the blur score threshold value is implemented by generating a difference score value by subtracting the blur score threshold value from the blur score value, wherein difference score values having a positive value or a non-negative value indicate that the input image is sufficiently sharp.

12 . The method according to claim 1 , characterized in that the comparison of the blur score value and the blur score threshold value is implemented by generating a score ratio by dividing the blur score value with the blur score threshold value, wherein score ratios having a value greater than 1 or not less than 1 indicate that the input image is sufficiently sharp.

13 . A data processing system comprising means for carrying out the steps of the method according to claim 1 .

14 . A non-transitory computer program product comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method of claim 1 .

15 . A non-transitory computer readable medium comprising instructions which, when executed by a computer, cause the computer to:

provide a blur score threshold value,

input the input image to an image processing system,

generate a two-dimensional frequency spectrum of the input image,

generate a one-dimensional frequency spectrum from the two-dimensional frequency spectrum,

fit a straight line on the one-dimensional frequency spectrum, and

determine a blur score value based on a residual of the fitting, and considering the input image as sufficiently sharp based on a comparison of the blur score value with the blur score threshold value, wherein the comparison is implemented by generating a score ratio by dividing the blur score value with the blur score threshold value, wherein score ratios having a value greater than 1 or not less than 1 indicate that the input image is sufficiently sharp.

16 . The method of claim 5 , wherein a frequency corresponding to a zero frequency is arranged in a centre of the two-dimensional frequency spectrum and frequencies increase radially outwards from the centre.

17 . The method of claim 8 , wherein calculating the blur score value comprises:

calculating the blur score value by generating a further two-dimensional frequency spectrum of each blurred image, by generating a further one-dimensional frequency spectrum of the further two-dimensional frequency spectrum, and by fitting a further straight line on the further one-dimensional frequency spectrum, wherein the blur score value is determined based on a residual of the fitting.

Priority Claims (1)
HU 2100190 · May 10, 2021 · national
Continuity (1)
Related Publication 20240233104A1 · Jul 11, 2024
References Cited (22)
US 10574980B1 · Batiz · 2020 [cited by examiner]
US 20040120598A1 · Feng · 2004 [cited by examiner]
US 20040156559A1 · Cheng et al. · 2004 [cited by applicant]
US 20050099536A1 · Zhu · 2005 [cited by examiner]
US 20070252907A1 · Hsu · 2007 [cited by examiner]
US 20080226148A1 · Gu · 2008 [cited by examiner]
US 20100246977A1 · Fu · 2010 [cited by examiner]
US 20120082385A1 · Xu · 2012 [cited by examiner]
US 20140003734A1 · Umansky et al. · 2014 [cited by applicant]
US 20170178296A1 · Li · 2017 [cited by examiner]
US 20190215438A1 · Lee · 2019 [cited by examiner]
US 20210264587A1 · Kobayashi · 2021 [cited by examiner]
CA 2562480A1 · 2008 [cited by applicant]
KR 101570602B1 · 2015 [cited by applicant]
Minin, P., & Shumilov, Y. (2017). Sharpness estimation in facial images by spectrum approximation. Signal, Image and Video Processing, 11(1), 163-170. (Year: 2017). [cited by examiner]
E. Mavridaki and V. Mezaris, “No-reference blur assessment in natural images using Fourier transform and spatial pyramids,” 2014 IEEE International Conference on Image Processing (ICIP), Paris, France, 2014, pp. 566-570… [cited by examiner]
M. S. Hosseini, J. A. Z. Brawley-Hayes, Y. Zhang, L. Chan, K. N. Plataniotis and S. Damaskinos, “Focus Quality Assessment of High-Throughput Whole Slide Imaging in Digital Pathology,” in IEEE Transactions on Medical Ima… [cited by examiner]
C. T. Vu, T. D. Phan and D. M. Chandler, “S3 : a Spectral and Spatial Measure of Local Perceived Sharpness in Natural Images,” 2012. (Year: 2012). [cited by examiner]
Minin Peter et al: “Sharpness estimation in facial images by spectrum approximation”, Signal Image and Video Processing, Springer London, London, vol. 11, No. 1, Jul. 5, 2016, pp. 163-170. [cited by applicant]
Lu Qingbo et al: “A no-reference Image sharpness metric based on structural information using sparse representation”, Information Sciences, Elsevier, Amsterdam, NL, vol. 369, Jun. 27, 2016, pp. 334-346. [cited by applicant]
PCT/HU2022/050043 International Preliminary Report on Patentability dated Apr. 25, 2023. [cited by applicant]
PCT/HU2022/050043 International Search Report dated Aug. 25, 2022. [cited by applicant]