IP Library › Granted Patent US 12,670,563
Granted Patent B2
US 12,670,563 · App. 18/141,528 · Granted Jun 30, 2026

Image recovery apparatus and removing aberrations in an acquired image from imperfect imaging optics

Inventors: Ian Bairstow Spielman (North Potomac, MD); Emine Altuntas (Germantown, MD)
Assignee: GOVERNMENT OF THE UNITED STATES OF AMERICA, AS REPRESENTED BY THE SECRETARY OF COMMERCE
G06T5/80G06T5/50G06T7/0012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,670,563
App. No.
18/141,528
Granted
Jun 30, 2026
Kind
B2
Abstract

A process for removing aberrations in an acquired image from imperfect imaging optics includes: acquiring an acquired image of an object with an imperfect imaging system that includes an imperfect imaging optic, the acquired image including a plurality of pixels; producing a prior that includes an expectation of data for the object; determining a pixel-by-pixel uncertainty of the acquired image; determining a total transfer function of the acquired image from the prior and the acquired image; and determining a data vector from the total transfer function and the acquired image to remove aberrations from the acquired image.

Claims (111)

1 . A computer implemented process for removing aberrations in an acquired image from imperfect imaging optics, the process comprising: acquiring an acquired image of an object with an imperfect imaging system that comprises an imperfect imaging optic, the acquire comprising a plurality of pixels; producing a prior that comprises an expectation of data for the object; determining a pixel-by-pixel uncertainty of the acquired image; determining a total transfer function h k of the acquired image from the prior and the acquire image; and determining a data vector d from the total transfer function h k and the acquired image to remove aberrations from the acquired image; wherein the total transfer function hk is provided by

h

t

⁢

o

⁢

t

(

k

⊥

)

=

1

4

+

δ

¯

2

⁢

h

DOF

(

k

⊥

)

⁢

h

E

(

k

⊥

)

h

E

(

0

)

⁢

e

i

⁡

(

φ

-

θ

)

.

2 . The process of claim 1 , further comprising converting the acquired image to vector m j .

3 . The process of claim 1 , wherein the prior is set to zero if there is no expectation of data.

4 . The process of claim 1 , wherein the prior is provided by a Gaussian distribution function.

5 . The process of claim 1 , wherein the expectation comprises information about the object or information about the imperfect imaging system.

6 . The process of claim 1 , wherein determining the pixel-by-pixel uncertainty of the acquired image comprises accounting for photon shot noise of a digital imaging device of the imperfect imaging system that acquired the acquired image.

7 . The process of claim 6 , wherein accounting for the photon shot noise comprises obtaining the square root of the pixel values of the acquired image.

8 . The process of claim 6 , further comprising performing background subtraction on the acquired image prior to determining the pixel-by-pixel uncertainty of the acquired image.

9 . The process of claim 6 , wherein determining the pixel-by-pixel uncertainty of the acquired image comprises accounting for readout noise of the imperfect imaging system that acquired the acquired image.

10 . The process of claim 8 , further comprising, after performing background subtraction, replacing any negative values of the pixel values with a positive value.

11 . The process of claim 10 , wherein the positive value is the smallest positive number of all of the pixels.

12 . The process of claim 10 , wherein the positive value is obtained by averaging pixel values of neighboring pixels.

13 . The process of claim 1 , wherein determining the total transfer function h k comprises determining aberrations in the acquired image, the aberrations comprising attenuation y and phase shift B.

14 . The process of claim 1 , wherein the data vector d is an optimal reconstructed image.

15 . The process of claim 1 , wherein determining the data vector d comprises numerically solving linear equations with a conjugate gradient method.

16 . The process of claim 1 , further comprising estimating a Fourier pupil function of the imperfect imaging system.

17 . The process of claim 16 , wherein estimating the Fourier pupil function comprises determining a density correlation.

18 . The process of claim 16 , wherein estimating the Fourier pupil function comprises determining aberrations in the acquired image from a diffraction pattern in the acquired image.

19 . The process of claim 16 , wherein estimating the Fourier pupil function comprises determining a point spread function and obtaining even order aberrations from the point spread function.

20 . The process of claim 16 , further comprising producing a polynomial a plurality of loss coefficients as a result of estimating the Fourier pupil function of the imperfect imaging system.

21 . The process of claim 20 , further comprising quantifying the spatial structure of the object as the pixel-by-pixel uncertainty of the acquired image.

22 . A computer implemented process for removing aberrations in an acquired image from imperfect imaging optics, the process comprising: acquiring an acquired image of an object with an imperfect imaging system that comprises an imperfect imaging optic, the acquired image comprising a plurality of pixels; producing a prior that comprises an expectation of data for the object; determining a pixel-by-pixel uncertainty of the acquired image; determining a total transfer function h k of the acquired image from the prior and the acquired image; and determining a data vector d from the total transfer function h k and the acquired image to remove aberrations from the acquired image; wherein, in determining the total transfer function h k , the attenuation γ and the phase shift β are accounted for by the following forward transfer function h E

h

E

(

k

⊥

)

=

e

-

γ

⁡

(

k

⊥

)

+

i

⁢

β

⁡

(

k

⊥

)

.

23 . A computer implemented process for removing aberrations in an acquired image from imperfect imaging optics, the process comprising: acquiring an acquired image of an object with an imperfect imaging system that comprises an imperfect imaging optic, the acquired image comprising a plurality of pixels; producing a prior that comprises an expectation of data for the object; determining a pixel-by-pixel uncertainty of the acquired image; determining a total transfer function h k of the acquired image from the prior and the acquired image; and determining a data vector d from the total transfer function h k and the acquired image to remove aberrations from the acquired image; further comprising verifying a statistical likelihood of the data vector d based on the acquired image and the pixel-by-pixel uncertainty of the acquired image, wherein verifying the statistical likelihood of the data vector d comprises evaluating

(

Hd

-

m

)

†

⁢

E

¯

-

1

(

Hd

-

m

)

.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 2, 2025
From: SPIELMAN, IAN BAIRSTOW
To: GOVERNMENT OF THE UNITED STATES OF AMERICA, AS REPRESENTED BY THE SECRETARY OF COMMERCE
Reel/Frame 070714/0400 →
Continuity (2)
Provisional Application 63336315 · Apr 29, 2022
Related Publication 20230351559A1 · Nov 2, 2023
References Cited (23)
US 20030210344A1 · Bloom · 2003 [cited by examiner]
US 20040066910A1 · De Villiers · 2004 [cited by examiner]
US 20060139494A1 · Zhou · 2006 [cited by examiner]
US 20070002158A1 · Robinson · 2007 [cited by examiner]
US 20080262806A1 · Vau · 2008 [cited by examiner]
US 20090263002A1 · Cremer · 2009 [cited by examiner]
US 20100299113A1 · Robinson · 2010 [cited by examiner]
US 20110096207A1 · Izumi · 2011 [cited by examiner]
US 20130105689A1 · Bischoff · 2013 [cited by examiner]
US 20130343669A1 · Fattal · 2013 [cited by examiner]
US 20150181131A1 · Kerwien · 2015 [cited by examiner]
US 20150317771A1 · Kato · 2015 [cited by examiner]
US 20200265555A1 · Elgendy · 2020 [cited by examiner]
US 20220261966A1 · Liu · 2022 [cited by examiner]
US 20220277427A1 · Bromberg · 2022 [cited by examiner]
G. Desiderá et al. Application of iterative blind deconvolution to the reconstruction of LBT LINC-NIRVANA images, Feb. 11, 2006, Università di Genova (Year: 2006). [cited by examiner]
Moulakaki AI, Del Águila-Carrasco AJ, Esteve-Taboada JJ, Montés-Micó R. Effect of even and odd-order aberrations on the accommodation response. Int J Ophthalmol. Jun. 18, 2017; 10(6):955-960. (Year: 2017). [cited by examiner]
Minglu Sun, Xiong Chen, Youqiang Zhu, Dayu Li, Quanquan Mu, and Li Xuan, “Neural network model combined with pupil recovery for Fourier ptychographic microscopy,” Opt. Express 27, 24161-24174 (Year: 2019). [cited by examiner]
Turner, L.D., et al., “Diffraction-contrast imaging of cold atoms”, Physical Review A, 2005, p. 031403, vol. 72. [cited by applicant]
Perry, A.R., et al., “Multiple-camera defocus imaging of ultracold atomic gases”, Optics Express, 2021, p. 17029, vol. 29 No.11 [cited by applicant]
Penczek, P.A., et al., “Three Dimensional Reconstruction With Contrast Transfer Compensation From Defocus Series”, Scanning Microscopy, 1997, p. 147-154, vol. 11. [cited by applicant]
Fienup, J.R., et al., “Hubble Space Telescope Characterized by Using Phase-Retrieval Algorithms”, Applied Optics, 993, p. 1747-1767, vol. 32 No. 10. [cited by applicant]
Altuntas, E., et al., “Self-Bayesian aberration removal via constraints for ultracold atom microscopy”, Physical Review Research, 2021, p. 043087, vol. 3. [cited by applicant]