IP Library Granted Patent US 12,399,461
Granted Patent B1
US 12,399,461 · App. 17/545,371 · Granted Aug 26, 2025

Totagraphy: coherent diffractive/digital information reconstruction by iterative phase recovery using reference wave

Inventor: Okan Ersoy (West Lafayette, IN)
Assignee: WAVEFRONT ANALYSIS SYSTEMS LLC
G03H1/0891G03H1/00G01J9/02G03H1/16G03H2226/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,399,461
App. No.
17/545,371
Granted
Aug 26, 2025
Kind
B1
Abstract

A totagram is produced by an iterative spectral phase recovery process resulting in complete information recovery using special masks and using a reference beam. Using these special masking systems reduce computation time, number of masks, and number of iterations. Adding a reference wave to the iterative process provides better phase recovery systems and aid in the preventing of phase wrapping. The reference wave is added on-axis to provide a well-controlled amplitude. The reference wave is added after the physical or digital transformation system and subtracted before recording the initial amplitude.

Claims (47)

1. A method for recovering phase information of an input from a coherent wave, the method comprising:

providing at least one transformation unit with an input plane and an output plane;

providing at least two masks one of which is a unity mask, each of the at least two masks configured to be disposed at the input plane;

separately applying the coherent wave at the input plane to each of the at least two masks to generate a modified input from each of the masks;

passing the modified inputs through the at least one transformation unit, wherein the at least one transformation units performs a generalized Fourier transform on each modified input to produce at its output plane a transformed modified input from each modified input;

combining a reference wave with each transformed modified input to produce a combined wave from each transformed modified input;

recording amplitude values at an array of points of each combined wave to produce phasorgrams;

associating a phase value with each point on each phasorgram to form a plurality of complex phasorgrams;

subtracting the reference wave from each of the complex phasorgrams; and

iteratively processing the plurality of complex phasorgrams after having been through subtraction, until convergence is achieved to produce a totagram constituting a reconstructed input with amplitude and phase information.

2. The method of claim 1 , wherein each mask includes an outer border that blocks an outer periphery of the coherent wave.

3. The method of claim 1 , further comprising switching from one of the at least two masks to another of the at least two masks such that the coherent wave is individually received sequentially in time by each of the at least two masks.

4. The method of claim 1 , further comprising splitting the coherent wave so that it is individually received in parallel by each of the at least two masks.

5. The method of claim 1 , wherein the at least two masks consist of the unity mask and a complex phase mask.

6. The method of claim 5 , wherein the complex phase mask comprises a bipolar binary mask.

7. The method of claim 1 , wherein the at least two masks consist of the unity mask and a pair of complementary unipolar binary masks.

8. The method of claim 1 , wherein the at least two masks are implemented in real time by optical devices including any of spatial light modulators and micromirror arrays.

9. The method of claim 1 , wherein recording is performed by an intensity sensor.

10. The method of claim 1 , further comprising, after completion, using the totagram to generate a representation of the information embedded in the reconstructed amplitude and phase.

11. The method of claim 1 , wherein the transformation unit comprises a lens system and the output plane is the focal plane of the lens system.

12. The method of claim 1 , wherein each reference wave arrives in parallel to each transformed modified input when combining.

13. A system for recovering phase information of an input from a coherent wave comprising:

a transformation unit having an input plane and an output;

at least two masks, one of which is a unity mask, each of the at least two masks being disposed at the input plane of the transformation unit for receiving the coherent wave;

wherein the at least two masks are configured to separately modify the coherent wave, and wherein the transformation unit effects a generalized Fourier transform on each of the separately modified waves to produce a transformed wave from each of the separately modified waves;

a reference wave source;

an optical beam combiner which combines the reference wave with each transformed wave to produce a combined wave from each transformed wave;

at least one sensor system configured to record amplitude values at an array of points of each combined wave to produce a phasorgram from each combined wave; and

a digital processor configured to:

associate a phase value with each point on each phasorgram to form a plurality of complex phasorgrams;

subtract the reference wave from each of the complex phasorgrams; and then iteratively process the plurality of complex phasorgrams until convergence is achieved to produce a totagram constituting a reconstructed input wave with amplitude and phase information.

14. The system of claim 13 , wherein the at least two masks consist of the unity mask and a bipolar binary mask.

15. The system of claim 13 , wherein the at least two masks consist of the unity mask and a pair of complementary unipolar binary masks.

16. The system of claim 13 , wherein each mask is surrounded by an outer border that blocks the coherent wave.

17. The system of claim 13 , wherein to iteratively process the plurality of complex phasorgrams comprises:

(a) processing the plurality of complex phasorgrams to obtain a single estimate of the input by performing on the complex phasorgrams an inverse generalized Fourier transform and averaging complex information at each point at corresponding locations;

(b) passing the single estimate of the input through a process replicating each of the masks to obtain a plurality of intermediate arrays;

(c) performing a generalized fast Fourier transform on each of the intermediate arrays, adding reference wave values to corresponding points in the transformed intermediate arrays, replacing amplitude values at each point with corresponding recorded amplitude values and then subtracting reference wave values from corresponding points to generate another plurality of complex phasorgrams; and

(d) repeating step (a) for the another plurality of complex phasorgrams followed by steps (b) and (c) until convergence is achieved, wherein upon completion the single estimate of the input is the totagram.

18. The system of claim 17 , wherein convergence is determined by any of (1) when a difference between successive single estimates reach a predetermined threshold, and (2) when a given number of iterations of step (a) is completed.

19. The system of claim 13 , wherein the at least two masks are configured so as to switch from one of the at least two masks to another of the at least two masks such that the coherent wave is individually received in sequence by each of the at least two masks.

20. The system of claim 13 , further comprising a beam splitter arranged to split the coherent wave so that it is individually received in parallel by each of the at least two masks.

21. The system of claim 13 , wherein the transformation unit comprises a lens system and the output corresponds to a focal plane of the lens system.

22. The system of claim 13 , wherein each reference wave is parallel to each transformed modified input at the optical beam combiner.

23. The system of claim 13 , wherein the masks are made from a photographic film or plate.

24. The system of claim 23 , further comprising a shutter system between the object and the at least two masks.

25. The system of claim 23 , wherein the sensor system comprises two cameras, a first camera recording the amplitude values at an array of points of a combined wave passing through the unity mask and a second camera recording the amplitude values at an array of points of a combined wave passing through the other mask.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 17, 2023
From: GERCHBERG OPHTHALMIC DISPENSING, PLLC
To: WAVEFRONT ANALYSIS SYSTEMS LLC
Reel/Frame 064279/0558 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2021
From: ERSOY, OKAN
To: GERCHBERG OPHTHALMIC DISPENSING, PLLC
Reel/Frame 058410/0801 →
References Cited (129)
US 3604778A · Burckhardt · 1971 [cited by applicant]
US 3917380A · Kato et al. · 1975 [cited by applicant]
US 4037918A · Kato · 1977 [cited by applicant]
US 4791584A · Greivenkamp, Jr. · 1988 [cited by examiner]
US 4832489A · Wyant · 1989 [cited by examiner]
US 4949389A · Allebach · 1990 [cited by examiner]
US 4953188A · Siegel · 1990 [cited by examiner]
US 5050220A · Marsh · 1991 [cited by examiner]
US 5086222A · Shibuya · 1992 [cited by examiner]
US 5274716A · Mitsuoka · 1993 [cited by examiner]
US 5426521A · Chen · 1995 [cited by examiner]
US 5454047A · Chang · 1995 [cited by examiner]
US 5768242A · Juday · 1998 [cited by examiner]
US 5835217A · Medecki · 1998 [cited by examiner]
US 6229649B1 · Woods · 2001 [cited by examiner]
US 6369932B1 · Gerchberg · 2002 [cited by applicant]
US 6545790B2 · Gerchberg · 2003 [cited by applicant]
US 6639683B1 · Tumbar · 2003 [cited by examiner]
US 6906839B2 · Gerchberg · 2005 [cited by applicant]
US 6969003B2 · Havens · 2005 [cited by examiner]
US 7079251B2 · Millerd · 2006 [cited by examiner]
US 7119953B2 · Yun · 2006 [cited by examiner]
US 7298497B2 · Millerd · 2007 [cited by examiner]
US 7460245B2 · Hill · 2008 [cited by examiner]
US 7684048B2 · Meshulach · 2010 [cited by examiner]
US 7808648B2 · Sandstrom · 2010 [cited by examiner]
US 7880820B2 · Yelleswarapu · 2011 [cited by examiner]
US 8040595B2 · Gerchberg · 2011 [cited by applicant]
US 8184298B2 · Popescu et al. · 2012 [cited by applicant]
US 8363316B2 · Asundi · 2013 [cited by examiner]
US 8520213B2 · Popescu et al. · 2013 [cited by applicant]
US 8837045B2 · Popescu et al. · 2014 [cited by applicant]
US 8941914B2 · Gerchberg · 2015 [cited by examiner]
US 9052180B2 · Popescu et al. · 2015 [cited by applicant]
US 9404857B2 · Popescu et al. · 2016 [cited by applicant]
US 9715098B2 · Babacan et al. · 2017 [cited by applicant]
US 9921111B2 · Bahk · 2018 [cited by examiner]
US 10132609B2 · Popescu et al. · 2018 [cited by applicant]
US 10162161B2 · Horstmeyer · 2018 [cited by examiner]
US 10470655B2 · Frisken · 2019 [cited by examiner]
US 11099007B2 · Goodwin · 2021 [cited by examiner]
US 11237059B1 · Ersoy · 2022 [cited by examiner]
US 12031868B2 · Ersoy · 2024 [cited by examiner]
US 20020060831A1 · Gerchberg · 2002 [cited by examiner]
US 20030030819A1 · Kuechel · 2003 [cited by examiner]
US 20050249095A1 · Tanaka et al. · 2005 [cited by applicant]
US 20070058174A1 · Hill · 2007 [cited by examiner]
US 20070268545A1 · Gluckstad · 2007 [cited by examiner]
US 20110085173A1 · Waller et al. · 2011 [cited by applicant]
US 20160004221A1 · Ayres · 2016 [cited by examiner]
US 20170003491A1 · Waller et al. · 2017 [cited by applicant]
US 20170059845A1 · Waller et al. · 2017 [cited by applicant]
US 20170146788A1 · Waller et al. · 2017 [cited by applicant]
US 20180024008A1 · Okamoto et al. · 2018 [cited by applicant]
US 20180048811A1 · Waller et al. · 2018 [cited by applicant]
US 20190107655A1 · Waller et al. · 2019 [cited by applicant]
US 20190187612A1 · Sato · 2019 [cited by applicant]
US 20190204074A1 · Goodwin · 2019 [cited by examiner]
US 20190227490A1 · Waller et al. · 2019 [cited by applicant]
US 20190310374A1 · Gerchberg et al. · 2019 [cited by applicant]
US 20190369411A1 · Piestun · 2019 [cited by examiner]
US 20200146545A1 · Kumar · 2020 [cited by examiner]
US 20200249095A1 · Milster · 2020 [cited by examiner]
US 20200403839A1 · Carvalho · 2020 [cited by examiner]
CN 108885425A · 2018 [cited by examiner]
EP 2459958B1 · 2016 [cited by examiner]
Yuan et al. “Phase Retrieval via Reweighted Wirtinger Flow,” Appl. Opt., vol. 56, No. 9, pp. 1-21, Mar. 2017. [cited by applicant]
Yurtsever et al. “Sketchy Decisions: Convex Low-Rank Matrix Optimization with Optimal Storage,” pp. 1-16, Feb. 22, 2017. [cited by applicant]
Zeng et al. “Coordinate Descent Algorithms for Phase Retrieval,” IEEE, pp. 1-13, Jun. 2017. [cited by applicant]
Zheng et al. “Wide-field, High-resolution Fourier Ptychographic Microscopy,” Nature Photonics, pp. 739-745, vol. 7, No. 9, Sep. 1, 2013. [cited by applicant]
Bourquard et al. “A practical inverse-problem approach to digital holographic reconstruction,” Optics Express, vol. 21, No. 3, pp. 3417-3433, Feb. 11, 2013. [cited by applicant]
Chandra et al. “PhasePack User Guide,” https://github.com/tomgoldstein/phasepack-matlab, pp. 1-20, Nov. 29, 2017. [cited by applicant]
Cheng et al. “Phase retrieval and diffractive imaging based on Babinet's principle and complementary random sampling,” Optics Express, vol. 23, No. 22, pp. 28874-28882, Nov. 2, 2015. [cited by applicant]
Eguchi et al. “Single-shot phase retrieval with complex diversity,” Optics Letters, vol. 44, Issue 21, pp. 5108-5112, 2019. [cited by applicant]
Horisaki, et al. “Single-shot phase imaging with a coded aperture,” Optics Letters, vol. 39, No. 22, pp. 6466-6469, Nov. 15, 2014. [cited by applicant]
Pozzi et al. “Fast Calculation of Computer Generated Holograms for 3D Photostimulation through Compressive-Sensing Gerchberg-Saxton Algorithm,” Methods and Protocols, pp. 1-11, 2019. [cited by applicant]
Acquire mass and volume information in real time with label-free, quantitative imaging for live cells, assays, tissues and organoids, Phioptics, https://phioptics.com, 3 pages, 2020. [cited by applicant]
“The Optical Computing Revolution Optalysys,” Optalysys, https://www.optalysys.com, 8 pages, 2020. [cited by applicant]
“Spacial Light Modulators,” Phase Modulation, https://www.meadowlark.com/spatial_light_modulators.php, 4 pages, 2020. [cited by applicant]
Abbey et al. “Lensless Imaging Using Broadband X-Ray Sources,” Nature Photonics, pp. 420-424, Jun. 26, 2011. [cited by applicant]
Ahderom et al. “Applications of Liquid Crystal Spatial Light Modulators in Optical Communications,” Proceedings of 5th IEEE International Conference on High Speed Networks and Multimedia Communications, Jeju Island, Kor… [cited by applicant]
Bahmani et al. “Phase Retrieval Meets Statistical Learning Theory: A Flexible Convex Relaxation,” School of Electrical and Computer Engineering, Georgia Institute of Technology, 17 pages, 2016. [cited by applicant]
Barbastathis et al. “On the Use of Deep Learning for Computational Imaging,” Optica, vol. 6, No. 8, pp. 921-943, Aug. 2019. [cited by applicant]
Bauschke, et al. “Hybrid Projection-Reflection Method for Phase Retrieval,” J. Optical Soc. Am. A, vol. 20, No. 6, pp. 1025-1034, Jun. 2003. [cited by applicant]
Bendory et al. “Fourier Phase Retrieval Uniqueness and Algorithms,” The Program in Applied and Computational Mathematics, Princeton University, pp. 1-44, 2017. [cited by applicant]
Bian et al. “Fourier Ptychographic Reconstruction Using Wirtinger Flow Optimization,” Optics Express, vol. 23, No. 4, pp. 4856-4866, 2015. [cited by applicant]
Canon U.S.A., Inc., https://www.usa.canon.com/internet/portal/us/home/products/details/cameras/eos-dslr-and-mirrorless-cameras/dslr/eos-5ds-r, 2 pages, 2020. [cited by applicant]
Candes et al. “Phaselift: Exact and Stable Signal Recovery from Magnitude Measurements via Convex Programming,” Communications on Pure and Applied Mathematics, pp. 1-31, Sep. 2011. [cited by applicant]
Candes et al. “Phase Retrieval via Matrix Completion,” Siam J. Imaging Sciences, vol. 6, No. 1, pp. 199-225, 2013. [cited by applicant]
Candes et al. “Phase Retrieval from Coded Diffraction Patterns,” Applied and Computational Harmonic Analysis, Stanford University, pp. 277-299, 2015. [cited by applicant]
Chandra et al. “Phasepack: A Phase Retrieval Library,” IEEE 13th International Conference on Sampling Theory and Applications, pp. 1-5, 2019. [cited by applicant]
Chen et al. “Phase Retrieval with One or Two Diffraction Patterns by Alternating Projection with Null Initialization,” Department of Applied Mathematics, pp. 1-41, 2015. [cited by applicant]
Chen et al. “Solving Random Quadratic Systems of Equations is Nearly as Easy as Solving Linear Systems,” Department of Mathematics and Statistics, Stanford University, pp. 1-45, May 2015. [cited by applicant]
Cheng et al. “Phase Retrieval and Diffractive Imaging Based on Babinet's Principle and Complemetary Random Sampling,” Optics Express, vol. 23, No. 22, pp. 28874-28882, Nov. 2, 2015. [cited by applicant]
Dhifallah et al. “Phase Retrieval Via Linear Programming: Fundamental Limits and Algorithmic Improvements,” Harvard University and Massachusetts Institute of Technology, pp. 1-7, 2017. [cited by applicant]
Elser “Solution of the Crystallographic Phase Problem by Iterated Projections,” Acta Crystallography Section A Foundations Crystallography, pp. 1-14, 2003. [cited by applicant]
Esroy “Diffraction, Fourier Optics and Imaging,” A Wiley-Interscience Publication, Table of Contents, Nov. 2006. [cited by applicant]
Fienup “Reconstruction of an Object from the Modules of its Fourier Transform,” Optics Letters, vol. 3, No. 1, pp. 27-29, Jul. 1978. [cited by applicant]
Fienup “Phase Retrieval Algorithms: a Comparison,” Applied Optics, vol. 21, No. 15, pp. 2758-2769, Aug. 1, 1982. [cited by applicant]
Fienup “Reconstruction of a Complex-Valued Object from the Modulus of its Fourier Transform using a Support Constraint,” Optical Society of America, vol. 4, No. 1, pp. 118-123, Jan. 1987. [cited by applicant]
Frauel et al. “Resistance of the Double Random Phase Encryption Against Various Attacks,” Optical Express, vol. 15, No. 16, pp. 10253-10265, Aug. 6, 2007. [cited by applicant]
Gabor “A New Microscopic Principle,” Nature, vol. 161, pp. 777-778, May 15, 1948. [cited by applicant]
Gerchberg, et al. “A Practical Algorithm for the Determination of Phase from Image and Diffraction Plane Pictures,” Optik, vol. 35, No. 2, pp. 237-246, 1972. [cited by applicant]
Gerchberg “Super-Resolution Through Error Energy Reduction,” Optica ACTA, vol. 21, No. 9, pp. 709-720, 1974. [cited by applicant]
Gerchberg “A New Approach to Phase Retrieval of a Wave Front,” Journal of Modern Optics, vol. 49, No. 7, pp. 1185-1196, 2002. [cited by applicant]
Goldstein et al. “Phasemax: Convex Phase Retrieval via Basis Pursuit,” pp. 1-15, 2016. [cited by applicant]
Guizar-Sicairos et al. “Phase Retrieval with Transverse Translation Diversity: A Nonlinear Optimization Approach,” Optics Express, vol. 16, No. 10, pp. 7264-7278, May 12, 2008. [cited by applicant]
Guizar-Sicairos et al. “Phase Retrieval with Fourier-Weighted Projections,”J. Optical Society Am. A, vol. 25, No. 3, pp. 701-709 Mar. 2008. [cited by applicant]
Holloway et al. “Toward Long Distance Sub-diffraction Imaging Using Coherent Camera Arrays,” IEEE Tran. Computational Imaging, vol. 2, Issue 3, pp. 1-13, Sep. 2016. [cited by applicant]
Holloway et al. “SAVI: Synthetic Apertures for Long Range Sub-diffraction-Limited Visible Imaging Using Fourier Ptychography,” Science Advances, vol. 3, No. 4, pp. 1-11, Apr. 14, 2017. [cited by applicant]
Isil et al. “Deep Iterative Reconstruction for Phase Retrieval,” Applied Optics, vol. 58, pp. 1-14, Aug. 20, 2019. [cited by applicant]
Jaganathan et al. “Phase Retrieval: An Overview of Recent Developments,” Department of Electrical Engineering Caltech and Israel Institute of Technology, pp. 1-24, 2015. [cited by applicant]
Li et al. “On Gradient Descent Algorithm for Generalized Phase Retrieval Problem,” pp. 1-14, 2016. [cited by applicant]
Luke “Relaxed Averaged Alternating Reflections for Diffraction Imaging,” Inverse Problems, vol. 21, pp. 37-50, 2005. [cited by applicant]
Mahajan “Zernike Circle Polynomials and Optical Aberrations of Systems with Circular Pupils,” Engineering and Laboratory Notes, R.R. Shannon, Editor, Supplement to Applied Optics, pp. 8121-8124, Dec. 1994. [cited by applicant]
Marchesini “Phase Retrieval and Saddle-Point Optimization,” Journal Optical Society of America, vol. 24, No. 10, pp. 3289-3296, Oct. 2007. [cited by applicant]
Metzler et al. “Coherent Inverse Scattering via Transmission Matrices: Efficient Phase Retrieval Algorithms and a Public Dataset.” In Computational Photography (ICCP), 2017 IEEE International Conference, pp. 1-16, May 2… [cited by applicant]
Millane “Phase Retrieval in Crystallography and Optics,” Journal Optical Society of America, vol. 7, No. 3, pp. 394-411, Mar. 1990. [cited by applicant]
Misell “A Method for the Solution of the Phase Problem in Electron Microscopy,” Journal of Physics D: Applied Physics, vol. 6, pp. L6-L10, 1973. [cited by applicant]
Mondelli et al. “Fundamental Limits of Weak Recovery with Applications to Phase Retrieval,” Proceedings of Machine Learning Research, 31 Annual Conference on Learning Theory, vol. 75, pp. 1-6, 2018. [cited by applicant]
Refregier “Optical Image Encryption based on Input Plane and Fourier Plane Random Encoding,” Optic Letters, vol. 20, No. 7, pp. 767-769, Apr. 1, 1995. [cited by applicant]
Rivenson et al. “Phase Recovery and Holographic Image Reconstruction Using Deep Learning in Neural Networks,” Light: Science & Applications, vol. 7, pp. 1-9, 2018. [cited by applicant]
Rodenburg et al. “Ptychography and Related Diffractive Imaging Methods,” Advances in Imaging and Electron Physics, vol. 150, pp. 87-184, 2008. [cited by applicant]
Rodriguez et al, “Oversampling Smoothness: an Effective Algorithm for Phase Retrieval of Noisy Diffraction Intensities,” Journal of Applied Crystallography, vol. 46, pp. 312-318 , 2013. [cited by applicant]
Spence “Diffractive (Lensless) Imaging,” Ch. 19, Science of Microscopy, edited by P.W. Hawkes, J. C.H. Spence, Springer, pp. 1-2, 2007. [cited by applicant]
Turpin et al. “Theory of the Synthetic Aperture Microscope,” Proceedings of SPIE, Advanced Imaging Technologies and Commercial Applications, vol. 2566, pp. 230-240, Aug. 23, 1995. [cited by applicant]
Wang et al. “Solving Almost all Systems of Random Quadratic Equations,” pp. 1-27, May 29, 2017. [cited by applicant]
Wang, et al. “Solving Systems of Random Quadratic Equations via Truncated Amplitude Flow,” IEEE Transactions on Information Theory, vol. 64, No. 2, pp. 773-794, Feb. 2018. [cited by applicant]
Wei, “Solving Systems of Phaseless Equations via Kaczmarz Methods: A Proof of Concept Study,” Department of Mathematics Hong Kong University of Science and Technology, pp. 1-24, Sep. 1, 2015. [cited by applicant]