IP Library Granted Patent US 10,228,554
Granted Patent B2
US 10,228,554 · App. 15/257,289 · Granted Mar 12, 2019

Partially coherent phase recovery

Inventors: Laura Waller (Berkeley, CA); Jingshan Zhong (Berkeley, CA); Lei Tian (Berkeley, CA); Justin Dauwels (Singapore, SG)
Assignees: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA; NANYANG TECHNOLOGICAL UNIVERSITY
G02B21/367G02B27/0012G02B27/52G06T5/10G02B21/14G06T2207/10056G06T2207/20024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,228,554
App. No.
15/257,289
Granted
Mar 12, 2019
Kind
B2
Abstract

A system and method for incorporating partially coherent illumination models into the problem of phase and amplitude retrieval from a stack of intensity images. The recovery of phase could be realized by many methods, including Kalman filters or other nonlinear optimization algorithms that provide least squares error between the measurement and estimation.

Claims (349)

1. A system for phase recovery of an intensity image with partially coherent illumination, the system comprising:

(a) a computer processor; and

(b) a memory storing instructions executable on the processor;

(c) the instructions, when executed, performing the steps comprising:

(i) mathematically modeling partial coherence with respect to the intensity image;

(ii) formulating a statespace Kalman filter from the partial coherence model; and

(iii) applying a standard Kalman filter to the statespace Kalman filter to estimate a phase with respect to the intensity image;

(iv) applying a sparse model to the Kalman filter to reduce computational complexity;

(v) wherein the sparse model optimizes according to:

â n =K H {circumflex over (b)} n

Q n ={circumflex over (Q)} n −( {circumflex over (Q)} n +{circumflex over (P)} n )( {circumflex over (Q)} n +{circumflex over (P)} n +( {circumflex over (Q)} n )*+( {circumflex over (P)} n )*+ qS −2 ) −1 ( {circumflex over (Q)} n +( {circumflex over (P)} n )*)

P n ={circumflex over (P)} n −( {circumflex over (Q)} n +{circumflex over (P)} n )( {circumflex over (Q)} n +{circumflex over (P)} n +( {circumflex over (Q)} n )*+( {circumflex over (P)} n )*+ qS −2 ) −1 ( {circumflex over (P)} n +( {circumflex over (Q)} n )*)

b n ={circumflex over (b)} n +( Q n +P n ) K diag( â n ) C n R −1 ( I n −γ|â n | 2 );

where â n is the state predicted from the previous n−1 observations, I n and b n are discretized column vectors, C n describes convolution of scaled source intensity distribution, and K is the discrete Fourier transform (DFT) matrix.

2. A system as recited in claim 1 , wherein the image comprises a stack of defocused intensity images; and

wherein a propagation transfer function is applied between captured intensity images.

3. A system as recited in claim 1 , wherein the instructions are configured for estimating a phase with respect to a partially coherent intensity image generated from one or more of: optical microscopes, electron imaging systems, tabletop X-ray imaging systems, synchrotron imaging systems, and lithography aerial imaging systems.

4. A system as recited in claim 1 , wherein the instructions are configured for estimating phase for an image having an arbitrary shape of Köhler illumination.

5. A system as recited in claim 1 , wherein the image comprises a stack of intensity images; and

wherein phase or amplitude filters or other linear optical systems are applied as a transfer function between captured intensity images.

6. A method for phase recovery of an intensity image with partially coherent illumination, the method comprising:

(a) mathematically modeling partial coherence with respect to the intensity image;

(b) formulating a state-space Kalman filter from the partial coherence model; and

(c) applying a standard Kalman filter to the state-space Kalman filter to estimate a phase with respect to the intensity image;

(d) wherein said method is performed by executing programming on at least one computer processor, said programming residing on a non-transitory medium readable by the computer processor;

(e) applying a sparse model to the Kalman filter to reduce computational complexity;

(f) wherein the sparse model optimizes according to:

â n =K H {circumflex over (b)} n

Q n ={circumflex over (Q)} n −( {circumflex over (Q)} n +{circumflex over (P)} n )( {circumflex over (Q)} n +{circumflex over (P)} n +( {circumflex over (Q)} n )*+( {circumflex over (P)} n )*+ qS −2 ) −1 ( {circumflex over (Q)} n +( {circumflex over (P)} n )*)

P n ={circumflex over (P)} n −( {circumflex over (Q)} n +{circumflex over (P)} n )( {circumflex over (Q)} n +{circumflex over (P)} n +( {circumflex over (Q)} n )*+( {circumflex over (P)} n )*+ qS −2 ) −1 ( {circumflex over (P)} n +( {circumflex over (Q)} n )*)

b n ={circumflex over (b)} n +( Q n +P n ) K diag( â n ) C n R −1 ( I n −γ|â n | 2 );

where â n is the state predicted from the previous n−1 observations, I n and b n are discretized column vectors, C n describes convolution of scaled source intensity distribution, and K is the discrete Fourier transform (DFT) matrix.

7. A method as recited in claim 6 , wherein the image comprises a stack of defocused intensity images; and

wherein a propagation transfer function is applied between captured intensity images.

8. A method as recited in claim 6 , wherein the method is configured for estimating a phase with respect to a partially coherent intensity image generated from one or more of: optical microscopes, electron imaging systems, tabletop X-ray imaging systems, synchrotron imaging systems, and lithography aerial imaging systems.

9. A method as recited in claim 6 , wherein the method is configured for estimating phase for an image having an arbitrary shape of Köhler illumination.

10. A system as recited in claim 6 , wherein the image comprises a stack of intensity images; and

wherein phase or amplitude filters or other linear optical systems are applied as a transfer function between captured intensity images.

11. A system for phase recovery of an intensity image with partially coherent illumination, the system comprising:

(a) a computer processor; and

(b) a memory storing instructions executable on the processor;

(c) the instructions, when executed, performing the steps comprising:

(i) mathematically modeling partial coherence with respect to one or more intensity image having partially coherent illumination;

(ii) applying a nonlinear least square error function to fit over the one or more measured intensity images; and

(iii) estimating a phase with respect to the one or more intensity images;

(iv) wherein applying a nonlinear least square error function comprises:

finding an optimal estimation to minimize an average square error between measurement and predicted measurement (cost function) with respect to the one or more intensity images;

minimizing the cost function using nonlinear least square error method; and

deriving a gradient and Hessian;

wherein the gradient and Hessian are computed according to:

F

(

b

,

b

_

)

=

n

=

1

N

im

[

-

A

n

H

diag

(

A

n

b

)

C

n

-

A

n

T

diag

(

A

_

n

b

_

)

C

n

H

]

[

I

n

-

C

n

H

A

n

b

2

]

;

F

(

b

,

b

_

)

n

=

1

N

im

[

H

_

n

K

diag

(

K

H

H

n

b

)

C

n

H

C

n

diag

(

K

H

_

n

b

_

)

K

H

H

n

H

_

n

K

diag

(

K

H

H

n

b

)

C

n

H

C

n

diag

(

K

H

H

n

b

)

K

H

_

n

H

n

K

H

diag

(

K

H

_

n

b

_

)

C

n

H

C

n

diag

(

K

H

_

n

b

_

)

K

H

H

n

H

n

K

H

diag

(

K

H

_

n

b

_

)

C

n

H

C

n

diag

(

K

H

H

n

b

)

K

H

_

n

]

.

12. A system as recited in claim 11 , further comprising:

computing a multiplication of the Hessian with vector with Fast Fourier transform (FFT).

13. A system as recited in claim 11 , further comprising solving the linear equations system:

F

(

b

,

b

_

)

[

x

x

_

]

=

-

F

(

b

,

b

_

)

.

14. A system as recited in claim 13 , wherein the linear equation is solved as a function of a conjugate gradient method iteratively by computing the gradient and the multiplication of the Hessian with a vector with FFT.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2016
From: DAUWELS, JUSTIN
To: NANYANG TECHNOLOGICAL UNIVERSITY
Reel/Frame 039898/0927 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 26, 2016
From: WALLER, LAURA; ZHONG, JINGSHAN; TIAN, LEI
To: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA
Reel/Frame 040148/0465 →
Continuity (3)
Continuation PCTUS2015019279 · Mar 6, 2015
Provisional Application 61949420 · Mar 7, 2014
Related Publication 20170059845A1 · Mar 2, 2017