IP Library › Granted Patent US 11,867,624
Granted Patent B2
US 11,867,624 · App. 17/528,404 · Granted Jan 9, 2024

System for reconstructing and outputting a structure of an estimation sample using refractive index distribution of updated estimation sample

Inventors: Yoshimasa Suzuki (Kawasaki, JP); Toshiro Okamura (Hino, JP)
Assignee: Evident Corporation
G01N21/4133G02B21/086G01N2021/4153G01N2201/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,867,624
App. No.
17/528,404
Granted
Jan 9, 2024
Kind
B2
Abstract

A refractive index distribution estimating system includes an illumination optical system configured to illuminate a sample, an imaging optical system configured to form an optical sample image, an image sensor configured to capture optical images of the sample, and a processor configured to reconstruct a refractive index distribution of the sample from images. The processor performs processing including the steps of: estimating the sample; calculating the estimated sample image from a plurality of first wavefronts emanating from a plurality of modeled light sources; optimizing a refractive index distribution of the estimated sample from a plurality of second wavefronts after the first wavefronts pass through the estimated sample, the captured image, and the image of the estimated sample; updating the estimation sample by repeating calculation of the estimated sample image and optimization of the refractive index distribution of the estimated sample; and reconstructing and outputting a structure of the estimated sample.

Claims (68)

1. A refractive index distribution estimating system comprising:

an illumination optical system configured to illuminate a sample with partial coherent illumination;

an imaging optical system configured to form an optical image of the sample;

an image sensor configured to acquire a captured image from the optical image of the sample formed by the imaging optical system; and

a processor configured to reconstruct a refractive index distribution of the sample from the captured image, wherein the processor performs processing including the steps of:

estimating an estimation sample including a refractive index distribution of the sample;

calculating an image of the estimation sample by calculating a first intensity distribution at an imaging position of the imaging optical system corresponding to each of a plurality of light sources, using a first wavefront corresponding to each of the plurality of light sources that model an intensity distribution of a pupil of the illumination optical system, and summing the first intensity distribution corresponding to each of the plurality of light sources;

optimizing a refractive index distribution of the estimation sample using a second wavefront after the first wavefront corresponding to each of the light sources passes through the estimation sample, the captured image, and the image of the estimation sample;

updating the estimation sample by repeating calculation of the image of the estimation sample and optimization of the refractive index distribution of the estimation sample; and

reconstructing and outputting a structure of the estimation sample using a refractive index distribution of an updated estimation sample

wherein in the step of calculating the image of the estimation sample, the processor is configured to:

calculate a plurality of the first wavefronts emanating from the plurality of light sources that model the intensity distribution of the pupil of the illumination optical system;

calculate a plurality of the second wavefronts after the plurality of first wavefronts pass through the estimation sample; and

calculate a plurality of the first intensity distributions at the imaging position of the imaging optical system using the plurality of second wavefronts and calculate the image of the estimation sample by summing the plurality of first intensity distributions, and

wherein in the step of optimizing the refractive index distribution of the estimation sample, the processor is configured to:

for each of the second wavefronts corresponding to the plurality of light sources as a process target, calculate a second correction wavefront corrected using the captured image and the image of the estimation sample corresponding to the same light source as the second wavefront; and

for each of the second wavefronts corresponding to the plurality of light sources as a process target, calculate a gradient of the refractive index distribution of the estimation sample from an error between the second wavefront and the second correction wavefront corresponding to the same light source, and optimize the refractive index distribution of the estimation sample using the gradient of the refractive index distribution.

2. The refractive index distribution estimating system according to claim 1 , further comprising:

a driving mechanism configured to change a distance between a focus position of the imaging optical system and a position of the sample in an optical axis direction of the imaging optical system,

wherein the processor is configured to:

acquire a plurality of captured images of the sample corresponding to a plurality of distances by changing the distance using the driving mechanism;

calculate a plurality of images of the estimation sample corresponding to the distances are calculated; and

optimize the refractive index distribution of the estimation sample in each of the distances.

3. The refractive index distribution estimating system according to claim 1 ,

wherein:

the illumination optical system includes a condenser lens and a first aperture member,

the imaging optical system includes an objective lens and a tube lens, and

an image of the first aperture member is formed at a pupil position of the objective lens.

4. The refractive index distribution estimating system according to claim 3 ,

wherein the first aperture member has an annular transmission part or darkening part.

5. The refractive index distribution estimating system according to claim 3 , further comprising:

a second aperture member different from the first aperture member; and

a moving mechanism configured to switch the first aperture member and the second aperture member.

6. A refractive index distribution estimating system comprising:

an illumination optical system configured to illuminate a sample with partial coherent illumination;

an imaging optical system configured to form an optical image of the sample;

an image sensor configured to acquire a captured image from the optical image of the sample formed by the imaging optical system; and

a processor configured to reconstruct a refractive index distribution of the sample from the captured image, wherein the processor performs processing including the steps of:

estimating an estimation sample including a refractive index distribution of the sample;

calculating an image of the estimation sample by calculating a first intensity distribution at an imaging position of the imaging optical system corresponding to each of a plurality of light sources, using a first wavefront corresponding to each of the plurality of light sources that model an intensity distribution of a pupil of the illumination optical system, and summing the first intensity distribution corresponding to each of the plurality of light sources;

optimizing a refractive index distribution of the estimation sample using a second wavefront after the first wavefront corresponding to each of the light sources passes through the estimation sample, the captured image, and the image of the estimation sample;

updating the estimation sample by repeating calculation of the image of the estimation sample and optimization of the refractive index distribution of the estimation sample; and

reconstructing and outputting a structure of the estimation sample using a refractive index distribution of an updated estimation sample,

wherein, in the step of calculating the image of the estimation sample, the processor is configured to:

calculate the first wavefront corresponding to each of the plurality of light sources;

calculate the second wavefront after passing through the estimation sample corresponding to each of the first wavefronts;

calculate a third wavefront at a focus position on the sample side of the imaging optical system corresponding to each of the second wavefronts;

calculate a fourth wavefront at the imaging position of the imaging optical system corresponding to the third wavefront, using the third wavefront and a pupil function of the imaging optical system, and calculate a first intensity distribution corresponding to the fourth wavefront by squaring the fourth wavefront; and

calculate the estimation sample image by summing the first intensity distribution corresponding to the fourth wavefront.

7. The refractive index distribution estimating system according to claim 6 ,

wherein in the step of optimizing the refractive index distribution of the estimation sample, the processor is configured to:

for each of the second wavefronts corresponding to the plurality of light sources as a process target, calculate a second correction wavefront is corrected using the captured image and the image of the estimation sample corresponding to the same light source as the second wavefront; and

for each of the second wavefronts corresponding to the plurality of light sources as a process target, calculate a gradient of the refractive index distribution of the estimation sample from an error between the second wavefront and the second correction wavefront corresponding to the same light source, and optimize the refractive index distribution of the estimation sample using the gradient of the refractive index distribution.

8. The refractive index distribution estimating system according to claim 7 , further comprising:

a driving mechanism configured to change a distance between a focus position of the imaging optical system and a position of the sample in an optical axis direction of the imaging optical system,

wherein the processor is configured to:

acquire a plurality of captured images of the sample corresponding to a plurality of distances by changing the distance using the driving mechanism;

calculate a plurality of images of the estimation sample corresponding to the distances are calculated; and

optimize the refractive index distribution of the estimation sample in each of the distances.

9. The refractive index distribution estimating system according to claim 7 ,

wherein the illumination optical system includes a condenser lens and a first aperture member, and

wherein the imaging optical system includes an objective lens and a tube lens, and

wherein an image of the first aperture member is formed at a pupil position of the objective lens.

10. The refractive index distribution estimating system according to claim 9 ,

wherein the first aperture member has an annular transmission part or darkening part.

11. The refractive index distribution estimating system according to claim 9 , further comprising:

a second aperture member different from the first aperture member; and

a moving mechanism configured to switch the first aperture member and the second aperture member.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2022
From: OLYMPUS CORPORATION
To: EVIDENT CORPORATION
Reel/Frame 060333/0883 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 17, 2021
From: SUZUKI, YOSHIMASA; OKAMURA, TOSHIRO
To: OLYMPUS CORPORATION
Reel/Frame 058137/0167 →
Continuity (2)
Continuation PCTJP2019031140 · Aug 7, 2019
Related Publication 20220074854A1 · Mar 10, 2022
Cited By (1)
US 12,736,793