IP Library › Granted Patent US 11,579,075
Granted Patent B2
US 11,579,075 · App. 17/336,720 · Granted Feb 14, 2023

Dynamic high-speed high-sensitivity imaging device and imaging method

Inventors: Sadao Ota (Tokyo, JP); Ryoichi Horisaki (Osaka, JP); Kazuki Hashimoto (Tokyo, JP)
Assignees: The University of Tokyo; Osaka University
G01N21/01G01B11/00G01N21/53G01N21/59G01N21/64G01N21/6456H03M7/3062
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,579,075
App. No.
17/336,720
Granted
Feb 14, 2023
Kind
B2
Abstract

Any one or both of an optical system with a structured lighting pattern and a structured detecting system having a plurality of regions with different optical characteristics are used. In addition, optical signals from an object to be observed through one or a small number of pixel detectors are detected while changing relative positions between the object to be observed and any one of the optical system and the detecting system, time series signal information of the optical signals are obtained, and an image associated with an object to be observed from the time series signal information is reconstructed.

Claims (35)

1. A method for analyzing an object, comprising:

(a) illuminating said object with light using at least one light source;

(b) changing a position or an orientation of said object such that a plurality of regions of said object is sequentially illuminated by said light;

(c) using at least one detector to sequentially detect a plurality of optical signals corresponding to said plurality of regions of said object, wherein said plurality of optical signals comprise one or more structured optical signals associated with a structured optical pattern;

(d) obtaining time series information indicating a change in intensity of said plurality of optical signals, and

(e) reconstructing one or more time-independent images associated with said plurality of regions of said object from said time series information, wherein said reconstructing of said one or more time-independent images comprises:

(i) separating partial time series information associated with a partial region of said plurality of regions of said object from said time series information detected by said detector;

(ii) extracting information associated with one or more partial images of said object from said partial time series information; and

(iii) reconstructing a whole image of said object using said information associated with said one or more partial images.

2. The method of claim 1 , wherein in (b), said position of said object is changed (i) by moving a stage on which said object is disposed or (ii) using cell flow cytometry.

3. The method of claim 1 , wherein said structured optical pattern is provided by at least one optical system selected from the group consisting of (i) an optical system comprising an optical element having a light source and at least one filter or film configured to receive light from said light source and form a structured lighting pattern, (ii) an optical system comprising a group of light sources configured to generate a structured lighting pattern, (iii) an optical system comprising said light source and a spatial modulator to structure a light from said at least one light source to provide a lighting pattern, and (iv) an optical system comprising a light filter present before said at least one detector.

4. The method of claim 1 , wherein said structured optical pattern is configured to have random intensity distributions for every pixel.

5. The method of claim 1 , wherein said structured optical pattern is configured to have a delta function form.

6. The method of claim 1 , wherein said structured optical pattern is configured to include one or more regions through which light is not transmitted.

7. The method of claim 1 , wherein said structured optical pattern is disposed along a light path between said light source and said at least one detector, wherein said structured optical pattern comprises a plurality of regions with different optical characteristics.

8. The method of claim 1 , wherein said structured optical pattern is generated by:

(a) ascertaining a range of size of said object by observing said object using a randomly distributed structured lighting pattern and reconstructing an image associated with said object; and

(b) adjusting said range of size of said structured lighting pattern based on a size of said object or by changing a target region observed to match a reference region in which said object is present.

9. A device for generating spatial information corresponding to time-independent images of an object, comprising:

(a) a light source configured to illuminate said object with light;

(b) a relative position control mechanism configured to change a position or an orientation of said object such that a plurality of regions of said object are sequentially illuminated by said light;

(c) at least one detector configured to (i) sequentially detect a plurality of optical signals corresponding to said plurality of regions of said object and (ii) obtain time series information indicating a change in intensity of said optical signals, wherein said plurality of optical signals comprises one or more structured optical signals associated with a structured optical pattern,

(d) an image reconstructor in communication with said detector, wherein said image reconstructor is configured to reconstruct one or more time-independent images associated with said plurality of regions of said object based on said time series information, wherein said image reconstructor comprises:

(i) a partial signal separating unit configured to separate partial time series information associated with a partial region of said plurality of regions of said object from said time series information detected by said detector,

(ii) a partial image reconstructing unit configured to extract information associated with one or more partial images of said object from said partial time series information, and

(iii) an image reconstructing unit configured to reconstruct a whole image of said object using said information associated with said one or more partial images of said object.

10. The device of claim 9 , wherein said relative position control mechanism is configured to change said position of said object (i) by moving a stage on which said object is disposed or (ii) using flow cytometry.

11. The device of claim 9 , further comprising at least one optical system configured to provide said structured optical pattern, wherein said optical system is selected from the group consisting of (i) an optical system comprising an optical element having a light source and at least one filter or film configured to receive light from the light source and form a structured lighting pattern, (ii) an optical system comprising a group of light sources to constitute a structured lighting pattern, (iii) an optical system comprising a light source and a spatial modulator to structure a light from said light source to have a lighting pattern, and (iv) an optical system comprising a light filter present before said at least one detector.

12. The device of claim 9 , wherein said structured optical pattern is configured to have random intensity distributions for every pixel.

13. The device of claim 9 , wherein said structured optical pattern is configured to have a delta function form.

14. The device of claim 9 , wherein said structured optical pattern comprises one or more regions through which light is not transmitted.

15. The device of claim 9 , wherein said structured optical pattern is generated by:

(a) ascertaining a range of size of said object by observing said object using a randomly distributed structured lighting pattern and reconstructing an image associated with said object; and

(b) adjusting said range of size of said structured lighting pattern based on a size of said object or by changing a target region observed to match a reference region in which said object is present.

16. The device of claim 9 , wherein said structured optical pattern is disposed along a light path between said light source and said detector, wherein said structured optical pattern comprises a plurality of regions with different optical characteristics.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2021
From: OTA, SADAO; HORISAKI, RYOICHI; HASHIMOTO, KAZUKI
To: THE UNIVERSITY OF TOKYO; OSAKA UNIVERSITY
Reel/Frame 057007/0934 →
Priority Claims (1)
JP 2015-033520 · Feb 24, 2015 · national
Continuity (3)
Continuation 16936138 · Jul 22, 2020
Continuation 15552438
Related Publication 20210404945A1 · Dec 30, 2021
Cited By (5)
US 12,230,023 US 12,235,202 US 12,259,311 US 12,298,221 US 12,339,217