IP Library Granted Patent US 11,830,165
Granted Patent B2
US 11,830,165 · App. 17/392,716 · Granted Nov 28, 2023

Method and apparatus for simultaneously acquiring super-resolution image and high-speed widefield image

Inventors: Chung Hun Park (Ulsan, KR); Tae Seong Woo (Ulsan, KR)
Assignee: UNIST(ULSAN NATIONAL INSTITUTE OF SCIENCE AND TECHNOLOGY)
G06T3/4053G02B21/367G02B27/58G06T7/20G06T2207/10056G06T2207/10152
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,830,165
App. No.
17/392,716
Granted
Nov 28, 2023
Kind
B2
Abstract

A method and apparatus for simultaneously acquiring a super-resolution image and a high-speed widefield image are disclosed. The image acquisition method includes receiving a first image signal from an optical microscope, generating, by using the first image signal, a first plurality of entire images, distinguishing, based on movements of a plurality of objects included in the first plurality of entire images, a dynamic region with respect to the first plurality of entire images and a static region with respect to the first plurality of entire images, and controlling the optical microscope so as to respectively irradiate lights having different amplitudes onto the dynamic region and the static region.

Claims (42)

1. An image acquisition method comprising:

receiving a first image signal from an optical microscope;

generating, by using the first image signal, a first plurality of entire images;

distinguishing, based on movements of a plurality of objects included in the first plurality of entire images, a dynamic region with respect to the first plurality of entire images and a static region with respect to the first plurality of entire images;

controlling the optical microscope so as to respectively irradiate lights having different amplitudes onto the dynamic region and the static region;

receiving, from the optical microscope, a second image signal acquired by respectively irradiating lights having different amplitudes irradiated onto the dynamic region and the static region;

generating, by using the second image signal, a second plurality of entire images;

generating, based on the second plurality of entire images and a mask for distinguishing the dynamic region and the static region, a plurality of static region images representing only the static region and a dynamic region image representing only the dynamic region; and

generating, based on the plurality of static region images and the dynamic region image, a final image with respect to the plurality of objects.

2. The image acquisition method of claim 1 , further comprising:

generating the mask for distinguishing the dynamic region and the static region by using two consecutive images among the first plurality of entire images.

3. The image acquisition method of claim 1 , wherein the generating of the final image comprises:

generating, by using the plurality of static region images, a super-resolution image with respect to the static region; and

generating, by using the super-resolution image and the dynamic region image, the final image.

4. The image acquisition method of claim 1 , wherein the generating comprises:

controlling the optical microscope so as to irradiate a light with a plane wave pattern onto the dynamic region; and

controlling the optical microscope so as to irradiate a light with a sinusoidal wave pattern onto the static region.

5. The image acquisition method of claim 1 , wherein the light is a light having an electromagnetic wave form in a predetermined wavelength range.

6. The image acquisition method of claim 1 , wherein the first image signal is acquired by irradiating light with a plane wave pattern from the optical microscope.

7. The image acquisition method of claim 1 , wherein the optical microscope is implemented as a digital micro-mirror device (DMD), a liquid crystal-based optical modulator, a micro electro mechanical systems (MEMS)-based optical modulator, or an LED.

8. An image acquisition apparatus comprising:

a memory configured to store instructions for simultaneously acquiring a super-resolution image and a high-speed widefield image; and

a processor configured to execute the instructions,

wherein, when the instructions are executed by the processor, the processor is configured to:

receive a first image signal from an optical microscope;

generate, by using the first image signal, a first plurality of entire images;

distinguish, based on movements of a plurality of objects included in the first plurality of entire images, a dynamic region with respect to the first plurality of entire images and a static region with respect to the first plurality of entire images;

control the optical microscope so as to respectively irradiate lights having different amplitudes onto the dynamic region and the static region;

receive, from the optical microscope, a second image signal acquired by respectively irradiating lights having different amplitudes onto the dynamic region and the static region;

generate, by using the second image signal, a second plurality of entire images;

generate, based on the second plurality of entire images and the mask for distinguishing the dynamic region and the static region, a plurality of static region images representing only the static region and a dynamic region image representing only the dynamic region; and

generate, based on the plurality of static region images and the dynamic region image, a final image with respect to the plurality of objects.

9. The image acquisition apparatus of claim 8 , wherein the processor is configured to generate the mask for distinguishing the dynamic region and the static region by using two consecutive images among the first plurality of entire images.

10. The image acquisition apparatus of claim 8 , wherein the processor is configured to:

generate, by using the plurality of static region images, a super-resolution image with respect to the static region; and

generate the final image by using the super-resolution image and the dynamic region image.

11. The image acquisition apparatus of claim 8 , wherein the processor is configured to:

control the optical microscope so as to irradiate a light with a plane wave pattern onto the dynamic region; and

control the optical microscope so as to irradiate a light with a sinusoidal wave pattern onto the static region.

12. The image acquisition apparatus of claim 8 , wherein the light is a light having an electromagnetic wave form in a predetermined wavelength range.

13. The image acquisition apparatus of claim 8 , wherein the first image signal is acquired by irradiating light with a plane wave pattern from the optical microscope.

14. The image acquisition of claim 8 , wherein the optical microscope is implemented as a DMD, a liquid crystal-based optical modulator, a MEMS-based optical modulator, or an LED.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2021
From: PARK, CHUNG HUN; WOO, TAE SEONG
To: UNIST(ULSAN NATIONAL INSTITUTE OF SCIENCE AND TECHNOLOGY)
Reel/Frame 057090/0361 →
Priority Claims (1)
KR 10-2020-0159185 · Nov 24, 2020 · national
Continuity (1)
Related Publication 20220164925A1 · May 26, 2022
Cited By (1)
US 12,682,592