IP Library Granted Patent US 10,200,604
Granted Patent B2
US 10,200,604 · App. 15/309,230 · Granted Feb 5, 2019

Image processing apparatus, image processing program, image processing method, microscopic system

Inventors: Hirokazu Tatsuta (Kanagawa, JP); Suguru Dowaki (Kanagawa, JP); Eriko Matsui (Tokyo, JP)
Assignee: Sony Corporation
H04N5/23232G02B21/06G02B21/241G02B21/36G02B21/367G06T5/003G06T5/50H04N5/225H04N5/2256H04N5/232H04N5/2354G06T2207/10024G06T2207/10056G06T2207/10152G06T2207/20221H04N5/23293
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,200,604
App. No.
15/309,230
Granted
Feb 5, 2019
Kind
B2
Abstract

To provide an image processing apparatus, an image processing program, an image processing method, and a microscopic system that are capable of acquiring a high-resolution image that is suitable for scientific verification. An image processing apparatus according to the present technology includes an image conversion unit and an image generation unit. The image conversion unit converts a first picked-up image and a second picked-up image into frequency components, the first picked-up image being obtained by picking up an image of an observation target object with first illumination light via a microscope optical system, the second picked-up image being obtained by picking up an image of the observation target object with second illumination light via the microscope optical system, the second picked-up image having a contrast in a low frequency band lower than that of the first picked-up image and a contrast in a high frequency band higher than that of the first picked-up image. The image generation unit combines a low frequency component of the first picked-up image and a high frequency component of the second picked-up image with each other to generate a composite image.

Claims (36)

1. An image processing apparatus, comprising:

an image conversion unit that converts a first picked-up image and a second picked-up image into frequency components, the first picked-up image being obtained by picking up an image of an observation target object with first illumination light via a microscope optical system, the second picked-up image being obtained by picking up an image of the observation target object with second illumination light via the microscope optical system, the second picked-up image having a contrast in a low frequency band lower than that of the first picked-up image and a contrast in a high frequency band higher than that of the first picked-up image; and

an image generation unit that combines a low frequency component of the first picked-up image and a high frequency component of the second picked-up image with each other to generate a composite image.

2. The image processing apparatus according to claim 1 , wherein

the first illumination light is narrow band light in a wavelength band longer than that of the second illumination light, and

the second illumination light is narrow band light in a wavelength band shorter than that of the first illumination light.

3. The image processing apparatus according to claim 2 , wherein

the first illumination light is red light, and

the second illumination light is blue light.

4. The image processing apparatus according to claim 1 , wherein

the first illumination light has an illumination NA lower than that of the second illumination light, and

the second illumination light has an illumination NA higher than that of the first illumination light.

5. The image processing apparatus according to claim 1 , wherein

the image conversion unit converts the first picked-up image into a spatial frequency area image to generate a first spatial frequency area image, and the second picked-up image into a spatial frequency area image to generate a second spatial frequency area image, and

the image generation unit generates the composite image from a low frequency area of the first spatial frequency area image and a high frequency area of the second spatial frequency area image.

6. The image processing apparatus according to claim 5 , wherein

the image generation unit generates a combined image obtained by combining the low frequency area and the high frequency area with each other, and generates the composite image by converting the combined image into a spatial area image.

7. The image processing apparatus according to claim 5 , wherein

the image generation unit generates a low frequency component image obtained by converting the low frequency area into a spatial area image and a high frequency component image obtained by converting the high frequency area into a spatial area image, and generates the composite image by adding the low frequency component image and the high frequency component image to each other.

8. An image processing program, comprising:

an image conversion unit that converts a first picked-up image and a second picked-up image into frequency components, the first picked-up image being obtained by picking up an image of an observation target object with first illumination light via a microscope optical system, the second picked-up image being obtained by picking up an image of the observation target object with second illumination light via the microscope optical system, the second picked-up image having a contrast in a low frequency band lower than that of the first picked-up image and a contrast in a high frequency band higher than that of the first picked-up image; and

an image generation unit that combines a low frequency component of the first picked-up image and a high frequency component of the second picked-up image with each other to generate a composite image.

9. An image processing method, comprising:

converting, by an image conversion unit, a first picked-up image and a second picked-up image into frequency components, the first picked-up image being obtained by picking up an image of an observation target object with first illumination light via a microscope optical system, the second picked-up image being obtained by picking up an image of the observation target object with second illumination light via the microscope optical system, the second picked-up image having a contrast in a low frequency band lower than that of the first picked-up image and a contrast in a high frequency band higher than that of the first picked-up image; and

combining, by an image generation unit, a low frequency component of the first picked-up image and a high frequency component of the second picked-up image with each other to generate a composite image.

10. A microscopic system, comprising:

an illumination lamp that applies first illumination light and second illumination light;

a microscope optical system;

an imaging unit; and

an image conversion unit that converts a first picked-up image and a second picked-up image into frequency components, the first picked-up image being obtained by picking up an image of an observation target object with the first illumination light via the microscope optical system, the second picked-up image being obtained by picking up an image of the observation target object with the second illumination light via the microscope optical system, the second picked-up image having a contrast in a low frequency band lower than that of the first picked-up image and a contrast in a high frequency band higher than that of the first picked-up image; and

an image generation unit that combines a low frequency component of the first picked-up image and a high frequency component of the second picked-up image with each other to generate a composite image.

11. The microscopic system according to claim 10 , further comprising:

a focus adjustment mechanism that adjust a focal position of the microscope optical system; and

a control unit that controls the focus adjustment mechanism to cause the microscope optical system to focus on the observation target object under irradiation of the first illumination light, and cause the microscope optical system to focus on the observation target object under irradiation of the second illumination light.

12. The microscopic system according to claim 10 , further comprising

a control unit that controls a light amount of the first illumination light and the second illumination light so that exposure of the first picked-up image and exposure of the second picked-up image match.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: TATSUTA, HIROKAZU; DOWAKI, SUGURU; MATSUI, ERIKO
To: SONY CORPORATION
Reel/Frame 041582/0051 →
Priority Claims (1)
JP 2014-100757 · May 14, 2014 · national
Continuity (1)
Related Publication 20170085789A1 · Mar 23, 2017
Cited By (1)
US 12,335,634