Microscope system
Provided is a microscope system including: a stage on which a multi-dyed specimen is mounted; an objective lens for collecting light from the specimen mounted on the stage; a Z-axis movement section for relatively moving the stage and the objective lens in a direction along the optical axis L of the objective lens; an XY-axis movement section for moving the stage in a direction orthogonal to the optical axis L; an image acquisition unit for acquiring a color image by capturing the light collected by the objective lens; and a depth-extension processing unit for generating a depth-extended image by performing depth extension processing dye by dye on the basis of a plurality of the color images that are acquired by the image acquisition unit at different positions of the stage relative to the objective lens set with the Z-axis movement section.
1. A microscope system comprising:
a stage on which a multi-dyed specimen is mounted;
an objective lens for collecting light from the specimen mounted on the stage, the stage being movable in a direction along an optical axis of the objective lens to change a position of the stage relative to the objective lens;
an image sensor for acquiring a color image by capturing the light collected by the objective lens; and
a controller comprising hardware, the controller being configured to generate a depth-extended image by performing depth extension processing dye by dye on the basis of a plurality of the color images that are acquired by the image sensor at different positions of the stage relative to the objective lens;
wherein the controller generates a dye-amount image, classified by dye component, by applying unmixing processing to the color image of the specimen and generates the depth-extended image using the generated dye-amount image.
2. The microscope system according to claim 1 , further comprising an image display for displaying a dynamic image that time-sequentially updates the color image acquired by the image sensor and the depth-extended image generated by the controller in a simultaneous and synchronous manner.
3. The microscope system according to claim 2 , wherein the controller generates the depth-extended image individually for a different combination of dyes, and
the controller is further configured to receive a signal for setting a display condition for combining the dynamic image and the depth-extended image displayed by the image display.
4. The microscope system according to claim 1 , wherein the controller adjusts the luminance of the dye-amount image generated through the unmixing processing.
5. The microscope system according to claim 1 , wherein the depth extension processing differs for each of the dyes.
6. The microscope system according to claim 1 , further comprising:
an image memory for time-sequentially storing a plurality of the color images, having different focal positions, that are acquired by the image sensor; and
the controller is further configured to play back a plurality of images stored by the image memory by displaying the images so as to be switched time-sequentially.
7. The microscope system according to claim 6 , wherein the controller is further configured to:
generate the depth-extended image by updating pixel-by-pixel depth information of the generated depth-extended image with pixel-by-pixel depth information of the newly acquired color image,
detect the number of pixels the depth information of which in the color image acquired by the image sensor is updated; and
determine whether or not the number detected of pixels is equal to or smaller than a predetermined threshold value, and
the image memory does not store the color image when the the determined number of pixels the depth information of which is updated is equal to or smaller than the predetermined threshold value.
8. The microscope system according to claim 7 , wherein the controller is further configured to report if a predetermined number of the color images for which it is determined that the number of pixels the depth information of which is updated is equal to or smaller than the predetermined threshold value are acquired successively in a time series.
9. The microscope system according to claim 7 , further comprising a pixel-number display for displaying the number of detected pixels.
10. The microscope system according to claim 6 , wherein the controller is further configured to:
set a region of interest in each of the color images stored in the image memory; and
display a time-lapse change in the luminance of the set region of interest.
11. The microscope system according to claim 6 , wherein the controller is further configured to:
detect that illumination to the specimen is blocked, and
when the light is detected to be blocked, play back images stored in the image memory.
12. The microscope system according to claim 1 , wherein the stage is further movable in a plane orthogonal to the direction, the controller being further configured to:
detect a position of the stage in the plane when each of the color images is acquired by the image sensor; and
calculate a difference in the position between two of the color images that are acquired by the image sensor, the two color images being adjacent to each other in a time-axis direction,
wherein, when the difference calculated is equal to or greater than a first threshold value, the controller starts the depth extension processing from the beginning.
13. The microscope system according to claim 12 , wherein positions of the color images in the plane are corrected when the calculated difference is smaller than the first threshold value and is equal to or greater than a second threshold value.
14. The microscope system according to claim 12 , wherein the controller is further configured to:
detect the luminance value of the color image acquired by the image sensor, and
when the detected luminance value is equal to or smaller than a predetermined threshold value, the controller does not detect the position in the plane.
15. An image processing unit for use with a microscope having a stage on which a multi-dyed specimen is mounted, an objective lens for collecting light from the specimen mounted on a stage, the stage being movable in a direction along an optical axis of the objective lens to change a position of the stage relative to the objective lens, and an image sensor for acquiring a color image by capturing the light collected by the objective lens, the image processing unit comprising:
a controller comprising hardware, the controller being configured to:
generate a depth-extended image by performing depth extension processing dye by dye on the basis of a plurality of the color images that are acquired by the image sensor at different positions of the stage relative to the objective lens;
wherein the controller generates a dye-amount image, classified by dye component, by applying unmixing processing to the color image of the specimen and generates the depth-extended image using the generated dye-amount image.