Microscope system and method for deciding stitched area

1. A microscope system for stitching a plurality of element images to generate a stitched image, the system comprising:

at least one optical system via which a sample can be imaged; and

a computer which is configured to function as:

an element image obtaining unit configured to obtain, via the at least one optical system, each of the plurality of element images that constitutes the stitched image;

a user image obtaining unit configured to move, according to an instruction from a user, a field of view of the user image obtaining unit to a plurality of positions on the sample corresponding, respectively, to a plurality of user-specified areas on the sample which are specified by the user, each user-specified area corresponding to a current field of view of the user image obtaining unit, and capture, via the at least one optical system, a plurality of user images of the respective user-specified areas on the sample;

a rectangle area deciding unit configured to decide a minimum rectangle area comprising all of the plurality of user images of the plurality of user-specified areas obtained by the user image obtaining unit;

a candidate area deciding unit configured to decide a plurality of candidate areas for obtaining respective ones of the plurality of element images, each of the plurality of candidate areas having a size of a field of view of the element image obtaining unit and being arranged in a grid-like manner in the rectangle area so as to fill the rectangle area decided by the rectangle area deciding unit;

an element area selecting unit configured to select a plurality of element areas for respectively obtaining the plurality of element images, from among the plurality of candidate areas decided by the candidate area deciding unit, wherein the element image obtaining unit obtains, via the at least one optical system, the plurality of element images in the plurality of element areas selected by the element area selecting unit, and

a stitched image generation unit configured to generate the stitched image by stitching the plurality of element images obtained by the element image obtaining unit,

wherein:

the at least one optical system comprises a first optical system and a second optical system;

the first optical system includes a laser light source, a two-dimensional scanning unit configured to scan the sample by laser light emitted from the laser light source, a pinhole plate in which a pinhole is formed on an optically conjugated position with a light-collecting point of the laser light, and a photodetector configured to detect light that has passed through the pinhole plate;

the element image obtaining unit obtains the plurality of element images via the first optical system, the element images being confocal images of the sample each generated from a detection signal output from the photodetector and information of a scanning position from the two-dimensional scanning unit;

the second optical system comprises a light source, an objective lens configured to cast light from the light source on the sample, and a CCD camera comprising a light-receiving plane on an optically conjugated position with a focal plane of the objective lens; and

the user image obtaining unit obtains the plurality of user images via the second optical system, the user images being non-confocal images of the sample generated by the CCD camera.

2. The microscope system according to claim 1 , wherein the element area selecting unit selects, as the plurality of element areas, a plurality of the candidate areas which each comprise an area overlapping with at least one of the plurality of user images of the plurality of user-specified areas, from among the plurality of candidate areas decided by the candidate area deciding unit.

3. The microscope system according to claim 1 , wherein the element area selecting unit selects, based on a selection by the user, the plurality of element areas from among the plurality of candidate areas decided by the candidate area deciding unit.

4. The microscope system according to claim 1 , wherein:

the size of the field of view of the element image obtaining unit is decided based on a scanning amount of the two-dimensional scanning unit.

5. The microscope system according to claim 4 , wherein the candidate area deciding unit decides the scanning amount of the two-dimensional scanning unit so that the plurality of candidate areas arranged in a grid-like manner in the rectangle area fill the rectangle area without sticking out of the rectangle area.

6. The microscope system according to claim 5 , wherein the candidate area deciding unit decides a plurality of different scanning amounts of the two-dimensional scanning unit so that the plurality of candidate areas arranged in a grid-like manner in the rectangle area fill the rectangle area without sticking out of the rectangle area.

7. The microscope system according to claim 1 , further comprising:

a display;

wherein:

the computer is further configured to function as a display control unit configured to control the display, and

the display control unit controls the display so that, on a map image in which the plurality of user images obtained by the user image obtaining unit are arranged according to a layout of the plurality of user-specified areas, a position image indicating positions of the plurality of candidate areas decided by the candidate area deciding unit is overlaid and displayed.

8. The microscope system according to claim 7 , wherein the position image overlaid on the map image is a translucent image.

9. The microscope system according to claim 1 , further comprising:

a display;

wherein:

the computer is further configured to function as a display control unit configured to control the display, and

the display control unit controls the display so that, on a map image in which the plurality of user images obtained by the user image obtaining unit are arranged according to a layout of the plurality of user-specified areas, a position image indicating positions of the plurality of element areas selected by the element area selecting unit is overlaid and displayed.

10. The microscope system according to claim 1 , further comprising:

a display;

wherein:

the computer is further configured to function as a display control unit configured to control the display, and

the display control unit controls the display so that, on a map image in which the plurality of user images obtained by the user image obtaining unit are arranged according to a layout of the plurality of user-specified areas, a position image indicating positions of the plurality of candidate areas decided by the candidate area deciding unit and indicating positions of the plurality of element areas selected by the element area selecting unit distinctly from a position of a candidate area that is not an element area is overlaid and displayed.

11. The microscope system according to claim 10 , wherein the position image overlaid on the map image is a translucent image in which a part corresponding to the candidate area and a part corresponding to the element area have different degrees of transparency.

12. The microscope system according to claim 1 , further comprising a memory configured to store coordinate information of the plurality of element areas selected by the element area selecting unit.

13. The microscope system according to claim 12 , further comprising:

a display;

wherein:

the computer is further configured to function as a display control unit configured to control the display, and

the display control unit makes the display a position image indicating positions of the plurality of element areas overlaid on a sample image being an image of the sample, based on the coordinate information of the plurality of element areas stored in the memory.

14. The microscope system according to claim 13 , wherein when a position specified by the user is outside an area corresponding to the plurality of element areas in the position image, the display control unit moves the position image with respect to the sample image so that the specified position corresponds to a center of the position image.

15. The microscope system according to claim 13 , wherein when a position specified by the user is inside an area corresponding to the plurality of element areas in the position image, the display control unit moves the position image with respect to the sample image so that the specified position corresponds to a center of the element area comprising the specified position.

16. The microscope system according to claim 1 , wherein:

the computer is further configured to function as a rectangle area changing unit configured to change at least one of a size or a position of the rectangle area decided by the rectangle area deciding unit, and

the element area selecting unit re-selects, as an element area, an area in the rectangle area changed by the rectangle area changing unit from the plurality of element areas selected in the element area selecting unit.

17. The microscope system according to claim 16 , further comprising a memory configured to store coordinate information of a plurality of element areas selected by the element area selecting unit before the rectangle area is changed by the rectangle area changing unit.