Microscope system. method and computer-readable storage device storing instructions for generating joined images

1. A microscope system comprising:

a microscope comprising:

a stage on which a sample is mounted;

a camera configured to be controlled to capture a plurality of live images of the sample mounted on the stage at a prescribed frame rate; and

an actuator configured to be controlled by a user to move the stage relative to the camera; and

a processor comprising hardware, wherein the processor is configured to:

generate a first joined image of the sample based on a first live image captured by the camera;

calculate relative positions between the live images consecutively captured by the camera at the prescribed frame rate;

cumulatively add the relative positions to obtain a cumulative value;

detect a position of the stage relative to the camera from the cumulative value;

as the user controls the actuator to move the stage relative to the camera, determine, on the basis of the position of the stage relative to the camera, whether the position of the stage relative to the camera is within a predetermined range;

while the position of the stage relative to the camera is determined to be within the predetermined range:

control an output device to perform a first notification; and

determine whether a moving speed of the stage relative to the camera is at or below a prescribed threshold; and

in response to determining that the moving speed of the stage relative to the camera is at or below the prescribed threshold, join at least the first joined image and a second live image captured by the camera to generate a second joined image.

2. The microscope system according to claim 1 ,

wherein the output device comprises a display, and

wherein the processor is configured to:

control the display to display the first joined image and a field of view of the camera; and

while the position of the stage relative to the camera is determined to be within the predetermined range, control the display to display the first notification.

3. The microscope system according to claim 1 ,

wherein the processor is configured to detect the moving speed of the stage relative to the camera on the basis of the relative positions between the live images consecutively captured by the camera.

4. The microscope system according to claim 1 ,

wherein the processor is configured to detect, as the position of the stage relative to the camera, the relative position between the first joined image and the second live image captured by the camera.

5. The microscope system according to claim 1 ,

wherein the processor is configured to detect, as the moving speed of the stage relative to the camera, a temporal change in the position of the stage relative to the camera detected.

6. The microscope system according to claim 1 ,

wherein the processor is configured to perform positioning of the first joined image and the second live image prior to joining the first joined image and the second live image to generate the second joined image.

7. The microscope system according to claim 1 ,

wherein the microscope comprises:

optical elements, wherein the stage is configured to move in a direction perpendicular to an observation optical axis of the optical elements, and

wherein the processor is configured to detect the moving speed of the stage relative to the camera.

8. The microscope system according to claim 1 ,

wherein the processor is configured to:

determine, on the basis of the position of the stage relative to the camera, whether or not a ratio of an area of an overlapping portion of the first joined image and the second live image to be captured falls within a prescribed range; and

in response to determining that the area of the overlapping portion falls within the prescribed range, determine that the position of the stage relative to the camera is within the predetermined range.

9. The microscope system according to claim 1 ,

wherein the processor is configured to:

calculate a distance between a position of the stage relative to the camera at which a first live image was captured and a current position of the stage relative to the camera;

determine whether or not the distance falls within a prescribed range of values; and

in response to determining that the distance falls within the prescribed range of values, determine that the position of the stage relative to the camera is within the predetermined range.

10. The microscope system according to claim 1 ,

wherein the processor is configured to:

in response to determining that the position of the stage relative to the camera is not within the predetermined range, control the output device to perform a second notification different from the first notification.

11. A method for controlling a microscope system comprising:

a microscope comprising:

a stage on which a sample is mounted;

a camera configured to be controlled to capture a plurality of live images of the sample mounted on the stage at a prescribed frame rate; and

an actuator configured to be controlled by a user to move the stage relative to the camera,

wherein the method comprises:

generating a first joined image of the sample based on a first live image captured by the camera;

calculating relative positions between the live images consecutively captured by the camera at the prescribed frame rate;

cumulatively adding the relative positions to obtain a cumulative value;

detecting a position of the stage relative to the camera from the cumulative value;

as the user controls the actuator to move the stage relative to the camera, determining, on the basis of the position of the stage relative to the camera, whether the position of the stage relative to the camera is within a predetermined range;

while the position of the stage relative to the camera is determined to be within the predetermined range:

controlling an output device to perform a first notification; and

determining whether a moving speed of the stage relative to the camera is at or below a prescribed threshold; and

in response to determining that the moving speed of the stage relative to the camera is at or below the prescribed threshold, joining at least the first joined image and a second live image captured by the camera to generate a second joined image.

12. A computer-readable storage device storing instructions that cause a computer to control a microscope system comprising:

a microscope comprising:

a stage on which a sample is mounted;

a camera configured to be controlled to capture a plurality of live images of the sample mounted on the stage at a prescribed frame rate; and

an actuator configured to be controlled by a user to move the stage relative to the camera,

wherein the instructions cause the computer to at least:

generate a first joined image of the sample based on a first live image captured by the camera;

calculate relative positions between the live images consecutively captured by the camera at the prescribed frame rate;

cumulatively add the relative positions to obtain a cumulative value;

detect a position of the stage relative to the camera from the cumulative value;

as the user controls the actuator to move the stage relative to the camera, determine, on the basis of the position of the stage relative to the camera, whether the position of the stage relative to the camera is within a predetermined range;

while the position of the stage relative to the camera is determined to be within the predetermined range:

control an output device to perform a first notification; and

determine whether a moving speed of the stage relative to the camera is at or below a prescribed threshold; and

in response to determining that the moving speed of the stage relative to the camera is at or below the prescribed threshold, join at least the first joined image and a second live image captured by the camera to generate a second joined image.