Observation system, recording medium, and control method of observation system

1. An observation system configured to observe a sample mass formed of samples gathering in a container containing the samples and a solution, the observation system comprising:

an entire image pickup unit configured to pick up an image of the entire container;

a sample mass identification unit configured to identify a sample mass formed in the container, from a macro observation image obtained by picking up an image of the entire container;

a magnifying image pickup unit configured to magnify and pick up an image of a part of an area in the container including the sample mass identified by the sample mass identification unit; and

a history information storage unit configured to store position information of the sample mass in association with time and date information,

the magnifying image pickup unit further configured to magnify and pick up an image of a part of an area in the container based on the past position information stored in the history information storage unit, while the sample mass identification unit is executing processing of identifying the sample mass.

2. The observation system according to claim 1 , wherein

when the sample mass is identified by the sample mass identifying unit and when an image of an area including the sample mass has already been picked up, the magnifying image pickup unit does not pick up an image of the area.

3. The observation system according to claim 1 , wherein

while the sample mass identification unit is executing processing of identifying the sample mass, in a case where a predetermined number or more of pieces of the position information estimated to be position information of the same sample mass are stored in the history information storage unit, the magnifying image pickup unit acquires an estimated position of a sample mass in the container based on the position information, and magnifies and picks up an image of a part of an area in the container including the estimated position.

4. The observation system according to claim 3 , wherein

in a case where a difference between first position information and second position information stored in the history information storage unit is within a predetermined range, the magnifying image pickup unit estimates that the first position information and the second position information are position information of the same sample mass.

5. The observation system according to claim 1 , further comprising:

a detail judgment unit configured to

extract a predetermined feature amount from a magnified observation image obtained by magnifying and picking up, with the magnifying image pickup unit, an image of a part of an area in the container including a sample mass identified by the sample mass identification unit,

judge whether the sample mass whose magnified observation image has been picked up is to be an observation target or not, based on the predetermined feature amount, and

store a judgment result in the history information storage unit, in association with position information of the sample mass, wherein

while the sample mass identification unit is executing processing of identifying a sample mass in the container, the magnifying image pickup unit acquires an estimated position of the sample mass in the container, based on the position information of the sample mass judged to be the observation target among the past position information stored in the history information storage unit, and magnifies and picks up an image of a part of an area in the container including the estimated position.

6. The observation system according to claim 1 , further comprising:

an observation apparatus control unit configured to, when the magnifying image pickup unit has magnified and picked up an image of a part of an area in the container including the sample mass identified by the sample mass identification unit, store information indicative that an image of the sample mass has been picked up in the history information storage unit, in association with position information of the sample mass, wherein

while the sample mass identification unit is executing processing of identifying a sample mass in the container, the magnifying image pickup unit acquires an estimated position of the sample mass in the container, based on the position information associated with the information indicative that an image of the sample mass has been picked up among the past position information stored in the history information storage unit, and magnifies and picks up an image of a part of an area in the container including the estimated position.

7. The observation system according to claim 1 , further comprising:

an observation apparatus control unit configured to, when the magnifying image pickup unit has magnified and picked up an image of a part of an area in the container including the sample mass identified by the sample mass identification unit, store information indicative that an image of the sample mass has been picked up in the history information storage unit, in association with position information of the sample mass, wherein

while the sample mass identification unit is executing processing of identifying a sample mass in the container, the magnifying image pickup unit acquires an estimated position of the sample mass in the container, based on the position information not associated with the information indicative that an image of the sample mass has been picked up among the past position information stored in the history information storage unit, and magnifies and picks up an image of a part of an area in the container including the estimated position.

8. The observation system according to claim 1 , further comprising:

an observation apparatus control unit configured to, when the magnifying image pickup unit has magnified and picked up an image of a part of an area in the container including the sample mass identified by the sample mass identification unit, store information indicative that an image of the sample mass has been picked up in the history information storage unit, in association with position information of the sample mass; and

a detail judgment unit configured to

extract a predetermined feature amount from a magnified observation image obtained by magnifying and picking up an image of the part of the area with the magnifying image pickup unit,

judge whether the sample mass whose magnified observation image has been picked up is to be an observation target or not, based on the extracted predetermined feature amount, and

store a judgment result in the history information storage unit, in association with position information of the sample mass, wherein

while the sample mass identification unit is executing processing of identifying a sample mass in the container,

the magnifying image pickup unit

acquires a first estimated position of the sample mass in the container, based on position information associated with a judgment result that the sample mass is the observation target among a plurality of pieces of the past position information stored in the history information storage unit, and magnifies and picks up an image of an area in the container including the first estimated position, and thereafter,

acquires a second estimated position of the sample mass in the container, based on position information associated with the information indicative that an image of the sample mass has been picked up among the plurality of pieces of the position information, and magnifies and picks up an image of an area in the container including the second estimated position, and thereafter,

acquires a third estimated position of the sample mass in the container, based on position information not associated with the information indicative that an image of the sample mass has been picked up among the plurality of pieces of the position information, and magnifies and picks up an image of an area in the container including the third estimated position.

9. The observation system according to claim 1 , wherein

the sample contained in the container is a cell, and the solution is a culture fluid for the cell.

10. A computer readable recording medium having a program recorded therein, the program causing a computer, configured to control an observation system configured to observe a sample mass formed of samples gathering in a container containing the samples and a solution, to execute steps of:

picking up an image of the entire container;

identifying a sample mass formed in the container from a macro observation image obtained by picking up an image of the entire container;

magnifying and picking up an image of a part of an area in the container including the identified sample mass;

storing position information of the sample mass in a history information storage unit, in association with time and date information; and

magnifying and picking up an image of a part of an area in the container based on the past position information stored in the history information storage unit while executing processing of identifying the sample mass.

11. A method for controlling an observation system configured to observe a sample mass formed of samples gathering in a container containing the samples and a solution, the method comprising:

picking up an image of the entire container, with the observation system;

identifying, with the observation system, a sample mass formed in the container from a macro observation image obtained by picking up an image of the entire container;

magnifying and picking up, with the observation system, an image of a part of an area in the container including the identified sample mass;

storing, with the observation system, position information of the sample mass in a history information storage unit, in association with time and date information; and

magnifying and picking up, with the observation system, an image of a part of an area in the container based on the past position information stored in the history information storage unit, while executing processing of identifying the sample mass.