Diagnosis assisting system, diagnosis assisting method, and program thereof

1. A biological tissue image display apparatus comprising:

memory storing instructions; and

one or more processors to execute the instructions to:

store a reference image obtained by photographing a prefixed stained sample and a comparison image obtained by photographing another stained sample, which are of substantially identical biological tissues;

detect a structure of the biological tissue from the reference image;

generate a partial image as an independent image by cutting out a portion from the comparison image that includes the structure detected;

store the partial image in association with the structure and the comparison image;

output a result screen that includes the reference image and the partial image;

store a plurality of comparison images each corresponding to the comparison image;

detect a plurality of structures each corresponding to the structure from the reference image, cut out from the plurality of comparison images partial images each corresponding to the partial image including one of the plurality of structures detected, and store the partial images each being in association with the structure and the comparison image; and

create a matrix in which identification information of the plurality of structures is arranged along a first axis of the result screen and in which identification information of the plurality of comparison images is arranged along a second axis of the result screen, and arrange the partial images in cells of the matrix in such a way that the partial images including same structures are arranged in the cells whose distances from the second axis are same and the partial images cut out from a same comparison image are arranged in the cells whose distances from the first axis are same, the cells being identified by the structures and the comparison images that are in association with the partial images.

2. The biological tissue image display apparatus according to claim 1 , the one or more processors to execute the instructions to:

extract feature information of each of the plurality of structures from the reference image and the partial images, determine priorities indicating an observation order of the plurality of structures on a basis of the feature information extracted, and store the priorities in association with the plurality of structures, and

arrange the identification information of the plurality of structures along the first axis in order of the priorities.

3. The biological tissue image display apparatus according to claim 1 , the one or more processors to execute the instructions to:

display the reference image, receive selection information of at least one of the plurality of structures, arrange identification information of the plurality of comparison images along a preset axis of the result screen, acquire from the partial image storage means the partial images in association with the structures selected, and arrange the partial images in cells near the identification information of the plurality of comparison images.

4. The biological tissue image display apparatus according to claim 1 , the one or more processors to execute the instructions to:

extract, from each of the plurality of partial images, feature information of each of the structures included in the partial image, and store the feature information in association with the partial image, and

arrange the partial images and the feature information associated with the partial images together in the cells.

5. A biological tissue image display method comprising:

storing a reference image obtained by photographing a prefixed stained sample and a comparison image obtained by photographing another stained sample, which are of substantially identical biological tissues;

detecting a structure of the biological tissue from the reference image

generating a partial image as an independent image by cutting out a portion from the comparison image that includes the structure detected;

storing the partial image in association with the structure and the comparison image;

outputting a result screen that includes the reference image and the partial image;

storing a plurality of comparison images each corresponding to the comparison image;

detecting a plurality of structures each corresponding to the structure from the reference image, cutting out from the plurality of comparison images partial images each corresponding to the partial image including one of the plurality of structures detected, and storing the partial images each being in association with the structure and the comparison image; and

creating a matrix in which identification information of the plurality of structures is arranged along a first axis of the result screen and in which identification information of the plurality of comparison images is arranged along a second axis of the result screen, and arranging the partial images in cells of the matrix in such a way that the partial images including same structures are arranged in the cells whose distances from the second axis are same and the partial images cut out from a same comparison image are arranged in the cells whose distances from the first axis are same, the cells being identified by the structures and the comparison images that are in association with the partial images.

6. The biological tissue image display method according to claim 5 , comprising:

extracting feature information of each of the plurality of structures from the reference image and the partial images, determining priorities indicating an observation order of the plurality of structures on a basis of the feature information extracted, and storing the priorities in association with the plurality of structures; and

arranging the identification information of the plurality of structures along the first axis in order of the priorities.

7. The biological tissue image display method according to claim 5 , comprising:

displaying the reference image, receiving selection information of at least one of the plurality of structures, arranging identification information of the plurality of comparison images along a preset axis of the result screen, acquiring the partial images associated with the structures selected, and arranging the partial images in cells near the identification information of the plurality of comparison images.

8. A non-transitory computer readable medium storing a biological tissue image display program causing a computer to execute:

an image storage step of storing a reference image obtained by photographing a prefixed stained sample and a comparison image obtained by photographing another stained sample, which are of substantially identical biological tissues;

a partial image creation step of:

detecting a structure of the biological tissue from the reference image,

generating a partial image as an independent image by cutting out a portion from the comparison image that includes the structure detected, and

storing into a partial image storage unit the partial image in association with the structure and the comparison image; and

an image output step of:

outputting a result screen that includes the reference image and the partial image;

storing a plurality of comparison images each corresponding to the comparison image;

detecting a plurality of structures each corresponding to the structure from the reference image, cutting out from the plurality of comparison images partial images each corresponding to the partial image including one of the plurality of structures detected, and storing the partial images each being in association with the structure and the comparison image; and

creating a matrix in which identification information of the plurality of structures is arranged along a first axis of the result screen and in which identification information of the plurality of comparison images is arranged along a second axis of the result screen, and arranging the partial images in cells of the matrix in such a way that the partial images including same structures are arranged in the cells whose distances from the second axis are same and the partial images cut out from a same comparison image are arranged in the cells whose distances from the first axis are same, the cells being identified by the structures and the comparison images that are in association with the partial images.