Apparatus and method for interlocking lesion locations between a guide image and a 3D tomosynthesis images composed of a plurality of 3D image slices
Provided are a method and an apparatus for interlocking a lesion location between a 2D medical image and 3D tomosynthesis images including a plurality of 3D image slices.
1 . An apparatus for displaying a guide image and 3D tomosynthesis images comprising a plurality of 3D image slices, the apparatus comprising:
a memory in which at least one program is stored; and
at least one processor operated by executing the at least one program, wherein the at least one processor is configured to:
receive the guide image and the plurality of 3D image slices constituting the 3D tomosynthesis images of a body part;
simultaneously display the guide image showing a plurality of pieces of lesion information detected from the plurality of 3D image slices, and a first 3D image slice included in the plurality of 3D image slices which shows a part of the plurality of pieces of lesion information; and
in response to receiving a user input of selecting a piece of lesion information among the plurality of pieces of lesion information on the guide image:
identify, from among 3D image slices of the plurality of 3D image slices corresponding to the piece of lesion information, a second 3D image slice having a highest lesion score for a particular lesion corresponding to the piece of lesion information, the highest lesion score being indicative of a malignancy of the particular lesion; and
change the first 3D image slice to the second 3D image slice,
wherein the plurality of pieces of lesion information including a location of at least one lesion and a lesion score of the at least one lesion are predicted by using an artificial intelligence model from the plurality of 3D image slices, and
wherein the at least one processor is further configured to:
display, for each of the plurality of pieces of lesion information displayed on the guide image, identification information of the second 3D image slice and the highest lesion score of the second 3D image slice at a position corresponding to an indicator of the second 3D image slice.
2 . The apparatus according to claim 1 , wherein the guide image is one of a 2D medical image, Synthetic 2D or a 3D image slice.
3 . The apparatus according to claim 1 , wherein the at least one processor is configured to enlarge a partial region of the at least the guide image or the second 3D image slice.
4 . The apparatus according to claim 3 , wherein the at least one processor is further configured to:
perform navigation for the partial region of the second 3D image slice in a depth-wise direction based on a user input, and
maintain the 3D image slice in regions other than the enlarged region based on the enlarged region being changed.
5 . The apparatus according to claim 3 , wherein the at least one processor is configured to enlarge the partial region of the second 3D image slice corresponding to the partial region in response to a user input of enlarging the partial region of the guide image.
6 . The apparatus according to claim 1 ,
wherein first coordinate information of a first region in which the piece of lesion information is displayed on the first 3D image slice corresponds to second coordinate information of a second region in which the piece of lesion information is displayed on the guide image.
7 . The apparatus according to claim 1 , wherein the at least one processor is configured to:
display a slice navigation tool in a display region of the second 3D image slice; and
perform navigation for the 3D tomosynthesis images in a depth-wise direction based on a user input received on the slice navigation tool.
8 . The apparatus according to claim 1 , wherein the at least one processor is configured to:
display a pre-stored medical image in response to selection of the piece of lesion information on the second 3D image slice; and
the pre-stored medical image is obtained by an external medical imaging device.
9 . The apparatus according to claim 8 , wherein the at least one processor is configured to process the pre-stored medical image to correspond to depth information of a currently displayed second 3D image slice and position information of a lesion displayed on the second 3D image slice.
10 . The apparatus according to claim 9 , wherein the at least one processor is configured to display a region corresponding to the depth information of the second 3D image slice and the position information of the lesion from among regions of the pre-stored medical image.
11 . A method of displaying a lesion location between a guide image and 3D tomosynthesis images comprising a plurality of three-dimensional (3D) image slices, the method comprising:
receiving the guide image and the plurality of 3D image slices constituting 3D tomosynthesis images of a body part;
simultaneously displaying the guide image showing a plurality of pieces of lesion information detected from the plurality of 3D image slices, and a first 3D image slice included in the plurality of 3D image slices which shows a part of the plurality of pieces of lesion information; and
in response to receiving a user input of selecting a piece of lesion information among the plurality of pieces of lesion information on the guide image:
identifying, from among 3D image slices of the plurality of 3D image slices corresponding to the piece of lesion information, a second 3D image slice having a highest lesion score for a particular lesion corresponding to the piece of lesion information, the highest lesion score being indicative of a malignancy of the particular lesion; and
changing the first 3D image slice to the second 3D image slice,
wherein the plurality of pieces of lesion information including a location of at least one lesion and a lesion score of the at least one lesion are predicted by using an artificial intelligence model from the plurality of 3D image slices, and
wherein the method further comprises:
displaying, for each of the plurality of pieces of lesion information displayed on the guide image, identification information of the second 3D image slice and the highest lesion score of the second 3D image slice at a position corresponding to an indicator of the second 3D image slice.
12 . A non-transitory computer-readable recording medium having recorded thereon a program for executing the method of claim 11 on a computer.