Image processing apparatus, image capturing system, image processing method, and image processing program
An image processing apparatus includes at least one processor, and the processor is configured to: acquire a synthesized two-dimensional image including information in a depth direction of a breast, the synthesized two-dimensional image being a composite image obtained by synthesizing a plurality of radiation images of the breast imaged in a compression state by a compression member; display the synthesized two-dimensional image; acquire position information indicating a position in the displayed synthesized two-dimensional image; acquire a plurality of ultrasound images of the breast imaged in a compression state by the compression member, the compression state which is considered to be the same as that in capturing the radiation image; and display an ultrasound image for display according to the plurality of ultrasound images with depth information indicating a depth of the breast corresponding to the position indicated by the position information added thereto.
1 . An image processing apparatus comprising at least one processor, wherein the processor is configured to:
acquire a synthesized two-dimensional image including information in a depth direction of a breast, the synthesized two-dimensional image being a composite image obtained by synthesizing a plurality of radiation images of the breast imaged in a compression state by a compression member;
display the synthesized two-dimensional image;
acquire position information indicating a position in the displayed synthesized two-dimensional image;
acquire a plurality of ultrasound images of the breast imaged in a compression state by the compression member, the compression state which is considered to be the same as that in capturing the radiation image; and
display an ultrasound image for display according to the plurality of ultrasound images with depth information indicating a depth of the breast corresponding to the position indicated by the position information added thereto,
wherein the ultrasound image for display includes at least a first cross-sectional ultrasound image and a second cross-sectional ultrasound image, and
the processor is further configured to
display, as the depth information, lines serving as an indicator at a position corresponding to the depth in the first and second cross-sectional ultrasound images,
detect a first region of interest from the synthesized two-dimensional image,
display, on the synthesized two-dimensional image, first region-of-interest information indicating the first region of interest,
acquire a position of the first region of interest as the position information,
display, on the synthesized two-dimensional image, a cross section line passing through a centroid position or a maximum density position of the region of interest, and
display the ultrasound image for display representing the cross section designated by the cross section line.
2 . The image processing apparatus according to claim 1 ,
wherein the ultrasound image for display is any of the plurality of ultrasound images,
the first cross-sectional ultrasound image is a cross-sectional image in a direction intersecting an imaging table on which the breast is placed;
the second cross-sectional ultrasound image is synthesized from the plurality of ultrasound images and is a cross-sectional image in a direction intersecting the imaging table and the first cross-sectional ultrasound image; and
the ultrasound image for display further includes at least one of:
a third cross-sectional image that is synthesized from the plurality of ultrasound images and is a cross-sectional image parallel to the imaging table; or
a three-dimensional ultrasound image that is synthesized from the plurality of ultrasound images and corresponds to a cross section parallel to the imaging table.
3 . The image processing apparatus according to claim 2 ,
wherein the processor is configured to display, as the ultrasound image for display to which the depth information is added, at least one of the third cross-sectional image or the three-dimensional ultrasound image corresponding to a cross section according to a position of the depth of the breast corresponding to the position indicated by the position information.
4 . The image processing apparatus according to claim 1 ,
wherein the processor is configured to:
detect a first region of interest from the synthesized two-dimensional image;
display, on the synthesized two-dimensional image, first region-of-interest information indicating the first region of interest;
acquire position information indicating a position of the first region of interest;
detect a second region of interest from a region corresponding to a vicinity of the first region of interest in the ultrasound image for display; and
display, on the ultrasound image for display, second region-of-interest information indicating the second region of interest.
5 . The image processing apparatus according to claim 4 ,
wherein the processor is configured to:
in a case in which a plurality of the second regions of interest are detected, display a list of scores indicating a degree of suspicion of each second region of interest; and
in a case in which a second region of interest designated from the list is received, display information indicating the received second region of interest on the ultrasound image for display.
6 . The image processing apparatus according to claim 1 ,
wherein the radiation image is a radiation image obtained by tomosynthesis imaging, and the processor is configured to:
acquire a tomographic image obtained by reconstructing the radiation image;
detect a first region of interest from the tomographic image;
display, on the synthesized two-dimensional image, a corresponding region corresponding to the first region of interest;
acquire position information indicating a position of the corresponding region on the synthesized two-dimensional image;
detect a second region of interest from a region corresponding to a vicinity of the first region of interest in the ultrasound image for display according to the position indicated by the position information; and
display, on the ultrasound image for display, second region-of-interest information indicating the second region of interest.
7 . The image processing apparatus according to claim 1 ,
wherein the processor is configured to:
display a movable cross section line on the synthesized two-dimensional image to designate a position of a cross section; and
display the ultrasound image for display representing the cross section designated by the cross section line.
8 . The image processing apparatus according to claim 1 ,
wherein the processor is configured to display, as the cross section line, two cross section lines with the centroid position or the maximum density position of the first region of interest as an intersection.
9 . The image processing apparatus according to claim 1 ,
wherein the processor is configured to:
detect a second region of interest from the ultrasound image for display representing a cross section designated by a cross section line; and
display, on the ultrasound image for display, second region-of-interest information indicating the detected second region of interest.
10 . The image processing apparatus according to claim 1 ,
wherein the radiation image is a radiation image obtained by tomosynthesis imaging, and the processor is configured to:
acquire a tomographic image obtained by reconstructing the radiation image;
detect a first region of interest from the tomographic image;
acquire position information indicating a position corresponding to the first region of interest on the synthesized two-dimensional image;
display, on the synthesized two-dimensional image, a cross section line passing through a centroid position or a maximum density position of the first region of interest;
display the ultrasound image for display representing a cross section designated by the cross section line;
detect a second region of interest from the ultrasound image for display; and
display, on the ultrasound image for display, second region-of-interest information indicating the second region of interest.
11 . The image processing apparatus according to claim 10 ,
wherein the processor is configured to:
in a case in which a plurality of the second regions of interest are detected from the ultrasound image for display, display a list of scores indicating a degree of suspicion of each second region of interest; and
in a case in which a second region of interest designated from the list is received, display the second region-of-interest information indicating the received second region of interest on the ultrasound image for display.
12 . The image processing apparatus according to claim 1 ,
wherein the processor is configured to determine that, in a case in which capturing of the ultrasound image and capturing of the radiation image are continuously performed while the breast is kept being compressed by the compression member, the compression state of the breast in the capturing of the ultrasound image and the compression state of the breast in the capturing of the radiation image are the same.
13 . The image processing apparatus according to claim 1 ,
wherein the processor is configured to determine that, in a case in which compression conditions for compressing the breast are the same in the capturing the ultrasound image and in the capturing of the radiation image, the compression state of the breast in capturing of the ultrasound image and the compression state of the breast in capturing of the radiation image are the same.
14 . The image processing apparatus according to claim 1 ,
wherein the processor is configured to determine that, in a case in which a state of the compressed breast are the same in the capturing the ultrasound image and in the capturing of the radiation image, the compression state of the breast in capturing of the ultrasound image and the compression state of the breast in capturing of the radiation image are the same.
15 . The image processing apparatus according to claim 1 ,
wherein the processor is configured to further determine that, in a case in which at least one of a size or a hardness of the breast itself in capturing of the plurality of ultrasound images and in capturing of the radiation image are considered to be the same, the compression state of the breast in the capturing of the ultrasound image and the compression state of the breast in the capturing of the radiation image are the same.
16 . An image capturing system comprising:
the image processing apparatus according to claim 1 ;
a radiography apparatus; and
an ultrasonography apparatus.
17 . An image processing method executed by a computer, the method comprising:
acquiring a synthesized two-dimensional image including information in a depth direction of a breast, the synthesized two-dimensional image being a composite image obtained by synthesizing a plurality of radiation images of the breast imaged in a compression state by a compression member;
displaying the synthesized two-dimensional image;
acquiring position information indicating a position in the displayed synthesized two-dimensional image;
acquiring a plurality of ultrasound images of the breast imaged in a compression state by the compression member, the compression state which is considered to be the same as that in capturing the radiation image; and
displaying an ultrasound image for display according to the plurality of ultrasound images with depth information indicating a depth of the breast corresponding to the position indicated by the position information added thereto,
wherein the ultrasound image for display includes at least a first cross-sectional ultrasound image and a second cross-sectional ultrasound image, and
the method further comprises
displaying, as the depth information, lines serving as an indicator at a position corresponding to the depth in the first and second cross-sectional ultrasound images,
detecting a first region of interest from the synthesized two-dimensional image,
displaying, on the synthesized two-dimensional image, first region-of-interest information indicating the first region of interest,
acquiring a position of the first region of interest as the position information,
displaying, on the synthesized two-dimensional image, a cross section line passing through a centroid position or a maximum density position of the region of interest, and
displaying the ultrasound image for display representing the cross section designated by the cross section line.
18 . A non-transitory storage medium storing an image processing program for causing a computer to execute image processing, the image processing comprising:
acquiring a synthesized two-dimensional image including information in a depth direction of a breast, the synthesized two-dimensional image being a composite image obtained by synthesizing a plurality of radiation images of the breast imaged in a compression state by a compression member;
displaying the synthesized two-dimensional image;
acquiring position information indicating a position in the displayed synthesized two-dimensional image;
acquiring a plurality of ultrasound images of the breast imaged in a compression state by the compression member, the compression state which is considered to be the same as that in capturing the radiation image; and
displaying an ultrasound image for display according to the plurality of ultrasound images with depth information indicating a depth of the breast corresponding to the position indicated by the position information added thereto,
wherein the ultrasound image for display includes at least a first cross-sectional ultrasound image and a second cross-sectional ultrasound image, and
the image processing further comprises
displaying, as the depth information, lines serving as an indicator at a position corresponding to the depth in the first and second cross-sectional ultrasound images,
detecting a first region of interest from the synthesized two-dimensional image,
displaying, on the synthesized two-dimensional image, first region-of-interest information indicating the first region of interest,
acquiring a position of the first region of interest as the position information,
displaying, on the synthesized two-dimensional image, a cross section line passing through a centroid position or a maximum density position of the region of interest, and
displaying the ultrasound image for display representing the cross section designated by the cross section line.