Ultrasonic diagnostic apparatus, scan support method, and medical image processing apparatus
An ultrasonic diagnosis apparatus includes a position detector, and control circuitry. The position detector detects a position in a three-dimensional space of one of an ultrasonic image and an ultrasonic probe. The control circuitry uses a vivisection view defined in a three-dimensional space. The control circuitry associates a structure related to a subject included in the ultrasonic image with a structure included in the vivisection view using a position and orientation in a first three-dimensional coordinate system of the structure related to the subject included in the ultrasonic image and a position and orientation in a second three-dimensional coordinate system of the structure included in the vivisection view.
1. An ultrasonic diagnosis apparatus comprising:
a position detector configured to detect a position in a three-dimensional space of one of an ultrasonic image and an ultrasonic probe;
control circuitry configured to:
use a vivisection view defined in a three-dimensional space, and
associate a structure related to a subject included in the ultrasonic image with a structure included in the vivisection view using a position and orientation in a first three-dimensional coordinate system of the structure related to the subject included in the ultrasonic image and a position and orientation in a second three-dimensional coordinate system of the structure included in the vivisection view; and
image calculation circuitry configured to generate a display image including the ultrasonic image and at least a support image indicating textual information associated with the structure.
2. The apparatus of claim 1 , wherein
the control circuitry recognizes an organ and/or the structure included in the ultrasonic image based on information of the vivisection view corresponding to the detected position in the three-dimensional space, and acquires support information about the recognized organ and/or the structure, and
the image calculation circuitry is configured to generate the display image including the ultrasonic image and the support information by arranging the ultrasonic image and the support information side by side or superimposing the support information on the ultrasonic image.
3. The apparatus of claim 1 , further comprising:
a storage, wherein
the control circuitry specifies an organ and/or the structure included in the ultrasonic image based on information of the vivisection view corresponding to the detected position in the three-dimensional space,
the control circuitry acquires support information about the specified organ and/or the structure, and
the storage is configured to save the ultrasonic image and the support information in association with each other.
4. The apparatus of claim 2 , further comprising:
a storage configured to save the support information,
wherein the control circuitry acquires an image using the support information saved in the storage.
5. The apparatus of claim 1 , wherein,
the control circuitry converts, based on a position and orientation of a characteristic portion represented in the first three-dimensional coordinate system, which are detected by the position detector by scanning the ultrasonic probe, the position and orientation of the characteristic portion into a biological coordinate system, and
the control circuitry associates the structure related to the subject included in the ultrasonic image with the structure included in the vivisection view using the position and orientation in the biological coordinate system of the characteristic portion and a position and orientation in the second three-dimensional coordinate system of a characteristic portion included in the vivisection view.
6. The apparatus of claim 1 , wherein the control circuitry performs association by enlarging, reducing, or deforming the second three-dimensional coordinate system based on the first three-dimensional coordinate system.
7. The apparatus of claim 5 , wherein the control circuitry performs association by enlarging, reducing, or deforming the second three-dimensional coordinate system based on the biological coordinate system.
8. The apparatus of claim 1 , further comprising:
an interface configured to accept designation from an operator,
wherein the control circuitry associates the structure related to the subject included in the ultrasonic image with the structure included in the vivisection view using a position and orientation in the first three-dimensional coordinate system of a structure designated via the interface and a position and orientation in the second three-dimensional coordinate system of the structure included in the vivisection view.
9. The apparatus of claim 1 , wherein,
the control circuitry aligns a stored three-dimensional medical image with the first three-dimensional coordinate system, and
the control circuitry associates a characteristic portion included in the three-dimensional medical image with a characteristic portion included in the vivisection view by inter-image alignment.
10. The apparatus of claim 2 , wherein if the organ and/or the structure is recognized based on the information of the vivisection view corresponding to the detected position in the three-dimensional space, the control circuitry acquires an organ content as the support information.
11. The apparatus of claim 10 , wherein the organ content is an examination finding example in ultrasonic examination of the organ.
12. The apparatus of claim 10 , wherein the organ content is diagnosis information and/or treatment information of the organ.
13. The apparatus of claim 10 , wherein the organ content is a result of non-image examination including blood examination of the subject.
14. The apparatus of claim 2 , wherein
the control circuitry acquires a name of the recognized organ and/or the structure as the support information, and
the image calculation circuitry generates the display image by assigning the name to the recognized organ and/or the structure.
15. The apparatus of claim 1 , wherein the image calculation circuitry generates the ultrasonic image and at least the support image indicating the textual information associated with the structure selected by a user, and displays the ultrasonic image and at least the support image together.
16. A scan support method for an ultrasonic diagnostic apparatus, the method comprising:
detecting a position in a first three-dimensional coordinate system of one of an ultrasonic image and an ultrasonic probe;
associating a structure related to a subject included in the ultrasonic image with a structure included in a vivisection view using a position and orientation in the first three-dimensional coordinate system of the structure related to the subject included in the ultrasonic image and a position and orientation in a second three-dimensional coordinate system of the structure included in the vivisection view; and
generating a display image including the ultrasonic image and at least a support image indicating textual information associated with the structure.
17. The method of claim 16 , further comprising:
recognizing an organ and/or the structure included in the ultrasonic image based on information of the vivisection view corresponding to the detected position in the first three-dimensional coordinate system;
acquiring support information about the recognized organ and/or the structure; and
generating the display image including the ultrasonic image and the support information by arranging the ultrasonic image and the support information side by side or superimposing the support information on the ultrasonic image.
18. The method of claim 16 , further comprising:
recognizing an organ and/or the structure included in the ultrasonic image based on information of the vivisection view corresponding to the detected position in the first three-dimensional coordinate system;
acquiring support information about the recognized organ and/or the structure; and
saving the ultrasonic image and the support information in association with each other in a storage.
19. The method of claim 16 , further comprising:
searching the image using saved support information.
20. The method of claim 16 , further comprising:
converting, based on the position and orientation of a characteristic portion represented in the first three-dimensional coordinate system, which is detected by scanning the ultrasonic probe, the position and orientation of the characteristic portion into a biological coordinate system,
wherein the structure related to the subject included in the ultrasonic image is associated with the structure included in the vivisection view using the position and orientation of the characteristic portion and a position and orientation in the second three-dimensional coordinate system of a characteristic portion included in the vivisection view.
21. The method of claim 16 , wherein the association is performed by enlarging, reducing, or deforming the second three-dimensional coordinate system based on the first three-dimensional coordinate system.
22. The method of claim 16 , further comprising:
aligning a stored three-dimensional medical image with the first three-dimensional coordinate system,
wherein a characteristic portion included in the three-dimensional medical image is associated with a characteristic portion included in the vivisection view by inter-image alignment.
23. The method of claim 16 , further comprising:
generating the ultrasonic image and at least the support image indicating the textual information associated with the structure selected by a user; and
displaying the ultrasonic image and at least the support image together.