Interactive 3D cursor for use in medical imaging
An interactive 3D cursor facilitates selection and manipulation of a three-dimensional volume from a three-dimensional image. The selected volume image may be transparency-adjusted and filtered to remove selected tissues from view. Qualitative and quantitative analysis of tissues in a selected volume may be performed. Location indicators, annotations, and registration markers may be overlaid on selected volume images.
1. A method for displaying a structure in a head display unit, the method comprising:
obtaining image data representing the structure in a three-dimensional (3D) image space;
obtaining an initial representation of a 3D cursor in the 3D image space, the 3D cursor having a 3D shape with an initial position in the 3D image space, and the 3D cursor containing the structure;
obtaining an initial viewing angle for orienting the 3D cursor and the structure in the 3D image space;
obtaining an initial left eye viewpoint for a left eye and an initial right eye viewpoint for a right eye for viewing the 3D cursor and the structure, wherein the initial right eye viewpoint is offset from the initial left eye viewpoint;
displaying, by the head display unit, a left eye image for the left eye based on the initial left eye viewpoint, the initial viewing angle, the 3D cursor, and the structure, and a right eye image for the right eye based on the initial right eye viewpoint, the initial viewing angle, the 3D cursor, and the structure;
obtaining an input to apply a rotation of the 3D cursor containing the structure about the 3D cursor's center;
responsive to the input, generating an updated viewing angle of the 3D cursor and the structure contained within the 3D cursor to reorient the 3D cursor and the structure in the 3D image space based on the rotation; and
displaying, by the head display unit, an updated left eye image for the left eye based on the initial left eye viewpoint, the updated viewing angle, the 3D cursor, and the structure, and an updated right eye image for the right eye based on the initial right eye viewpoint, the updated viewing angle, the 3D cursor and the structure.
2. The method of claim 1 , further comprising:
receiving an input to zoom in on the structure contained within the 3D cursor;
responsive to the input, moving the initial left eye viewpoint to an updated left eye viewpoint closer to the structure and moving the initial right eye viewpoint to an updated right eye viewpoint closer to the structure; and
displaying, by the head display unit, a further updated left eye image for the left eye and a further updated right eye image for the right eye based on the updated left eye viewpoint and the updated right eye viewpoint.
3. The method of claim 1 , further comprising:
receiving an input to move the initial left eye viewpoint and the initial right eye viewpoint to a different angle with respect to the 3D cursor containing the structure to obtain and moved left eye viewpoint and a moved right eye viewpoint; and
displaying, by the head display unit, a further updated left eye image for the left eye and a further updated right eye image for the right eye based on the moved left eye viewpoint and moved right eye viewpoint.
4. The method of claim 1 , further comprising:
receiving an input to enlarge the 3D cursor to obtain an enlarged 3D cursor;
updating the structure's size to obtain an enlarged structure contained within the enlarged 3D cursor; and
displaying, by the head display unit, a further updated left eye image for the left eye and a further updated right eye image for the right eye based on the enlarged 3D cursor and the enlarged structure.
5. The method of claim 1 , further comprising:
receiving an input to move the 3D cursor within 3D image space from the initial position to a moved position; and
displaying, by the head display unit, a further updated left eye image for the left eye and a further updated right eye image for the right eye based on the moved position of the 3D cursor.
6. The method of claim 1 , wherein obtaining the input to apply the rotation comprises receiving a user control from a human machine interface.
7. The method of claim 1 , wherein displaying the updated left eye image and the updated right eye image comprises:
identifying a center point of the 3D cursor;
obtaining a left eye center viewing angle and a right eye center viewing angle that converge at the center point; and
generating the updated left eye image based on the left eye center viewing angle and the updated right eye image based on the right eye center viewing angle.
8. The method of claim 1 , further comprising:
tracking motion of the head display unit;
generating an updated left eye viewpoint and an updated right eye viewpoint based on the motion; and
displaying, by the head display unit, a further updated left eye image for the left eye based on the updated left eye viewpoint and a further updated right eye image for the right eye based on the updated right eye viewpoint.
9. The method of claim 1 , further comprising:
receiving an input to apply an image processing function to the structure contained within the 3D cursor; and
displaying, by the head display unit, a further updated left eye image for the left eye and a further updated right eye image for the right eye based on the image processing function.
10. The method of claim 1 , wherein obtaining the initial representation of the 3D cursor comprises:
receiving an input indicative of a color and size of the 3D cursor; and
generating the initial representation of the 3D cursor based on the color and size.
11. The method of claim 1 , wherein displaying the left eye image and the right eye image comprises:
determining, for the updated left eye image, left eye pixel angles for respective left eye pixels in the updated left eye image;
identifying respective left eye voxel cones through the structure for each of the left eye pixel angles; and
generating respective left eye pixel values for the respective left eye pixels in the updated left eye image based on the respective left eye voxel cones;
determining, for the right eye image, right eye pixel angles for respective right eye pixels in the updated right eye image;
identifying respective right eye voxel cones through the structure for each of the right eye pixel angles; and
generating respective right eye pixel values for the respective right eye pixels in the updated right eye image based on the respective right eye voxel cones.
12. A non-transitory computer-readable storage medium storing instructions for displaying a structure in a head display unit, the instructions when executed by a processor causing the processor to perform steps including:
obtaining image data representing the structure in a three-dimensional (3D) image space;
obtaining an initial representation of a 3D cursor in the 3D image space, the 3D cursor having a 3D shape with an initial position in the 3D image space, and the 3D cursor containing the structure;
obtaining an initial viewing angle for orienting the 3D cursor and the structure in the 3D image space;
obtaining an initial left eye viewpoint for a left eye and an initial right eye viewpoint for a right eye for viewing the 3D cursor and the structure, wherein the initial right eye viewpoint is offset from the initial left eye viewpoint;
displaying, by the head display unit, a left eye image for the left eye based on the initial left eye viewpoint, the initial viewing angle, the 3D cursor, and the structure, and a right eye image for the right eye based on the initial right eye viewpoint, the initial viewing angle, the 3D cursor, and the structure;
obtaining an input to apply a rotation of the 3D cursor containing the structure about the 3D cursor's center;
responsive to the input, generating an updated viewing angle of the 3D cursor and the structure contained within the 3D cursor to reorient the 3D cursor and the structure in the 3D image space based on the rotation; and
displaying, by the head display unit, an updated left eye image for the left eye based on the initial left eye viewpoint, the updated viewing angle, the 3D cursor, and the structure, and an updated right eye image for the right eye based on the initial right eye viewpoint, the updated viewing angle, the 3D cursor and the structure.
13. The non-transitory computer-readable storage medium of claim 12 , wherein the instructions further cause the processor to perform steps including:
receiving an input to zoom in on the structure contained within the 3D cursor;
responsive to the input, moving the initial left eye viewpoint to an updated left eye viewpoint closer to the structure and moving the initial right eye viewpoint to an updated right eye viewpoint closer to the structure; and
displaying, by the head display unit, a further updated left eye image for the left eye and a further updated right eye image for the right eye based on the updated left eye viewpoint and the updated right eye viewpoint.
14. The non-transitory computer-readable storage medium of claim 12 , wherein the instructions further cause the processor to perform steps including:
receiving an input to move the initial left eye viewpoint and the initial right eye viewpoint to a different angle with respect to the 3D cursor containing the structure to obtain and moved left eye viewpoint and a moved right eye viewpoint; and
displaying, by the head display unit, a further updated left eye image for the left eye and a further updated right eye image for the right eye based on the moved left eye viewpoint and moved right eye viewpoint.
15. The non-transitory computer-readable storage medium of claim 12 , wherein the instructions further cause the processor to perform steps including:
receiving an input to enlarge the 3D cursor to obtain an enlarged 3D cursor;
updating the structure's size to obtain an enlarged structure contained within the enlarged 3D cursor; and
displaying, by the head display unit, a further updated left eye image for the left eye and a further updated right eye image for the right eye based on the enlarged 3D cursor and the enlarged structure.
16. The non-transitory computer-readable storage medium of claim 12 , wherein the instructions further cause the processor to perform steps including:
receiving an input to move the 3D cursor within 3D image space from the initial position to a moved position; and
displaying, by the head display unit, a further updated left eye image for the left eye and a further updated right eye image for the right eye based on the moved position of the 3D cursor.
17. The non-transitory computer-readable storage medium of claim 12 , wherein obtaining the input to apply the rotation comprises receiving a user control from a human machine interface.
18. The non-transitory computer-readable storage medium of claim 12 , wherein displaying the updated left eye image and the updated right eye image comprises:
identifying a center point of the 3D cursor;
obtaining a left eye center viewing angle and a right eye center viewing angle that converge at the center point; and
generating the updated left eye image based on the left eye center viewing angle and the updated right eye image based on the right eye center viewing angle.
19. The non-transitory computer-readable storage medium of claim 12 , wherein the instructions further cause the processor to perform steps including:
tracking motion of the head display unit;
generating an updated left eye viewpoint and an updated right eye viewpoint based on the motion; and
displaying, by the head display unit, a further updated left eye image for the left eye based on the updated left eye viewpoint and a further updated right eye image for the right eye based on the updated right eye viewpoint.
20. The non-transitory computer-readable storage medium of claim 12 , wherein the instructions further cause the processor to perform steps including:
receiving an input to apply an image processing function to the structure contained within the 3D cursor; and
displaying, by the head display unit, a further updated left eye image for the left eye and a further updated right eye image for the right eye based on the image processing function.
21. The non-transitory computer-readable storage medium of claim 12 , wherein obtaining the initial representation of the 3D cursor comprises:
receiving an input indicative of a color and size of the 3D cursor; and
generating the initial representation of the 3D cursor based on the color and size.
22. The non-transitory computer-readable storage medium of claim 12 , wherein displaying the left eye image and the right eye image comprises:
determining, for the updated left eye image, left eye pixel angles for respective left eye pixels in the updated left eye image;
identifying respective left eye voxel cones through the structure for each of the left eye pixel angles; and
generating respective left eye pixel values for the respective left eye pixels in the updated left eye image based on the respective left eye voxel cones;
determining, for the right eye image, right eye pixel angles for respective right eye pixels in the updated right eye image;
identifying respective right eye voxel cones through the structure for each of the right eye pixel angles; and
generating respective right eye pixel values for the respective right eye pixels in the updated right eye image based on the respective right eye voxel cones.
23. A computing system, comprising:
a head display unit;
one or more processors; and
a non-transitory computer-readable storage medium storing instructions for displaying a volume of interest in a head display unit, the instructions when executed causing the one or more processors to perform steps comprising:
obtaining image data representing a structure in a three-dimensional (3D) image space;
obtaining an initial representation of a 3D cursor in the 3D image space, the 3D cursor having a 3D shape with an initial position in the 3D image space, and the 3D cursor containing the structure;
obtaining an initial viewing angle for orienting the 3D cursor and the structure in the 3D image space;
obtaining an initial left eye viewpoint for a left eye and an initial right eye viewpoint for a right eye for viewing the 3D cursor and the structure, wherein the initial right eye viewpoint is offset from the initial left eye viewpoint;
displaying, by the head display unit, a left eye image for the left eye based on the initial left eye viewpoint, the initial viewing angle, the 3D cursor, and the structure, and a right eye image for the right eye based on the initial right eye viewpoint, the initial viewing angle, the 3D cursor, and the structure;
obtaining an input to apply a rotation of the 3D cursor containing the structure about the 3D cursor's center;
responsive to the input, generating an updated viewing angle of the 3D cursor and the structure contained within the 3D cursor to reorient the 3D cursor and the structure in the 3D image space based on the rotation; and
displaying, by the head display unit, an updated left eye image for the left eye based on the initial left eye viewpoint, the updated viewing angle, the 3D cursor, and the structure, and an updated right eye image for the right eye based on the initial right eye viewpoint, the updated viewing angle, the 3D cursor and the structure.