Overlay and manipulation of medical images in a virtual environment

1. An apparatus comprising:

at least one processor; and

at least one memory comprising instructions that, in response to execution by the at least one processor, cause the at least one processor to:

generate a virtual environment for display of image content via a virtual reality display device, the image content comprising a two-dimensional image and a three-dimensional image volume, the two-dimensional image defined with respect to a plane movable within the three-dimensional image volume;

enable interaction with the image content in the virtual environment via an avatar;

adjust the image content in the virtual environment based on the interaction by at least changing the two-dimensional image that is displayed in the virtual environment based on movement of the avatar to move the plane within the three-dimensional image volume to extract and display the two-dimensional image; and

generate an output of image content from the virtual environment.

2. The apparatus of claim 1 , wherein the instructions, when executed, cause the at least one processor to import a display of an implant, a medical device, a marker, or a combination thereof into the virtual environment.

3. The apparatus of claim 1 , wherein the instructions, when executed, cause the at least one processor to detect a manipulation of a displayed stent in the virtual environment, plot a surgical path, or compute a measurement.

4. The apparatus of claim 1 , wherein the virtual environment comprises a display of an anatomical image representing an internal view of an organ or a blood vessel.

5. The apparatus of claim 4 , wherein the anatomical image indicates a blood vessel length, a blood vessel diameter, or a combination thereof.

6. The apparatus of claim 1 , wherein the virtual environment comprises data from a functional scan, the data representing blood flow or tumor growth.

7. The apparatus of claim 1 , wherein the instructions, when executed, cause the at least one processor to provide one or more tools for interaction with the image content to adjust the image content in the virtual environment, the one or more tools comprising a model of an implant to be positioned with respect to the image content.

8. The apparatus of claim 1 , wherein the instructions, when executed, cause the at least one processor to provide an avatar that is to allow the two-dimensional image to be extracted from the three-dimensional image volume or inserted into the three-dimensional image volume.

9. The apparatus of claim 8 , wherein the extracted two-dimensional image comprises an annotation, a marker, a segmented anatomy, or a combination thereof.

10. The apparatus of claim 1 , wherein the instructions, when executed, cause the at least one processor to generate the image content in the virtual environment by at least:

generating two or more representations based on medical image data retrieved from one or more imaging devices, at least one representation including a three-dimensional representation;

registering the two or more representations in the virtual environment; and

presenting the registered two or more representations in the virtual environment for adjustment.

11. The apparatus of claim 1 , wherein the virtual reality display device includes virtual reality goggles.

12. A non-transitory computer readable storage medium comprising instructions which, when executed, cause at least one processor to at least:

generate a virtual environment for display of image content via a virtual reality display device, the image content comprising a two-dimensional image and a three-dimensional image volume, the two-dimensional image defined with respect to a plane movable within the three-dimensional image volume;

enable interaction with the image content in the virtual environment via an avatar;

adjust the image content in the virtual environment based on the interaction by at least changing the two-dimensional image that is displayed in the virtual environment based on movement of the avatar to move the plane within the three-dimensional image volume to extract and display the two-dimensional image; and

generate an output of image content from the virtual environment.

13. The computer readable storage medium of claim 12 , wherein the instructions, when executed, cause the at least one processor to import a display of an implant, a medical device, a marker, or a combination thereof into the virtual environment.

14. The computer readable storage medium of claim 12 , wherein the instructions, when executed, cause the at least one processor to detect a manipulation of a displayed stent in the virtual environment, plot a surgical path, or compute a measurement.

15. The computer readable storage medium of claim 12 , wherein the virtual environment comprises a display of an anatomical image representing an internal view of an organ or a blood vessel.

16. The computer readable storage medium of claim 15 , wherein the anatomical image indicates a blood vessel length, a blood vessel diameter, or a combination thereof.

17. The computer readable storage medium of claim 12 , wherein the virtual environment comprises data from a functional scan, the data representing blood flow or tumor growth.

18. The computer readable storage medium of claim 12 , wherein the instructions, when executed, cause the at least one processor to generate the image content in the virtual environment by at least:

generating two or more representations based on medical image data retrieved from one or more imaging devices, at least one representation including a three-dimensional representation;

registering the two or more representations in the virtual environment; and

presenting the registered two or more representations in the virtual environment for adjustment.

19. A computer-implemented method comprising:

generating, by executing an instruction using at least one processor, a virtual environment for display of image content via a virtual reality display device, the image content comprising a two-dimensional image and a three-dimensional image volume, the two-dimensional image defined with respect to a plane movable within the three-dimensional image volume;

enabling interaction with the image content in the virtual environment via an avatar;

adjusting the image content in the virtual environment based on the interaction by at least changing the two-dimensional image that is displayed in the virtual environment based on movement of the avatar to move the plane within the three-dimensional image volume to extract and display the two-dimensional image; and

generating an output of image content from the virtual environment.

20. The method of claim 19 , wherein enabling the interaction to adjust the image content in the virtual environment comprises enabling manipulation of the image content using the avatar to extract the two-dimensional image from the three-dimensional image volume, insert the two-dimensional image into the three-dimensional volume, adjust a view of the image content, annotate the image content, measure the image content, select a reference plane in the image content, or a combination thereof.