Real-time rendering and referencing for medical procedures
Methods, systems, and devices for medical imaging are described. Examples may include an augmented reality (AR) server receiving a set of medical imaging data acquired by at least a first imaging modality. The set of medical imaging data may include a visual representation of a biological structure of a body. Next, the medical imaging data can be used to render an isolated anatomical model of a least a portion of the biological structure. The isolated anatomical model can be received by an AR viewing device such as AR glasses. The AR viewing device may display on a display of the AR viewing device, a first view perspective of the isolated anatomical model in a first orientation. The first orientation may be based on a position of the first AR viewing device relative to the body. Examples include displaying a virtual position of the medical instrument in the AR viewing device.
1. A method for medical imaging, the method comprising:
receiving a set of medical imaging data acquired by at least a first imaging modality, the set of medical imaging data comprising a visual representation of a biological structure of a body;
rendering an anatomical model of at least a portion of the biological structure, wherein the rendering comprises:
generating a contrasted image of the anatomical model by darkening the biological structure and lightening image noise after receiving the set of medical imaging data;
vectorizing the contrasted image of the anatomical model to refine edges of the biological structure after generating the contrasted image; and
removing the image noise from the vectorized contrasted image to render an isolated anatomical model after vectorizing the contrasted image; and
displaying, on a display of an augmented reality (AR) viewing device, a first view perspective of the isolated anatomical model, wherein the first view perspective displays the isolated anatomical model in a first orientation based at least in part on a position of the first AR viewing device relative to the body.
2. The method of claim 1 , further comprising:
tracking a real-time change in position of the AR viewing device; and
displaying a real-time position of the first view perspective of the isolated anatomical model based at least in part on tracking the real-time change in position of the AR viewing device.
3. The method of claim 2 , wherein displaying the real-time position of the first view perspective of the isolated anatomical model comprises:
updating the first view perspective of the isolated anatomical model based at least in part on a change in position of the AR viewing device relative to the body, wherein updating the first view perspective comprises displaying the isolated anatomical model in a second orientation based at least in part on the change in position of the AR viewing device.
4. The method of claim 2 , further comprising:
receiving real-time position data of a medical instrument relative to a reference point of the body.
5. The method of claim 4 , further comprising:
computing a virtual position of the medical instrument relative to the isolated anatomical model based at least in part on the received real-time position data of the medical instrument.
6. The method of claim 5 , wherein the computing the virtual position of the medical instrument corresponds to a real-time position of the medical instrument relative to the reference point of the body.
7. The method of claim 4 , further comprising:
displaying a virtual position of the medical instrument in the first view perspective of the AR viewing device, wherein the virtual position of the medical instrument is oriented within the isolated anatomical model based at least in part on the received real-time position data of the medical instrument relative to the reference point of the body.
8. The method of claim 4 , wherein receiving the real-time position data of the medical instrument further comprises:
receiving signal data from an active tracking component located on the medical instrument.
9. The method of claim 8 , wherein the signal data comprises at least one of a force measurement, an ultrasonic measurement, a magnetic measurement, an orientation measurement, or a combination thereof.
10. The method of claim 8 , further comprising:
receiving at least a portion of the real-time position data of the medical instrument from a navigation instrument located outside the body.
11. The method of claim 10 , wherein the real-time position data of the medical instrument comprises at least one of ultrasonic data, radio frequency identification (RFID) sensor data, contrast imaging data, global positioning system (GPS) data, orientation data, or a combination thereof.
12. The method of claim 1 , further comprising:
determining a medical imaging reference orientation based at least in part on receiving the set of medical imaging data, wherein the medical imaging reference orientation comprises position data of the visual representation of the biological structure relative to the body; and
displaying an anchoring orientation of the isolated anatomical model within the first view perspective of the AR viewing device, wherein the anchoring orientation positions the isolated anatomical model to align with the medical imaging reference orientation.
13. The method of claim 12 , wherein the anchoring orientation positions the isolated anatomical model in the first view perspective of the AR viewing device to appear at a location above the body.
14. The method of claim 13 , further comprising:
updating the first view perspective of the isolated anatomical model in response to a change in position of the AR viewing device, wherein the updating comprises maintaining the isolated anatomical model in the anchoring orientation relative to the body.
15. The method of claim 12 , further comprising:
receiving a command to change an orientation of the isolated anatomical model from the anchoring orientation to a selected orientation; and
displaying, on the display the AR viewing device, a second orientation of the isolated anatomical model, wherein the second orientation of the isolated anatomical model displays the isolated anatomical model at the selected orientation based at least in part on the position of the AR viewing device relative to the body.
16. The method of claim 1 , further comprising:
displaying, on a display of a second AR viewing device, a second view perspective of the isolated anatomical model, wherein the second view perspective displays the isolated anatomical model in a second orientation based at least in part on a position of the second AR viewing device relative to the body.
17. A method for image rendering, the method comprising:
receiving a set of imaging data acquired by at least a first imaging modality, the set of imaging data comprising a visual representation of a structure;
rendering a model of at least a portion of the structure, wherein the rendering comprises:
generating a contrasted image of the model by darkening the structure and lightening image noise after receiving the set of imaging data;
vectorizing the contrasted image of the model to refine edges of the structure after generating the contrasted image; and
removing the image noise from the vectorized contrasted image to render an isolated model after vectorizing the contrasted image; and
displaying, on a display of an augmented reality (AR) viewing device, a first view perspective of the isolated model, wherein the first view perspective displays the isolated model in a first orientation based at least in part on a position of the first AR viewing device relative to viewing reference point.
18. The method of claim 17 , wherein:
the structure comprises at least a set of internal features that are contained within the interior of the structure; and
the set of imaging data comprises a visual representation of at least a portion of the set of internal features.
19. An apparatus for medical imaging comprising:
a processor;
memory in electronic communication with the processor; and
instructions stored in the memory and executable by the processor to cause the apparatus to:
receive a set of medical imaging data acquired by at least a first imaging modality, the set of medical imaging data comprising a visual representation of a biological structure of a body;
rendering an anatomical model of at least a portion of the biological structure, wherein the rendering comprises:
generating a contrasted image of the anatomical model by darkening the biological structure and lightening image noise after receiving the set of medical imaging data;
vectorizing the contrasted image of the anatomical model to refine edges of the biological structure after generating the contrasted image; and
removing the image noise from the vectorized contrasted image to render an isolated anatomical model after vectorizing the contrasted image; and
display, on a display of an augmented reality (AR) viewing device, a first view perspective of the isolated anatomical model, wherein the first view perspective displays the isolated anatomical model in a first orientation based at least in part on a position of the first AR viewing device relative to the body.
20. The apparatus of claim 19 , wherein the instructions are further executable by the processor to cause the apparatus to:
track a real-time change in position of the AR viewing device; and
display a real-time position of the first view perspective of the isolated anatomical model based at least in part on tracking the real-time change in position of the AR viewing device.
21. The apparatus of claim 20 , wherein the instructions to display the real-time position of the first view perspective of the isolated anatomical model are executable by the processor to cause the apparatus to:
update the first view perspective of the isolated anatomical model based at least in part on a change in position of the AR viewing device relative to the body, and wherein updating the first view perspective causes the apparatus to display the isolated anatomical model in a second orientation based at least in part on the change in position of the AR viewing device.
22. The apparatus of claim 20 , wherein the instructions are further executable by the processor to cause the apparatus to:
receive real-time position data of a medical instrument relative to a reference point of the body.
23. The apparatus of claim 22 , wherein the instructions are further executable by the processor to cause the apparatus to:
compute a virtual position of the medical instrument relative to the isolated anatomical model based at least in part on the received real-time position data of the medical instrument.
24. The apparatus of claim 23 , wherein the computing the virtual position of the medical instrument corresponds to a real-time position of the medical instrument relative to the reference point of the body.
25. The apparatus of claim 22 , wherein the instructions are further executable by the processor to cause the apparatus to:
display a virtual position of the medical instrument in the first view perspective of the AR viewing device, and wherein the virtual position of the medical instrument is oriented within the isolated anatomical model based at least in part on the received real-time position data of the medical instrument relative to the reference point of the body.
26. The apparatus of claim 22 , wherein the instructions to receive the real-time position data of the medical instrument are further executable by the processor to cause the apparatus to:
receive signal data from an active tracking component located on the medical instrument.
27. The apparatus of claim 26 , wherein the instructions are further executable by the processor to cause the apparatus to:
receive at least a portion of the real-time position data of the medical instrument from a navigation instrument located outside the body.
28. The apparatus of claim 19 , wherein the instructions are further executable by the processor to cause the apparatus to:
determine a medical imaging reference orientation based at least in part on receiving the set of medical imaging data, wherein the medical imaging reference orientation comprises position data of the visual representation of the biological structure relative to the body; and
display an anchoring orientation of the isolated anatomical model within the first view perspective of the AR viewing device, wherein the anchoring orientation positions the isolated anatomical model to align with the medical imaging reference orientation.
29. The apparatus of claim 28 , wherein the anchoring orientation positions the isolated anatomical model in the first view perspective of the AR viewing device to appear at a location above the body.
30. The apparatus of claim 29 , wherein the instructions are further executable by the processor to cause the apparatus to:
update the first view perspective of the isolated anatomical model in response to a change in position of the AR viewing device, and wherein the updating is executable by the processor to cause the apparatus to maintain the isolated anatomical model in the anchoring orientation relative to the body.
31. The apparatus of claim 28 , wherein the instructions are further executable by the processor to cause the apparatus to:
receive a command to change an orientation of the isolated anatomical model from the anchoring orientation to a selected orientation; and
display, on the display of the AR viewing device, a second orientation of the isolated anatomical model, wherein the second orientation of the isolated anatomical model displays the isolated anatomical model at the selected orientation based at least in part on the position of the AR viewing device relative to the body.
32. A method for medical imaging, comprising:
rendering an anatomical model of at least a portion of a biological structure, wherein the rendering comprises:
generating a contrasted image of the anatomical model by darkening the biological structure and lightening image noise after receiving a set of medical imaging data;
vectorizing the contrasted image of the anatomical model to refine edges of the biological structure after generating the contrasted image; and
removing the image noise from the vectorized contrasted image to render an isolated anatomical model after vectorizing the contrasted image;
displaying, in a display device of an augmented reality (AR) viewing device, a first view perspective of the isolated anatomical model in a first orientation based at least in part on a position of the first AR viewing device relative to a body;
receiving position data of a medical instrument relative to a reference point of the body, wherein the medical instrument is located within an interior of the body; and
displaying a virtual position of the medical instrument in the first view perspective of the AR viewing device, wherein the virtual position of the medical instrument is displayed at a relative position to the isolated anatomical model based at least on part on the received position data of the medical instrument.