Mixed reality endoscopic retrograde cholangiopancreatopgraphy (ERCP) procedure
View Patent ↗A mixed reality endoscopic surgical procedure method, including the steps of selecting a three-dimensional holographic first image of a body part to be surgically operated on and displaying the three-dimensional holographic first image of the body part. The method can further include positioning an endoscope relative to the body part, wherein the endoscope further includes a guidewire, displaying a three-dimensional second holographic image or video of the endoscope or guidewire relative to the body part, and using the three-dimensional first holographic first image as a visual guide for engaging the body part via the guidewire.
1 . A mixed reality endoscopic surgical procedure method, comprising:
selecting a three-dimensional holographic first image or video representative of a body part to be surgically operated on;
displaying the three-dimensional holographic first image or video of the body part on a display;
positioning an endoscope comprising a camera relative to the body part, wherein the endoscope further comprises a guidewire;
displaying, from the camera of the endoscope, a second video of the guidewire relative to the body part;
overlaying the second video and the three-dimensional first holographic image or video over each other;
displaying one or more graphical markers on or adjacent to the overlaid second video and three-dimensional holographic first image or video, wherein the one or more graphical markers are adapted to visually assist a user to guide the guidewire; and
penetrating the body part via the guidewire.
2 . The mixed reality endoscopic surgical procedure method of claim 1 , wherein the first holographic first image is comprised of a duodenum illustrating a major papilla orifice or ampulla.
3 . The mixed reality endoscopic surgical procedure method of claim 1 , wherein the body part is comprised of the major papilla orifice or ampulla.
4 . The mixed reality endoscopic surgical procedure method of claim 1 , wherein the endoscope is further comprised of a sphincterotome.
5 . The mixed reality endoscopic surgical procedure method of claim 4 , further comprising:
orientating the sphincterotome to a desired position relative to the position of the first holographic image of the body part.
6 . The mixed reality endoscopic surgical procedure method of claim 4 , further comprising:
orientating the sphincterotome within a range of about 10-degrees to about 80-degrees relative to a horizontal plane and further with respect to the position of the first holographic image of the body part.
7 . The mixed reality endoscopic surgical procedure method of claim 1 , further comprising displaying a three-dimensional third holographic image or video relative to the three-dimensional first holographic image and the video.
8 . The mixed reality endoscopic surgical procedure method of claim 1 , further comprising displaying one or more holographic information of patient vitals.
9 . The mixed reality endoscopic surgical procedure method of claim 1 , wherein the video is further comprised of streaming one or more video or image data from a first source.
10 . The mixed reality endoscopic surgical procedure method of claim 1 , further comprising displaying one or more holographic images of one or more users and further communicating with the one or more users via audio or video.
11 . A mixed reality endoscopic surgical procedure method, comprising:
selecting a three-dimensional holographic first image representative of a body part to be surgically operated on;
displaying the three-dimensional holographic first image of the body part via an augmented reality or virtual reality headset;
positioning an endoscope comprising a camera relative to the body part, wherein the endoscope further comprises a guidewire;
displaying a second video, via a feed from the camera of the endoscope, the body part relative to the guidewire;
overlaying the three-dimensional first holographic image or video and the second video over each other;
displaying one or more visual representations on or adjacent to the overlaid second video and three-dimensional holographic first image or video; and
positioning the guidewire using the one or more visual representations and the overlaid second video and three-dimensional holographic first image or video.
12 . A mixed reality endoscopic surgical procedure method, comprising:
selecting a first image representative of a body part to be surgically operated on;
displaying the first image of the body part via an augmented reality or virtual reality headset;
positioning an endoscope comprising a camera relative to the body part, wherein the endoscope further comprises a catheter;
displaying a second image or video, retrieved via the camera of the endoscope, the body part relative to the catheter;
overlaying the first image and the second image or video over each other;
displaying one or more visual representations on or adjacent to the overlaid first image and second image or video; and
orienting the catheter using the one or more visual representations and the overlaid first image and second image or video.