Markerless navigation system
A surgical system and method for markerless intraoperative navigation is provided. The system can includes a structured light system that can be utilized to intraoperatively sense three-dimensional surface geometry. The computer system is configured to segment a depth image to obtain surface geometry data of an anatomical structure embodied within the depth image, register the surface geometry data of the anatomical structure to a model, and update the surgical plan according to the registered surface geometry data. The surgical system is an endoscopic surgical system.
1 . A surgical system for an endoscopic surgical procedure, the surgical system comprising:
a depth-sensing system comprising:
an emitter configured to project structured electromagnetic radiation (EMR) onto a surface, and
an image sensor configured to obtain a depth image of the surface based on the structured EMR; and
a computer system coupled to the depth-sensing system, the computer system configured to:
receive a surgical plan associated with the endoscopic surgical procedure,
receive a model of an anatomical structure associated with the endoscopic surgical procedure,
generate, via the image sensor, the depth image based on the structured EMR,
segment the depth image to obtain surface geometry data of the anatomical structure embodied within the depth image,
register the surface geometry data of the anatomical structure to the model, and
update the surgical plan according to the registered surface geometry data.
2 . The surgical system of claim 1 , wherein the computer system is configured to register depth data of the anatomical structure to the model using at least one of an iterative closest point algorithm or a data aligned rigidity constrained exhaustive search algorithm.
3 . The surgical system of claim 1 , wherein the structured EMR comprises at least one of visible light or infrared.
4 . The surgical system of claim 1 , wherein the depth-sensing system is mounted to a movable stand.
5 . The surgical system of claim 1 , wherein the depth-sensing system is mounted to a light.
6 . A method of performing an endoscopic surgical procedure, the method comprising:
receiving, by a computer system coupled to an endoscope, a surgical plan associated with the endoscopic surgical procedure, wherein the endoscope may comprise an emitter configured to project structured EMR onto a surface and an image sensor configured to obtain a depth image of the surface based on the structured EMR;
receiving, by the computer system, a preoperative model of an anatomical structure associated with the endoscopic surgical procedure;
generating, by the computer system, the depth image based on the structured EMR using the image sensor;
segmenting, by the computer system, the depth image to obtain surface geometry data of the anatomical structure embodied within the depth image;
registering, by the computer system, the surface geometry data of the anatomical structure to the preoperative model; and
updating, by the computer system, the surgical plan according to the registered surface geometry data.
7 . The method of claim 6 , wherein depth data of the anatomical structure is registered to the model using at least one of an iterative closest point algorithm or a data aligned rigidity constrained exhaustive search algorithm.
8 . The method of claim 6 , wherein the endoscope comprises an arthroscope.
9 . The method of claim 6 , wherein the endoscope further comprises an image sensor, the method further comprising:
displaying a video feed obtained via the image sensor.
10 . The method of claim 9 , further comprising:
displaying at least one of the updated surgical plan or the registered surface geometry data in association with the video feed.
11 . The method of claim 9 , further comprising:
displaying the registered surface geometry data overlaid on the anatomical structure in the video feed.
12 . The method of claim 6 , wherein the endoscope further comprises a depth sensor selected from the group consisting of a time-of-flight sensor, a laser scanning device, and a combination thereof.
13 . A surgical system for an endoscopic surgical procedure, the surgical system comprising:
an endoscope comprising:
an emitter configured to project structured electromagnetic radiation (EMR) onto a surface, and
an image sensor configured to obtain a depth image of the surface based on the structured EMR; and
a computer system coupled to the endoscope, the computer system configured to:
receive a surgical plan associated with the endoscopic surgical procedure,
receive a model of an anatomical structure associated with the endoscopic surgical procedure,
generate, via the image sensor, the depth image based on the structured EMR,
segment the depth image to obtain surface geometry data of the anatomical structure embodied within the depth image,
register the surface geometry data of the anatomical structure to the model, and
update the surgical plan according to the registered surface geometry data.
14 . The surgical system of claim 13 , wherein the computer system is configured to register depth data of the anatomical structure to the model using at least one of an iterative closest point algorithm or a data aligned rigidity constrained exhaustive search algorithm.
15 . The surgical system of claim 13 , wherein the endoscope comprises an arthroscope.
16 . The surgical system of claim 13 , wherein the surgical system further comprises a display coupled to the computer system, wherein the endoscope further comprises an image sensor, wherein the computer system is further configured to cause the display to display a video feed obtained via the image sensor.
17 . The surgical system of claim 16 , wherein the computer system is configured to cause the display to display at least one of the updated surgical plan or the registered surface geometry data in association with the video feed.
18 . The surgical system of claim 16 , wherein the computer system is configured to cause the display to display the registered surface geometry data overlaid on the anatomical structure in the video feed.
19 . The surgical system of claim 13 , wherein the endoscope further comprises a depth sensor selected from the group consisting of a time-of-flight sensor, a laser scanning device, and a combination thereof.
20 . The surgical system of claim 13 , wherein the structured EMR comprises at least one of visible light or infrared.