System and methods for intraoperative guidance feedback
Systems and methods for surgical guidance and image registration are provided, in which three-dimensional image data associated with an object or patient is registered to topological image data obtained using a surface topology imaging device. The surface topology imaging device may be rigidly attached to an optical position measurement system that also tracks fiducial markers on a movable instrument. The instrument may be registered to the topological image data, such that the topological image data and the movable instrument are registered to the three-dimensional image data. The three-dimensional image data may be CT or MRI data associated with a patient. The system may also co-register images pertaining to a surgical plan with the three-dimensional image data. In another aspect, the surface topology imaging device may be configured to directly track fiducial markers on a movable instrument. The fiducial markers may be tracked according to surface texture.
1. An integrated optical system comprising:
an optical surface topography detection subsystem configured to project optical radiation onto a surface, detect backscattered radiation from the surface, and process the backscattered radiation to determine a topography of the surface; and
a plurality of imaging cameras;
wherein said imaging cameras and said optical surface topography detection subsystem are rigidly mounted on a frame.
2. The integrated optical system according to claim 1 wherein said imaging cameras are arranged in an array.
3. The integrated optical system according to claim 1 wherein said imaging cameras are arranged symmetrically on said frame.
4. The integrated optical system according to claim 1 wherein said optical surface topography detection subsystem is a structured light surface detection system.
5. The integrated optical system according to claim 1 wherein said imaging cameras and said optical surface topography detection subsystem have spatially overlapping respective fields of view.
6. The integrated optical system according to claim 1 wherein at least two of said imaging cameras are angled radially inward toward a central region of said frame.
7. The integrated optical system according to claim 1 wherein at least two cameras mounted on said frame are configured to acquire images from different angles.
8. The integrated optical system according to claim 1 wherein said imaging cameras are tracking cameras configured for imaging fiducial markers.
9. The integrated optical system according to claim 8 further comprising a light source rigidly mounted on said frame.
10. The integrated optical system according to claim 8 further comprising a plurality of light sources rigidly mounted on said frame.
11. The integrated optical system according to claim 10 wherein said plurality of light sources are arranged in an array.
12. The integrated optical system according to claim 11 wherein the array is a first array, and wherein said imaging cameras are arranged in a second array.
13. The integrated optical system according to claim 1 wherein said optical surface topography detection subsystem comprises an optical projection device, and wherein said imaging cameras are arranged in an array surrounding said optical projection device.
14. The integrated optical system according to claim 1 wherein said optical surface topography detection subsystem resides proximal to a center of said frame.
15. The integrated optical system according to claim 1 wherein said imaging cameras are first cameras, and wherein said optical surface topography detection subsystem comprises one or more second cameras.
16. The integrated optical system according to claim 15 wherein said first cameras and said second cameras are configured to perform imaging within different respective spectral bands.
17. The integrated optical system according to claim 16 wherein the different spectral bands are non-overlapping.
18. The integrated optical system according to claim 15 wherein said first cameras are arranged in a first array and said second cameras are arranged in a second array.
19. The integrated optical system according to claim 18 wherein said optical surface topography detection subsystem comprises an optical projector, wherein said optical projector resides centrally relative to the first array and the second array.
20. A surgical guidance system comprising:
said integrated optical system according to claim 1 ; and
a controller comprising a processor configured to:
control said optical surface topography detection subsystem to obtain an intraoperative surface image characterizing an exposed surface of a subject;
perform image registration between the intraoperative surface image and preoperative image data associated with the subject, thereby obtaining a transformation between a preoperative coordinate system associated with the preoperative image data and an intraoperative coordinate system associated with the subject;
obtain, from said imaging cameras, tracking images comprising fiducial markers associated with a surgical tool;
process the tracking images to locate the fiducial markers determine an intraoperative position and orientation of the surgical tool;
and
employ the transformation to generate and display a navigation image indicating the intraoperative location and orientation of the surgical tool relative to the preoperative image data.
21. A surgical guidance system comprising:
said integrated optical system according to claim 1 ; and
a patient support;
said integrated optical system residing in an overhead orientation relative to said patient support.
22. The surgical guidance system according to claim 21 further comprising an articulating arm configured to position said integrated optical system in the overhead orientation relative to said patient support.
23. A method of performing surgical guidance, the method comprising:
providing the surgical guidance system according to claim 21 ; and
employing the optical surface topography detection subsystem to obtain an intraoperative surface image characterizing an exposed surface of a subject;
performing image registration between the intraoperative surface image and preoperative image data associated with the subject, thereby obtaining a transformation between a preoperative coordinate system associated with the preoperative image data and an intraoperative coordinate system associated with the subject;
employing the imaging cameras to obtain tracking images comprising fiducial markers associated with a surgical tool;
processing the tracking images to locate the fiducial markers determine an intraoperative position and orientation of the surgical tool; and
employing the transformation to generate and display a navigation image indicating the intraoperative location and orientation of the surgical tool relative to the preoperative image data.
24. The method according to claim 23 wherein the navigation image is displayed on an augmented reality display device.
25. The method according to claim 24 wherein the augmented reality display device is a head-mounted display device.