Augmented reality system configured for coordinate correction or re-registration responsive to spinal movement for spinal procedures, including intraoperative imaging, CT scan or robotics
Devices and methods for performing a surgical step or surgical procedure with visual guidance using an optical head mounted display are disclosed.
1. A system for a spinal surgical procedure, the system comprising:
at least one processor; and
at least one see through optical head mounted display;
wherein the system is configured to generate a virtual surgical guide, wherein the virtual surgical guide is a virtual axis, a virtual trajectory, a virtual path, a virtual point, or a combination thereof, wherein the virtual axis, the virtual trajectory, the virtual path, the virtual point, or the combination thereof is a three-dimensional digital representation indicating a predetermined position, predetermined orientation, or combination thereof at at least one predetermined coordinate in a coordinate system for at least one physical surgical tool, physical surgical instrument, physical device, or combination thereof,
wherein the system is configured to display, by the at least one see through optical head mounted display, at the at least one predetermined coordinate the virtual surgical guide one a physical spine of a patient,
wherein the system is configured to receive data for a coordinate correction, coordinate adjustment, coordinate transfer, re-registration, or combination thereof of the virtual surgical guide,
wherein when the position, orientation, or position and orientation of the at least one physical surgical tool, physical surgical instrument, physical device, or combination thereof placed in the physical spine deviates from the predetermined position, predetermined orientation, or combination thereof of the virtual surgical guide at the at least one predetermined coordinate, the position, orientation, or position and orientation of the virtual surgical guide after the coordinate correction, coordinate adjustment, coordinate transfer, re-registration, or combination thereof matches the position, orientation, or position and orientation of the at least one physical surgical tool, physical surgical instrument, physical device, or combination thereof placed in the physical spine.
2. The system of claim 1 , wherein the position, orientation, or position and orientation of the at least one physical surgical tool, physical surgical instrument, physical device, or combination thereof matches the predetermined position, predetermined orientation, or combination thereof of the virtual surgical guide within about 5 mm, about 4 mm, about 3 mm, about 2 mm, about 1 mm, about 0.5 mm, about 0.25 mm, or less, or within a range of 0.25 mm to 0.5 mm, 0.25 mm to 1 mm, 0.25 mm to 2 mm, 0.25 mm to 3 mm, 0.25 mm to 4 mm, 0.25 mm to 5 mm, 0.5 mm to 1 mm, 0.5 mm to 2 mm, 0.5 mm to 3 mm, 0.5 mm to 4 mm, 0.5 mm to 5 mm, 1 mm to 2 mm, 1 mm to 3 mm, 1 mm to 4 mm, 1 mm to 5 mm, 2 mm to 3 mm, 2 mm to 4 mm, 2 mm to 5 mm, 3 mm to 4 mm, 3 mm to 5 mm, 4 mm to 5 mm, in at least one direction, or wherein the position, orientation, or position and orientation of the at least one physical surgical tool, physical surgical instrument, physical device, or combination thereof matches the predetermined position, predetermined orientation, or combination thereof of the virtual surgical guide within about 5°, about 4°, about 3°, about 2°, about 1°, about 0.5°, about 0.25° or less, or within a range of 0.25-5°, 0.25-4°, 0.25-3°, 0.25-2°, 0.25-1°, 0.25-0.5°, 0.5-5°, 0.5-4°, 0.5-3°, 0.5-2°, 0.5-1°, 1-5°, 1-4°, 1-3°, 1-2°, 2-5°, 2-4°, 2-3°, 3-5°, 3-4°, in at least one direction.
3. The system of claim 1 , wherein the at least one predetermined coordinate in the coordinate system is determined in relationship to at least one anatomic structure, or wherein the at least one predetermined coordinate in the coordinate system is determined in relationship to at least one marker attached to the patient.
4. The system of claim 1 , wherein the coordinate system is determined in relationship to at least one anatomic structure, or wherein the coordinate system is determined in relationship to at least one marker attached to the patient.
5. The system of claim 4 , wherein the coordinate system is maintained in relationship to the at least one anatomic structure or in relationship to the at least one marker when the physical spine moves.
6. The system of claim 1 , wherein the system is configured to reference the at least one coordinate in relationship to at least one infrared marker, radiofrequency marker, IMU, LED, optical marker, geometric pattern, patient specific marker, patient specific template or a combination thereof, or to obtain the at least one coordinate using a surgical navigation system, camera, video system, image capture system, depth sensor, laser scanner, 3D scanner, x-ray, imaging system or a combination thereof.
7. The system of claim 6 , wherein the at least one infrared marker, radiofrequency marker, IMU, LED, optical marker, geometric pattern, patient specific marker, patient specific template, or combination thereof are attached to the patient.
8. The system of claim 6 , wherein the at least one infrared marker, radiofrequency marker, IMU, LED, optical marker, geometric pattern, patient specific marker, patient specific template, or a combination thereof are attached to at least a portion of the physical spine, a spinous process, a posterior spinal element, a facet joint, a skin, a subcutaneous tissue, a sacrum, an iliac wing, an occiput, or a combination thereof.
9. The system of claim 1 wherein the system is configured to maintain the display of the virtual surgical guide at the at least one predetermined coordinate in the coordinate system when the at least one physical surgical tool, physical surgical instrument, physical device, or combination thereof moves in the field of view of a user.
10. The system of claim 1 , wherein the system further comprises at least one user interface and wherein the at least one user interface comprises a graphical user interface, a voice recognition, a gesture recognition, a virtual interface displayed by the at least one see through optical head mounted display, a virtual keyboard displayed by the at least one see through optical head mounted display, a physical keyboard, a physical computer mouse, a physical track pad, or a combination thereof.
11. The system of claim 1 , wherein the three-dimensional digital representation corresponds to at least a portion of the at least one physical surgical tool, physical surgical instrument, physical device, or combination thereof.
12. The system of claim 1 , wherein the virtual axis corresponds to an axis of the at least one physical surgical tool, physical surgical instrument, physical device, or combination thereof.
13. The system of claim 1 , wherein the physical device comprises a spinal implant, and wherein the spinal implant comprises one or more pedicle screws, screws, rods, plates, cages, artificial disks, or a combination thereof.
14. The system of claim 1 , wherein the system is configured for removing or resecting one or more spinal tissues, and wherein the one or more spinal tissues comprise at least a portion of a disk tissue, a bone tissue, an intervertebral disk, a bone, a vertebral endplate, a vertebral body, a pedicle, a facet joint, a posterior spinal element, a spinous process, or a combination thereof.
15. The system of claim 1 , wherein the predetermined position comprises a predetermined start position, a predetermined start point, a predetermined end position, a predetermined end point, or a combination thereof, or wherein the predetermined orientation comprises a predetermined angle, a predetermined start orientation, a predetermined start alignment, a predetermined end orientation, a predetermined start point and end point, a predetermined end alignment, or a combination thereof.
16. The system of claim 1 , wherein the at least one physical surgical tool, physical surgical instrument, or combination thereof comprises at least one needle, pin, drill, K-wire, awl, feeler probe, ball handle probe, straight probe, curved probe, tap, ratchet, screw driver, rod template, rod inserter, rod gripper, bender, plug starter, compressor, distractor, break off driver, obturator, counter torque, quick connector, driver, retractor, retracting frame, implant positioner, caliper, plate holder, plate bender, forceps, or a combination thereof.
17. The system of claim 1 , wherein the system is configured to track the at least one physical surgical tool, physical surgical instrument, physical device, or combination thereof in the coordinate system.
18. The system of claim 1 , wherein the system is configured to display the virtual surgical guide continuously or wherein the system is configured to display the virtual surgical guide intermittently.
19. The system of claim 1 , wherein the at least one see through optical head mounted display comprises the at least one processor.
20. The system of claim 1 , wherein the at least one processor is separate from the at least one see through optical head mounted display.
21. The system of claim 1 , wherein at least one predetermined coordinate is determined using intraoperative imaging and wherein the intraoperative imaging comprises at least one x-ray imaging, C-arm imaging, digital tomosynthesis, cone beam CT, CT scan, CT scan generated by x-ray acquisition with a C-arm system, spiral or helical CT scan, 3D scan, O-arm scan, or a combination thereof.
22. The system of claim 1 , wherein the coordinate correction, coordinate adjustment, coordinate transfer, re-registration, or combination thereof comprises a repeat imaging and wherein the repeat imaging comprises at least one intraoperative x-ray imaging, C-arm imaging, digital tomosynthesis, cone beam CT, CT scan, CT scan generated by x-ray acquisition with a C-arm system, spiral or helical CT scan, 3D scan, O-arm scan, or a combination thereof.
23. The system of claim 1 , wherein the system further comprises at least one user interface and wherein the at least one user interface is configured to assist with a coordinate correction, coordinate adjustment, coordinate transfer, re-registration, or combination thereof of the virtual surgical guide when the at least one physical surgical tool, physical surgical instrument, physical device, or combination thereof is placed in the physical spine.
24. A system for preparing a spinal procedure, the system comprising:
at least one processor; and
at least one see through optical head mounted display;
wherein the system is configured to generate a virtual surgical guide, wherein the virtual surgical guide is at least a portion of a virtual tool, at least a portion of a virtual surgical instrument, at least a portion of a virtual screw, at least a portion of a virtual implant, or a combination thereof, wherein the virtual surgical guide is a three-dimensional digital representation indicating a predetermined position, predetermined orientation, or combination thereof at at least one predetermined coordinate in a coordinate system for at least one physical surgical tool, physical surgical instrument, physical screw, physical implant, or combination thereof,
wherein the system is configured to display, by the at least one see through optical head mounted display, at the at least one predetermined coordinate the virtual surgical guide on the physical spine of a patient,
wherein the system is configured to receive data for a coordinate correction, coordinate adjustment, coordinate transfer, re-registration, or combination thereof of the virtual surgical guide,
wherein when the position, orientation, or position and orientation of the at least one physical surgical tool, physical surgical instrument, physical screw, physical implant, or combination thereof placed in the physical spine deviates from the predetermined position, predetermined orientation, or combination thereof of the virtual surgical guide at the at least one predetermined coordinate, the position, orientation, or position and orientation of the virtual surgical guide after the coordinate correction, coordinate adjustment, coordinate transfer, re-registration, or combination thereof matches the position, orientation, or position and orientation of the at least one physical surgical tool, physical surgical instrument, physical screw, physical implant, or combination thereof placed in the physical spine.
25. The system of claim 1 , wherein the position, orientation, or position and orientation of the at least one physical surgical tool, physical surgical instrument, physical device, or combination thereof placed in the physical spine deviates from the predetermined position, predetermined orientation, or combination thereof of the virtual surgical guide at the at least one predetermined coordinate when two or more spinal segments move in relationship to each other, or when a first spinal segment with an attached fiducial marker moves in relationship to a second spinal segment.
26. The system of claim 17 , wherein the system is configured to use tracking information to generate a visual feedback or an acoustic feedback, when the at least one physical surgical tool, physical surgical instrument, physical device, or combination thereof placed in the physical spine deviates from the predetermined position, predetermined orientation, or combination thereof of the virtual surgical guide at the at least one predetermined coordinate.
27. The system of claim 24 , wherein the at least one predetermined coordinate in the coordinate system is determined in relationship to at least one anatomic structure, or wherein the at least one predetermined coordinate in the coordinate system is determined in relationship to at least one marker attached to the patient.
28. The system of claim 24 , wherein the coordinate system is determined in relationship to at least one anatomic structure, or wherein the coordinate system is determined in relationship to at least one marker attached to the patient.
29. The system of claim 24 , wherein the system is configured to determine the at least one predetermined coordinate using a surgical navigation system, camera, video system, image capture system, depth sensor, laser scanner, 3D scanner, x-ray, imaging system or a combination thereof, or reference the at least one predetermined coordinate in relationship to at least one infrared marker, radiofrequency marker, IMU, LED, optical marker, geometric pattern, patient specific marker, patient specific template or a combination thereof, and wherein the at least one infrared marker, radiofrequency marker, IMU, LED, optical marker, geometric pattern, patient specific marker, patient specific template, or a combination thereof are attached to at least a portion of the physical spine, a spinous process, a posterior spinal element, a facet joint, a skin, a subcutaneous tissue, a sacrum, an iliac wing, an occiput, or a combination thereof.
30. The system of claim 24 , wherein the coordinate correction, coordinate adjustment, coordinate transfer, re-registration, or combination thereof comprises a repeat imaging and wherein the repeat imaging comprises at least one intraoperative x-ray imaging, C-arm imaging, digital tomosynthesis, cone beam CT, CT scan, CT scan generated by x-ray acquisition with a C-arm system, spiral or helical CT scan, 3D scan, O-arm scan, or a combination thereof.