Augmented reality dental surgery
Systems and methods of the present disclosure relate to augmented reality (AR) assisted surgery. A system comprises a spatial virtual surgical treatment plan (SVSTP) for mixed or virtual reality; multiple AR interfaces (ARIs), each ARI configured to overlay the SVSTP onto a surgical site, wherein the ARIs are positioned at different angles to provide an unobstructed view of the surgical site and reduce parallax and occlusion errors during surgery, wherein the ARIs are configured to exchange coordinate information with each other such that the SVSTP viewed from each ARI is overlaid upon the surgical site and superimposed with each other to guide a surgical instrument.
1. An augmented reality (AR) assisted surgical system comprising:
a three-dimensional spatial virtual surgical treatment plan (SVSTP) for mixed or virtual reality; and
multiple AR interfaces (ARIs), including a first ARI and a second ARI, at least the first ARI and the second ARI configured to overlay the SVSTP onto a surgical site to generate an overlaid SVSTP viewed from the first ARI and an overlaid SVSTP viewed from the second ARI, wherein the ARIs are positioned at different angles and are configured to exchange three-dimensional coordinate information with each other, wherein the exchanged coordinate information is used to align different surgical view angles to superimpose at least the overlaid SVSTP viewed from the first ARI with the overlaid SVSTP viewed from the second ARI to generate a superimposed SVSTP, which is used to display information on at least the first ARI to guide a surgical instrument in three dimensions, and to provide an unobstructed view of the surgical site and reduce parallax and occlusion errors during surgery.
2. The system of claim 1 , further comprising a camera in communication with the ARIs, the camera dynamically positionable to reduce viewing obstruction at the surgical site.
3. The system of claim 1 , wherein at least one of the ARIs comprises a face shield, wherein the face shield comprises a display configured to display the SVSTP.
4. The system of claim 1 , wherein the coordinate information comprises less than 1 kilobyte of coordinates without images.
5. The system of claim 1 , wherein at least the first and the second ARIs are operable to synchronize surgical images and surgical procedures.
6. The system of claim 5 , wherein at least one of the ARIs is operable to project synchronized surgical images and surgical procedures onto another ARI for teaching purposes.
7. The system of claim 1 , wherein at least the first and second ARIs are configured to utilize a coordinate transformation.
8. The system of claim 1 , wherein the SVSTP comprises virtual markers.
9. The system of claim 8 , wherein the surgical site comprises physical rigid markers.
10. The system of claim 9 , wherein the virtual markers are positioned to overlay corresponding ones of the physical rigid markers.
11. The system of claim 9 , wherein the physical rigid markers comprise anatomical structures.
12. The system of claim 9 , wherein the physical rigid markers comprise radiographical markers.
13. The system of claim 1 , wherein the SVSTP is pinned to the surgical site.
14. A method for performing augmented reality (AR) assisted surgery, the method comprising:
loading a three-dimensional spatial virtual surgical treatment plan (SVSTP) onto multiple ARIs, including a first ARI and a second ARI;
positioning the first ARI and the second ARI at different angles to a surgical site during surgery;
identifying virtual and one or more corresponding physical rigid markers with at least the first and second ARIs based on the SVSTP;
exchanging three-dimensional coordinate information between at least the first and second ARIs;
overlaying the SVSTP onto the surgical site viewed from at least the first ARI and the second ARI to generate an overlaid SVSTP viewed from the first ARI and an overlaid SVSTP viewed from the second ARI;
using the exchanged coordinate information to align different surgical view angles to superimpose at least the overlaid SVSTP viewed from the first ARI with the overlaid SVSTP viewed from the second ARI to generate a superimposed SVSTP; and
displaying information based on the superimposed SVSTP on at least the first ARI to guide a surgical instrument in three dimensions, and to reduce parallax and occlusion issues during surgery.
15. The method of claim 14 , further comprising establishing a coordinate system for the ARIs.
16. The method of claim 15 , further comprising tracking the surgical site with a camera.
17. The method of claim 16 , further comprising establishing a coordinate transformation to exchange coordinates.
18. The method of claim 17 , further comprising placing markers at the surgical site.
19. The method of claim 14 , further comprising selecting virtual markers from the SVSTP with at least the first and second ARIs.
20. The method of claim 19 , further comprising selecting physical markers at the surgical site that correspond with the virtual markers.