Systems and method for augmented reality ophthalmic surgical microscope projection
The disclosure provides a system including an augmented reality device communicatively coupled to an imaging system of an ophthalmic microscope. The augmented reality device may include a lens configured to project a digital image, a gaze control configured to detect a focus of an eye of an operator, and a dimming system communicatively coupled to the gaze control and the outer surface and including a processor that receives a digital image from the imaging system, projects the digital image on the lens, receives a signal from the gaze control regarding the focus of the eye of the operator, and transitions the outer surface of the augmented reality device between at least partially transparent to opaque based on the received signal. The disclosure further includes a method of performing ophthalmic surgery using an augmented reality device and a non-transitory computer readable medium able to perform augmented reality functions.
1. A system for an ophthalmic surgery comprising:
an augmented reality device communicatively coupled to an imaging system of an ophthalmic microscope, the augmented reality device comprising:
a lens configured to:
project a digital image onto an eye of an operator of the augmented reality device; and
allow the eye to view a physical space beyond the lens;
an outer surface coupled to the lens, the outer surface being at least partially transparent;
a gaze tracker comprising a device configured to:
detect a focus of the eye in order to determine the gaze of the eye;
determine if the eye is focused on the digital image or the physical space; and
transmit an indication based on the focus; and
a dimming system communicatively coupled to the gaze tracker and the outer surface, the dimming system including a processor operable to:
receive the digital image from the imaging system of the ophthalmic microscope;
project the digital image onto the lens;
receive the indication from the gaze tracker regarding the focus of the eye of the operator; and
transition the outer surface of the augmented reality device between at least partially transparent to opaque based on the received indication, the transitioning comprising:
if the eye is focused on the digital image projected onto the lens, transitioning the outer surface to opaque; and
if the eye is focused on the physical space beyond the lens, transitioning the outer surface to at least partially transparent.
2. The system of claim 1 , wherein the augmented reality device comprises augmented reality glasses.
3. The system of claim 1 , wherein the digital image comprises a separate image projected onto the lens for each eye of the operator.
4. The system of claim 1 , further comprising an instrument configured to engage with the digital image.
5. The system of claim 4 , wherein the instrument comprises a physical instrument manipulated by the operator.
6. The system of claim 4 , wherein the instrument comprises a digital instrument manipulated by the operator.
7. The system of claim 1 , further comprising an input/output device configured to engage with the digital image.
8. A method of performing an ophthalmic surgery comprising:
receiving a digital image from an imaging system of an ophthalmic microscope;
projecting the digital image on a lens of an augmented reality device;
detecting a focus of an eye of an operator of the augmented reality device in order to determine if the eye is focused on the digital image or a physical space beyond the lens;
receiving an indication regarding the focus of the eye of the operator; and
transitioning an outer surface of the augmented reality device between at least partially transparent to opaque based on the received indication, the transitioning comprising:
if the eye is focused on the digital image projected onto the lens, transitioning the outer surface to opaque; and
if the eye is focused on the physical space beyond the lens, transitioning the outer surface to at least partially transparent.
9. The method of claim 8 , wherein the augmented reality device comprises augmented reality glasses.
10. The method of claim 8 , wherein the digital image comprises a separate image projected onto the lens for each eye of the operator.
11. The method of claim 8 , further comprising engaging an instrument with the digital image.
12. The method of claim 11 , wherein the instrument comprises a physical instrument manipulated by the operator.
13. The method of claim 11 , wherein the instrument comprises a digital instrument manipulated by the operator.
14. The method of claim 8 , further comprising an input/output device configured to engage with the digital image.
15. A non-transitory computer readable medium having instructions stored therein, the instructions readable by a processor and, when read and executed, configured to cause the processor to:
receive a digital image from an imaging system of an ophthalmic microscope;
project the digital image on a lens of an augmented reality device;
determine a focus of an eye of an operator of the augmented reality device in order to determine if the eye is focused on the digital image or a physical space beyond the lens;
receive an indication regarding the focus of the eye of the operator; and
transition an outer surface of the augmented reality device between at least partially transparent to opaque based on the received indication, the transitioning comprising:
if the eye is focused on the digital image projected onto the lens, transitioning the outer surface to opaque; and
if the eye is focused on the physical space beyond the lens, transitioning the outer surface to at least partially transparent.
16. The non-transitory computer readable medium of claim 15 , wherein the augmented reality device comprises augmented reality glasses.
17. The non-transitory computer readable medium of claim 15 , wherein the digital image comprises a separate image projected onto the lens for each eye of the operator.
18. The non-transitory computer readable medium of claim 15 , wherein the processor is further configured to engage an instrument with the digital image.
19. The non-transitory computer readable medium of claim 18 , wherein the instrument comprises a physical instrument manipulated by the operator.
20. The non-transitory computer readable medium of claim 18 , wherein the instrument comprises a digital instrument manipulated by the operator.