Natural physio-optical user interface for intraocular microdisplay
An intraocular micro-display (IOMD) system includes an auxiliary head unit. The auxiliary head unit includes a frame for mounting to a head of a user, a scene camera module mounted in or on the frame in a forward-facing orientation, a gaze tracking module disposed in or on the frame and configured to monitor an eye of the user, and an auxiliary controller. The auxiliary controller includes for: acquiring a scene image with the scene camera module, determining a gazing direction of the eye based upon gaze direction data from the gaze tracking module, identifying a sub-portion of the scene image based upon the gazing direction, and wirelessly relaying the sub-portion of the scene image to an IOMD implant within the eye for displaying to a retina of the eye.
1 . An intraocular micro-display (IOMD) system, comprising:
an implant including a micro-display for displaying images onto a retina of an eye of a user when implanted inside the eye, and a first controller; and
a head mounted device including:
a camera for capturing a scene image that is forward facing of the user while worn by the user, and
a second controller configured to:
acquire the scene image from the camera; and
wirelessly transmit the scene image to the implant,
wherein the first controller is configured to:
cause the micro-display to display the scene image onto the retina of the eye;
receive an indication that an eyelid of the eye is closed; and
temporarily cause the micro-display to cease displaying the scene image onto the retina while the eyelid is deemed closed based upon the indication; and
wherein the implant includes a sensor configured to monitor whether the eyelid is closed, and the indication is generated based on an output of the sensor.
2 . The IOMD system of claim 1 , wherein the indication is generated based on the output of the sensor of the head mounted device, and the indication is wirelessly transmitted to the implant from the head mounted device.
3 . The IOMD system of claim 2 , wherein the sensor comprises an eye-ward facing camera for visually monitoring the eyelid and produces eye images as the output of the sensor.
4 . The IOMD system of claim 1 , wherein the first controller temporarily causes the micro-display to cease displaying the scene image by causing the micro-display to stop projecting a regenerated image of the scene image onto the retina until a subsequent indication is received that indicates that the eyelid of the eye is open.
5 . The IOMD system of claim 1 ,
wherein the head mounted device includes a second sensor for generating gaze direction data of the eye of the user,
wherein the second controller is further configured to:
determine a gazing direction of the eye based on the gaze direction data;
identify a sub-portion of the scene image based on the gazing direction; and
wirelessly transmit the sub-portion of the scene image to the implant.
6 . The IOMD system of claim 5 , wherein the second controller is further configured to:
identify a different sub-portion of the scene image based on a change to the gazing direction of the eye; and
wirelessly transmit the different sub-portion of the scene image to the implant.
7 . An intraocular implant, comprising:
a micro-display for displaying images onto a retina of an eye of a user while the intraocular implant is inside the eye;
a controller configured to:
wirelessly receive, from an electronic device, one or more images captured by a camera of the electronic device;
cause the micro-display to display the one or more images onto a retina of the eye;
determine that an eyelid of the eye is closed; and
responsive to a determination that the eyelid is closed, cause the micro-display to cease displaying the one or more images onto the retina while the eyelid is closed; and
a sensor configured to monitor whether the eyelid is closed, wherein the controller determines that the eyelid of the eye is closed based on an output of the sensor.
8 . The intraocular implant of claim 7 , wherein the sensor comprises a photosensor that is configured to monitor whether the eyelid is closed by tracking changes in light intensity.
9 . The intraocular implant of claim 7 ,
wherein the electronic device comprises a head mounted device that is configured to wirelessly transmit a power signal to the intraocular implant for powering at least the micro-display and the controller during operation of the intraocular implant, wherein the one or more images are wirelessly received as a data signal,
wherein the controller determines that the eyelid of the eye is closed by sensing one or more fluctuations in a signal strength of the data signal or of the power signal.
10 . The intraocular implant of claim 7 , wherein the controller is configured to determine that the eyelid of the eye is closed by wirelessly receiving, from the electronic device, a black image instead of the one or more images captured by the camera.
11 . The intraocular implant of claim 7 , wherein the controller is configured to determine that the eyelid of the eye is closed by wirelessly receiving, from the electronic device, an indication that the eyelid is currently deemed closed.
12 . A head mounted device of an intraocular micro-display (IOMD) system that comprises an implant that has a micro-display, the head mounted device comprising:
a camera for capturing a scene image that is forward facing of a user while the head mounted device is worn by the user, and
a controller configured to:
receive the scene image from the camera;
wirelessly transmit a data signal comprising image data based on the scene image to the implant to cause the micro-display to display the image data onto a retina of an eye in which the implant is implanted;
determine that an eyelid of the eye is closed; and
temporarily cause the micro-display to cease displaying the image data onto the retina while the eyelid is closed; and
encode the data signal with an indication that the eyelid of the eye is when the eyelid of the eye is closed.
13 . The head mounted device of claim 12 , wherein the controller temporarily causes the micro-display to cease displaying the image data by wirelessly transmitting the indication that the eyelid of the eye is closed, wherein the indication configures the implant to stop displaying the image data.
14 . The head mounted device of claim 13 , wherein the indication is generated based on eye images produced by an eye-ward facing camera of the head mounted device.
15 . The head mounted device of claim 12 further comprises a sensor for generating gaze direction data of the eye of the user, wherein the controller is further configured to:
determine a gazing direction of the eye based on the gaze direction data; and
identify a sub-portion of the scene image based on the gazing direction,
wherein the image data comprises the sub-portion of the scene image.
16 . The head mounted device of claim 15 , wherein the controller is further configured to:
identify a different sub-portion of the scene image based on a change to the gazing direction of the eye; and
wirelessly transmit the different sub-portion of the scene image to the implant.
17 . The head mounted device of claim 15 , wherein the controller determines the gazing direction of the eye by:
identifying a fiducial disposed in or on the eye based on the gaze direction data; and
determining a position of the fiducial relative to a reference position.
18 . The head mounted device of claim 17 , wherein the fiducial comprises a tattoo disposed on a cornea or an iris of the eye.
19 . The head mounted device of claim 12 , wherein the controller is configured to determine that the eyelid of the eye is closed based on an actuation of a sensor.
20 . The head mounted device of claim 19 , wherein the controller is configured to wirelessly transmit a signal based on the actuation of the sensor to the implant to cause the micro-display to cease displaying the image data onto the retina of the eye in which the implant is implanted.