Eye tracking system for use in head-mounted display units
An eye tracking system for use with a head-mounted display (HMD) unit is described. The eye tracking system includes a support frame mounted to the HMD unit, a light source mounted to the support frame and configured to illuminate an area of a patient eye, a plurality of photosensors mounted to the support frame and configured to receive reflected light from different portions of the illuminated patient eye, a temperature sensor mounted to the support frame and configured to measure a temperature of the photosensors, and a processor. The processor is programmed to execute an algorithm including a processing module that compensates photosensor measurement error due to variable operating temperature in the HMD unit, and an eye-tracking module that determines a gaze position of the patient eye using a mapping between intensities of photosensors and a gaze position estimated during a calibration procedure.
1. An eye tracking system for use with a head-mounted display (HMD) unit, comprising:
a support frame mounted to the HMD unit;
a light source mounted to the support frame and configured to illuminate an area of a subject's eye;
a plurality of photosensors mounted to the support frame and configured to receive reflected light from different portions of the illuminated eye;
a temperature sensor mounted to the support frame and configured to measure an interior temperature of the HMD unit; and
a processor programmed to execute an algorithm including:
a processing module that compensates photosensor measurement error due to variable operating temperature in the HMD unit including:
receiving the interior temperature measurement of the HMD unit from the temperature sensor;
determining an estimated temperature of the photosensors based on the received interior temperature measurement of the HMD unit and a coefficient based on the HMD unit; and
compensating photosensor measurement error based on the estimated temperature of the photosensors by calculating a heat transfer formula including:
T ph ( i )= T ph ( i−i )+ K ·( T ( i− 1)− T ( i ));
wherein Tph(i) is an estimated photosensor temperature, T(i) is a measured interior temperature of the HMD unit, and K is a heat transfer coefficient; and
an eye-tracking module that determines a gaze position of the eye using a mapping between intensities of photosensors and a gaze position estimated during a calibration procedure.
2. The eye tracking system of claim 1 , wherein the processor is programmed to execute the algorithm including the steps of:
determining the gaze position of the eye using the mapping between the intensities of photosensors that are compensated photosensor measurement errors due to variable operating temperature in the HMD unit and the estimated gaze position.
3. The eye tracking system of claim 1 , wherein the processor is programmed to execute the algorithm including the steps of:
adjusting display properties of the HMD unit based on the determined gaze position of the eye; and
adjusting a rendering process for the HMD unit based on the determined gaze position of the eye.
4. The eye tracking system of claim 1 , wherein the processor is programmed to execute the algorithm including the steps of:
estimating inter-pupilar distance measurements based on the determined gaze position of the eye.
5. The eye tracking system of claim 1 ,
wherein the heat transfer formula includes the coefficient based on the HIVID unit.
6. The eye tracking system of claim 1 , wherein the processing module compensates a non-linear independence of photosensor reading with a temperature of a photosensor.
7. The eye tracking system of claim 1 , wherein the processor is programmed to execute the algorithm including the steps of:
compensating photosensor measurement error connected with a temperature variation in the HMD unit.
8. The eye tracking system of claim 1 , wherein the processor is programmed to execute the algorithm including the steps of:
performing the calibration procedure including acquiring calibration data by:
operating the HMD unit to present a fixation target sequentially at multiple known locations; and
detecting and storing light intensities gathered by the photosensors during presentation of the fixation target.
9. The eye tracking system of claim 1 , wherein the processor is programmed to execute the algorithm including the steps of:
constructing the mapping between intensities values and a gaze position by using the calibration data to construct a mapping basing purely on a reading of a single user, or a general mapping modified for a selected user.
10. A method of operating an eye tracking system mounted to an HMD unit, the eye tracking system including a light source configured to illuminate an area of a subject's eye, a plurality of photosensors configured to receive reflected light from different portions of the illuminated eye, a temperature sensor configured to measure an interior temperature of the HMD unit, and a processor, the method including the processor performing an algorithm including:
a processing module that compensates photosensor measurement error due to variable operating temperature in the HMD unit including:
receiving an interior temperature measurement of the HMD unit from the temperature sensor; and
determining an estimated temperature of the photosensors based on the received interior temperature measurement of the HMD unit and a coefficient based on the HMD unit; and
compensating photosensor measurement error based on the estimated temperature of the photosensors by calculating a heat transfer formula including:
T ph ( i )= T ph ( i−i )+ K ·( T ( i− 1)− T ( i ))
wherein Tph(i) is an estimated photosensor temperature, T(i) is a measured interior temperature of the HMD unit, and K is a heat transfer coefficient; and
an eye-tracking module that determines a gaze position of the eye using a mapping between intensities of photosensors and a gaze position estimated during a calibration procedure.
11. The method of claim 10 , including the processor performing the algorithm including the steps of:
determining the gaze position of the eye using the mapping between the intensities of photosensors that are compensated photosensor measurement errors due to variable operating temperature in the HMD unit and the estimated gaze position.
12. The method of claim 10 , including the processor performing the algorithm including the steps of:
adjusting display properties of the HMD unit based on the determined gaze position of the eye; and
adjusting a rendering process for the HMD unit based on the determined gaze position of the eye.
13. The method of claim 10 , including the processor performing the algorithm including the steps of:
estimating inter-pupilar distance measurements based on the determined gaze position of the eye.
14. The method of claim 10 ,
wherein the heat transfer formula includes the coefficient based on the HMD unit.
15. The method of claim 10 , wherein the processing module compensates a non-linear independence of photosensor reading with a temperature of a photosensor.
16. The method of claim 10 , including the processor performing the algorithm including the steps of:
compensating photosensor measurement error connected with a temperature variation in the HMD unit.
17. The method of claim 10 , including the processor performing the algorithm including the steps of:
performing the calibration procedure including acquiring calibration data by:
operating the HMD unit to present a fixation target sequentially at multiple known locations; and
detecting and storing light intensities gathered by the photosensors during presentation of the fixation target.
18. A non-transitory computer-readable storage media having computer-executable instructions embodied thereon for operating an eye tracking system mounted to an HMD unit, the eye tracking system including a light source configured to illuminate an area of a subject's eye, a plurality of photosensors configured to receive reflected light from different portions of the illuminated eye, a temperature sensor configured to measure an interior temperature of the HMD unit, and a processor, when executed by the processor the computer-executable instructions cause the processor to perform an algorithm including:
a processing module that compensates photosensor measurement error due to variable operating temperature in the HMD unit including:
receiving an interior temperature measurement of the HMD unit from the temperature sensor; and
determining an estimated temperature of the photosensors based on the received interior temperature measurement of the HMD unit and a coefficient based on the HMD unit; and
compensating photosensor measurement error based on the estimated temperature of the photosensors by calculating a heat transfer formula including:
T ph ( i )= T ph ( i−i )+ K ·( T ( i− 1)− T ( i ))
wherein Tph(i) is an estimated photosensor temperature, T(i) is a measured interior temperature of the HMD unit, and K is a heat transfer coefficient; and
an eye-tracking module that determines a gaze position of the eye using a mapping between intensities of photosensors and a gaze position estimated during a calibration procedure.