Variable intensity distributions for gaze detection assembly
A gaze detection assembly comprises a plurality of infrared (IR) light emitters configured to emit IR light toward a user eye and an IR camera configured to sequentially capture IR images of the user eye. A controller is configured to, during a reference frame, control the plurality of IR light emitters to emit IR light toward the user eye with a reference intensity distribution. During the reference frame, an IR image is captured depicting a first glint distribution on the user eye. Based at least in part on the first glint distribution, during a subsequent frame, the plurality of IR light emitters are controlled to emit IR light toward the user eye with a subsequent intensity distribution, different than the reference intensity distribution. During the subsequent frame, a second IR image is captured depicting a second glint distribution on the user eye.
1. A gaze detection assembly, comprising:
a plurality of infrared (IR) light emitters configured to emit IR light toward a user eye;
an IR camera configured to sequentially capture IR images of the user eye; and
a controller configured to:
during a reference frame, control the plurality of IR light emitters to emit IR light toward the user eye with a reference intensity distribution;
during the reference frame, capture a first IR image of the user eye, the first IR image depicting a first glint distribution on the user eye;
based at least in part on the first glint distribution, during a subsequent frame, control the plurality of IR light emitters to emit IR light toward the user eye with a subsequent intensity distribution, different than the reference intensity distribution;
during the subsequent frame, capture a second IR image of the user eye, the second IR image depicting a second glint distribution on the user eye; and
on a recheck frame occurring one or more frames after the subsequent frame, control the plurality of IR light emitters to emit IR light toward the user eye with the reference intensity distribution, wherein the recheck frame is triggered responsive to the controller outputting a gaze direction estimate of the user eve having an associated confidence parameter below a predetermined confidence threshold.
2. The gaze detection assembly of claim 1 , wherein controlling the plurality of IR emitters to emit IR light toward the user eye with the subsequent intensity distribution includes reducing an intensity of the IR light emitted by one or more IR light emitters relative to the reference intensity distribution.
3. The gaze detection assembly of claim 1 , wherein controlling the plurality of IR emitters to emit IR light toward the user eye with the subsequent intensity distribution includes deactivating one or more IR light emitters relative to the reference intensity distribution.
4. The gaze detection assembly of claim 3 , wherein the controller is configured to identify correspondences between individual glints of the first glint distribution and individual IR light emitters of the plurality of IR light emitters, and deactivating the one or more IR light emitters includes deactivating an IR light emitter that does not correspond to a glint of the first glint distribution.
5. The gaze detection assembly of claim 1 , wherein emitting IR light toward the user eye with the subsequent intensity distribution consumes less electrical power than emitting IR light toward the user eye with the reference intensity distribution.
6. The gaze detection assembly of claim 1 , wherein the controller is configured to output a first gaze direction estimate of the user eye during the reference frame based at least in part on the first glint distribution, and output a second gaze direction estimate of the user eye during the subsequent frame based at least in part on the second glint distribution.
7. The gaze detection assembly of claim 6 , wherein the controller is configured to output a first confidence parameter based at least in part on the first glint distribution, and a second confidence parameter based at least in part on the second glint distribution.
8. The gaze detection assembly of claim 1 , wherein the recheck frame is additionally triggered responsive to the controller outputting the gaze direction estimate of the user eye that differs from a preceding gaze direction estimate by more than a difference threshold.
9. The gaze detection assembly of claim 1 , wherein the IR camera includes an image sensor having a plurality of pixels, the controller reads pixel values from each of the plurality of pixels during the reference frame, and based at least in part on the first glint distribution, the controller reads pixel values from less than all of the plurality of pixels during the subsequent frame.
10. The gaze detection assembly of claim 1 , wherein the gaze detection assembly is a component of a head-mounted display device configured to present virtual imagery to the user eye.
11. A method for a gaze detection assembly, the method comprising:
during a reference frame, controlling a plurality of IR light emitters to emit IR light toward a user eye with a reference intensity distribution;
during the reference frame, capturing a first IR image of the user eye via an IR camera, the first IR image depicting a first glint distribution on the user eye;
based at least in part on the first glint distribution, during a subsequent frame, controlling the plurality of IR light emitters to emit IR light toward the user eye with a subsequent intensity distribution, different than the reference intensity distribution;
during the subsequent frame, capturing a second IR image of the user eye via the IR camera, the second IR image depicting a second glint distribution on the user eye; and
on a recheck frame occurring one or more frames after the subsequent frame, controlling the plurality of IR light emitters to emit IR light toward the user eye with the reference intensity distribution, wherein the recheck frame is triggered responsive to a controller of the gaze detection assembly outputting a gaze direction estimate of the user eye differing from a preceding gaze direction estimate by more than a difference threshold.
12. The method of claim 11 , wherein controlling the plurality of IR emitters to emit IR light toward the user eye with the subsequent intensity distribution includes reducing an intensity of the IR light emitted by one or more IR light emitters relative to the reference intensity distribution.
13. The method of claim 11 , further comprising outputting a first gaze direction estimate of the user eye during the reference frame based at least in part on the first glint distribution, and outputting a second gaze direction estimate of the user eye during the subsequent frame based at least in part on the second glint distribution.
14. The method of claim 11 , wherein the recheck frame additionally is triggered responsive to the controller of the gaze detection assembly outputting the gaze direction estimate of the user eye having an associated confidence parameter below a predetermined confidence threshold.
15. A gaze detection assembly, comprising:
a plurality of infrared (IR) light emitters configured to emit IR light toward a user eye;
an IR camera configured to sequentially capture IR images of the user eye; and
a controller configured to:
during a reference frame, control the plurality of IR light emitters to emit IR light toward the user eye with a reference intensity distribution;
during the reference frame, capture a first IR image of the user eye, the first IR image depicting a first glint distribution on the user eye;
output a first gaze direction estimate of the user eye based at least in part on the first glint distribution;
during a subsequent frame, based at least in part on the first glint distribution, control the plurality of IR light emitters to emit IR light toward the user eye with a subsequent intensity distribution, different than the reference intensity distribution, by reducing one or both of:
an intensity of the IR light emitted by the plurality of IR light emitters as compared to the reference intensity distribution, and
a quantity of the IR light emitters emitting IR light toward the user eye as compared to the reference intensity distribution;
during the subsequent frame, capture a second IR image of the user eye, the second IR image depicting a second glint distribution on the of the user eye;
output a second gaze direction estimate of the user eye based at least in part on the second glint distribution; and
on a recheck frame occurring one or more frames after the subsequent frame, control the plurality of IR light emitters to emit IR light toward the user eye with the reference intensity distribution, wherein the recheck frame is triggered responsive to the controller outputting a subsequent gaze direction estimate of the user eye having an associated confidence parameter below a predetermined confidence threshold.