Managing input modalities on an extended reality device

1 . A method comprising:

moving a position indicator of a display device from a first location determined by a controller to a second location determined by a tracker of an eye gaze;

detecting an intent state relating to eye movements based on eye tracking data from a sensor system of the display device;

receiving an input signal representing a displacement of the controller; and

in response to the intent state being detected as a non-fixation state and the displacement achieving a movement threshold:

moving the position indicator from the second location back to the first location; and

displaying the position indicator at the first location.

2 . The method of claim 1 , further comprising:

in response to the intent state being detected as a fixation state and the displacement achieving the movement threshold:

moving the position indicator from the second location to a third location determined by the tracker; and

displaying the position indicator at the third location.

3 . The method of claim 1 , further comprising:

in response to the intent state being detected as a fixation state and the displacement not achieving the movement threshold, moving the position indicator to a third location determined by the tracker, the position indicator not being visibly displayed at the third location.

4 . The method of claim 1 , further comprising:

in response to the position indicator being displayed at the first location, detecting the intent state as a fixation state;

determining whether a distance between a third location determined by the tracker and the first location satisfies a threshold level; and

in response to the distance between the third location and the first location being determined as satisfying the threshold level and the intent state being detected as the fixation state, moving the position indicator from the first location to the third location, the position indicator not being visibly displayed at the third location.

5 . The method of claim 4 , further comprising:

in response to the distance between the third location and the first location being determined as not satisfying the threshold level and the intent state being detected as the fixation state, continuing to display the position indicator at the first location.

6 . The method of claim 1 , wherein the non-fixation state includes a saccade state, the method further comprising:

in response to the position indicator being displayed at the first location, detecting the intent state as the saccade state;

determining whether a length of a saccade satisfies a threshold level;

in response to the length of the saccade satisfying the threshold level, moving the position indicator from the first location to a third location, the third location being a latest reading of the tracker, the position indicator not visibly displayed at the third location; and

in response to the length of the saccade satisfying the threshold level, continuing to display the position indicator at the first location.

7 . The method of claim 1 , wherein the non-fixation state includes a saccade state and an undecided state, wherein detecting the intent state includes:

detecting a fixation state based on the eye tracking data achieving a dispersion threshold;

detecting the saccade state based on the eye tracking data achieving a velocity threshold; and

detecting the undecided state based on the eye tracking data not achieving the dispersion threshold and the eye tracking data not achieving the velocity threshold.

8 . The method of claim 1 , further comprising:

identifying an interface element based on the eye tracking data by determining that the interface element is at a third location corresponding to a fixation location determined by the tracker;

detecting a user gesture while the position indicator is at the first location; and

in response to the user gesture being detected, selecting the interface element at the third location.

9 . A display device comprising:

at least one processor; and

a non-transitory computer-readable medium storing executable instructions that cause the at least one processor to:

move a position indicator of the display device from a first location determined by a controller to a second location determined by a tracker of an eye gaze, the position indicator not being visibly displayed at the second location;

detect an intent state relating to eye movements based on eye tracking data from a sensor system on the display device;

receive an input signal representing a displacement of the controller; and

in response to the intent state being detected as a non-fixation state and the displacement achieving a movement threshold:

move the position indicator from the second location back to the first location; and

display the position indicator at the first location.

10 . The display device of claim 9 , wherein the executable instructions include instructions that cause the at least one processor to:

in response to the intent state being detected as a fixation state and the displacement achieving the movement threshold:

move the position indicator from the second location to a third location determined by the tracker; and

display the position indicator at the third location.

11 . The display device of claim 9 , wherein the executable instructions include instructions that cause the at least one processor to:

in response to the intent state being detected as a fixation state and the displacement not achieving the movement threshold, move the position indicator from the second location to a third location determined by the tracker, the position indicator not being visibly displayed at the third location.

12 . The display device of claim 9 , wherein the executable instructions include instructions that cause the at least one processor to:

in response to the position indicator being displayed at the first location, detect the intent state as a fixation state;

determine whether a distance between a third location determined by the tracker and the first location satisfies a threshold level; and

in response to the distance between the third location and the first location being determined as satisfying the threshold level and the intent state being detected as the fixation state, move the position indicator from the first location to the third location, the position indicator not being visibly displayed at the third location.

13 . The display device of claim 12 , wherein the executable instructions include instructions that cause the at least one processor to:

in response to the distance between the third location and the first location being determined as not satisfying the threshold level and the intent state being detected as the fixation state, continue to display the position indicator at the first location.

14 . The display device of claim 9 , wherein the non-fixation state includes a saccade state, wherein the executable instructions include instructions that cause the at least one processor to:

in response to the position indicator being displayed at the first location, detect the intent state as the saccade state;

determine whether a length of a saccade satisfies a threshold level;

in response to the length of the saccade satisfying the threshold level, move the position indicator from the first location to a third location, the third location being a latest reading of the tracker; and

in response to the length of the saccade not satisfying the threshold level, continue to display the position indicator at the first location.

15 . The display device of claim 9 , wherein the non-fixation state includes a saccade state and an undecided state, wherein the executable instructions include instructions that cause the at least one processor to:

detect a fixation state based on the eye tracking data achieving a dispersion threshold;

detect the saccade state based on the eye tracking data achieving a velocity threshold; and

detect the undecided state based on the eye tracking data not achieving the dispersion threshold and the eye tracking data not achieving the velocity threshold.

16 . The display device of claim 9 , wherein the executable instructions include instructions that cause the at least one processor to:

identify an interface element based on the eye tracking data by determining that the interface element is at a third location corresponding to a fixation location determined by the tracker;

detect a user gesture while the position indicator is at the first location; and

in response to the user gesture being detected, select the interface element at the third location.

17 . A non-transitory computer-readable medium storing executable instructions that when executed by at least one processor cause the at least one processor to execute operations, the operations comprising:

moving a position indicator of a display device from a first location determined by a controller to a second location determined by a tracker of an eye gaze, the position indicator not being visibly displayed at the second location;

detecting an intent state relating to eye movements based on eye tracking data from a sensor system on the display device;

receiving an input signal representing a displacement of the controller; and

in response to the intent state being detected as a non-fixation state and the displacement achieving a movement threshold:

moving the position indicator from the second location back to the first location; and

displaying the position indicator at the first location.

18 . The non-transitory computer-readable medium of claim 17 , the operations further comprising:

in response to the intent state being detected as a fixation state and the displacement achieving the movement threshold:

moving the position indicator from the second location to a third location determined by the tracker; and

displaying the position indicator at the third location.

19 . The non-transitory computer-readable medium of claim 17 , wherein the non-fixation state includes a saccade state, wherein the operations comprise:

in response to the position indicator being displayed at the first location, detecting the intent state as the saccade state;

determining whether a length of a saccade satisfies a threshold level; and

in response to the length of the saccade satisfying the threshold level and the intent state being detected as the saccade state, moving the position indicator from the first location to a third location, the third location being a latest reading of the tracker, the position indicator not visibly displayed at the third location.

20 . The non-transitory computer-readable medium of claim 17 , wherein the operations further comprise:

identifying an interface element based on the eye tracking data by determining that the interface element is at a third location corresponding to a fixation location determined by the tracker;

detecting a user gesture while the position indicator is at the first location; and

in response to the user gesture being detected, selecting the interface element at the third location.