Gaze-based user interactions
In an exemplary process for interacting with user interface objects using an eye gaze, an affordance associated with a first object is displayed. A gaze direction or a gaze depth is determined. While the gaze direction or the gaze depth is determined to correspond to a gaze at the affordance, a first input representing user instruction to take action on the affordance is received, and the affordance is selected responsive to receiving the first input.
1. An electronic device, comprising:
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
while the electronic device is in a gaze-engaged mode:
receiving a first user input at a first time;
determining a gaze position at the first time;
in response to receiving the first user input and in accordance with a determination that a plurality of possible selectable positions are at the gaze position at the first time:
designating a selection point at a first position of the plurality of possible selectable positions; and
switching the electronic device from the gaze-engaged mode to a gaze-disengaged mode; and
while the electronic device is in the gaze-disengaged mode:
while maintaining designation of the selection point, receiving a second user input;
in response to receiving the second user input, moving the selection point to a second position of the plurality of possible selectable positions, wherein the second position is different than the first position, and wherein moving the selection point to the second position is not based on the gaze position;
while the selection point is at the second position, receiving a third user input; and
in response to receiving the third user input, confirming the selection point at the second position.
2. The electronic device of claim 1 , wherein the one or more programs further include instructions for:
in response to receiving the third user input, selecting an object corresponding to the second position.
3. The electronic device of claim 1 , wherein the one or more programs further include instructions for:
before receiving the first user input, selecting an object at a third position different than the second position; and
in response to receiving the third user input, placing the object at the second position.
4. The electronic device of claim 1 , wherein the first user input is the same type of input as the second user input or the third user input.
5. The electronic device of claim 1 , wherein the second position is different than a gaze position associated with the second user input.
6. The electronic device of claim 1 , wherein the selection point is designated at the first position in accordance with a determination that the first user input is a first type of input, and wherein the one or more programs further include instructions for:
in response to receiving the first user input:
in accordance with a determination that the first user input is a second type of input different than the first type of input, confirming the selection point at the first position.
7. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device, the one or more programs including instructions for:
while the electronic device is in a gaze-engaged mode:
receiving a first user input at a first time;
determining a gaze position at the first time;
in response to receiving the first user input and in accordance with a determination that a plurality of possible selectable positions are at the gaze position at the first time:
designating a selection point at a first position of the plurality of possible selectable positions; and
switching the electronic device from the gaze-engaged mode to a gaze-disengaged mode; and
while the electronic device is in the gaze-disengaged mode:
while maintaining designation of the selection point, receiving a second user input;
in response to receiving the second user input, moving the selection point to a second position of the plurality of possible selectable positions, wherein the second position is different than the first position, and wherein moving the selection point to the second position is not based on the gaze position;
while the selection point is at the second position, receiving a third user input; and
in response to receiving the third user input, confirming the selection point at the second position.
8. The non-transitory computer-readable storage medium of claim 7 , wherein the one or more programs further include instructions for:
in response to receiving the third user input, selecting an object corresponding to the second position.
9. The non-transitory computer-readable storage medium of claim 7 , wherein the one or more programs further include instructions for:
before receiving the first user input, selecting an object at a third position different than the second position; and
in response to receiving the third user input, placing the object at the second position.
10. The non-transitory computer-readable storage medium of claim 7 , wherein the first user input is the same type of input as the second user input or the third user input.
11. The non-transitory computer-readable storage medium of claim 7 , wherein the second position is different than a gaze position associated with the second user input.
12. The non-transitory computer-readable storage medium of claim 7 , wherein the selection point is designated at the first position in accordance with a determination that the first user input is a first type of input, and wherein the one or more programs further include instructions for:
in response to receiving the first user input:
in accordance with a determination that the first user input is a second type of input different than the first type of input, confirming the selection point at the first position.
13. A method, comprising:
at an electronic device that is in communication with one or more input devices:
while the electronic device is in a gaze-engaged mode:
receiving, via the one or more input devices, a first user input at a first time;
determining a gaze position at the first time;
in response to receiving the first user input and in accordance with a determination that a plurality of possible selectable positions are at the gaze position at the first time:
designating a selection point at a first position of the plurality of possible selectable positions; and
switching the electronic device from the gaze-engaged mode to a gaze-disengaged mode; and
while the electronic device is in the gaze-disengaged mode:
while maintaining designation of the selection point, receiving, via the one or more input devices, a second user input;
in response to receiving the second user input, moving the selection point to a second position of the plurality of possible selectable positions, wherein the second position is different than the first position, and wherein moving the selection point to the second position is not based on the gaze position;
while the selection point is at the second position, receiving, via the one or more input devices, a third user input; and
in response to receiving the third user input, confirming the selection point at the second position.
14. The method of claim 13 , further comprising:
in response to receiving the third user input, selecting an object corresponding to the second position.
15. The method of claim 13 , further comprising:
before receiving the first user input, selecting an object at a third position different than the second position; and
in response to receiving the third user input, placing the object at the second position.
16. The method of claim 13 , wherein the first user input is the same type of input as the second user input or the third user input.
17. The method of claim 13 , wherein the second position is different than a gaze position associated with the second user input.