Gaze-based user interactions
In an exemplary process for interacting with user interface objects using an eye gaze, an affordance associated with a first object is displayed. A gaze direction or a gaze depth is determined. While the gaze direction or the gaze depth is determined to correspond to a gaze at the affordance, a first input representing user instruction to take action on the affordance is received, and the affordance is selected responsive to receiving the first input.
1. An electronic device, comprising:
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
receiving a first user input at a first time;
in response to receiving the first user input, designating a first object of a plurality of selectable objects, wherein a gaze position at the first time corresponds to a gaze at the plurality of selectable objects;
while maintaining designation of the first object, receiving a second user input;
in response to receiving the second user input:
ceasing designation of the first object; and
designating a second object of the plurality of selectable objects, wherein designating the second object is not based on the gaze position;
while maintaining designation of the second object, receiving a third user input;
in response to receiving the third user input, selecting the second object;
after selecting the second object, receiving a fourth user input at a second time; and
in response to receiving the fourth user input, in accordance with a determination that the fourth user input is a first type of input, placing the second object at a gaze position at the second time.
2. The electronic device of claim 1 , the one or more programs further including instructions for:
in response to receiving the first user input, in accordance with a determination that the gaze position at the first time corresponds to a gaze at only a single selectable object, selecting the single selectable object.
3. The electronic device of claim 1 , the one or more programs further including instructions for:
in response to receiving the fourth user input, in accordance with a determination that the fourth user input is a second type of input different than the first type of input, designating a placement point corresponding to the gaze position at the second time.
4. The electronic device of claim 3 , the one or more programs further including instructions for:
while maintaining designation of the placement point, receiving a fifth user input; and
in response to receiving the fifth user input, placing the second object at a current position of the placement point.
5. The electronic device of claim 1 , wherein the first user input is received while the electronic device is in a first mode, and wherein the first object is designated in accordance with the electronic device being in the first mode, the one or more programs further including instructions for:
in response to receiving the first user input, switching the electronic device from the first mode to a second mode, wherein the second user input is received while the electronic device is in the second mode, and wherein the second object is designated in accordance with the electronic device being in the second mode.
6. The electronic device of claim 1 , wherein the first user input is the same type of input as the second user input or the third user input.
7. The electronic device of claim 1 , wherein the second user input is at a second time, wherein a position of the second object at the second time is different than a gaze position at the second time.
8. The electronic device of claim 1 , wherein the first object is designated in accordance with a determination that the first user input is a first type of input, the one or more programs further including instructions for:
in response to receiving the first user input, in accordance with a determination that the first user input is a second type of input different than the first type of input, selecting the plurality of selectable objects.
9. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device, the one or more programs including instructions for:
receiving a first user input at a first time;
in response to receiving the first user input, designating a first object of a plurality of selectable objects without designating other objects of the plurality of selectable objects, wherein a gaze position at the first time corresponds to a gaze at the plurality of selectable objects;
while maintaining designation of the first object receiving a second user input;
in response to receiving the second user input:
ceasing designation of the first object; and
designating a second object of the plurality of selectable objects, wherein designating the second object is not based on the gaze position;
while maintaining designation of the second object, receiving a third user input;
in response to receiving the third user input, selecting the second object;
after selecting the second object, receiving a fourth user input at a second time; and
in response to receiving the fourth user input, in accordance with a determination that the fourth user input is a first type of input, placing the second object at a gaze position at the second time.
10. The non-transitory computer-readable storage medium of claim 9 , the one or more programs further including instructions for:
in response to receiving the first user input, in accordance with a determination that the gaze position at the first time corresponds to a gaze at only a single selectable object, selecting the single selectable object.
11. The non-transitory computer-readable storage medium of claim 9 , the one or more programs further including instructions for:
in response to receiving the fourth user input, in accordance with a determination that the fourth user input is a second type of input different than the first type of input, designating a placement point corresponding to the gaze position at the second time.
12. The non-transitory computer-readable storage medium of claim 11 , the one or more programs further including instructions for:
while maintaining designation of the placement point, receiving a fifth user input; and
in response to receiving the fifth user input, placing the second object at a current position of the placement point.
13. The non-transitory computer-readable storage medium of claim 9 , wherein the first user input is received while the electronic device is in a first mode, and wherein the first object is designated in accordance with the electronic device being in the first mode, the one or more programs further including instructions for:
in response to receiving the first user input, switching the electronic device from the first mode to a second mode, wherein the second user input is received while the electronic device is in the second mode, and wherein the second object is designated in accordance with the electronic device being in the second mode.
14. The non-transitory computer-readable storage medium of claim 9 , wherein the first user input is the same type of input as the second user input or the third user input.
15. The non-transitory computer-readable storage medium of claim 9 , wherein the second user input is at a second time, wherein a position of the second object at the second time is different than a gaze position at the second time.
16. The non-transitory computer-readable storage medium of claim 9 , wherein the first object is designated in accordance with a determination that the first user input is a first type of input, the one or more programs further including instructions for:
in response to receiving the first user input, in accordance with a determination that the first user input is a second type of input different than the first type of input, selecting the plurality of selectable objects.
17. A method comprising:
at an electronic device that is in communication with one or more input devices:
receiving, via the one or more input devices, a first user input at a first time;
in response to receiving the first user input, designating a first object of a plurality of selectable objects without designating other objects of the plurality of selectable objects, wherein a gaze position at the first time corresponds to a gaze at the plurality of selectable objects;
while maintaining designation of the first object, receiving, via the one or more input devices, a second user input;
in response to receiving the second user input:
ceasing designation of the first object; and
designating a second object of the plurality of selectable objects, wherein designating the second object is not based on the gaze position;
while maintaining designation of the second object, receiving, via the one or more input devices, a third user input;
in response to receiving the third user input, selecting the second object;
after selecting the second object, receiving, via the one or more input devices, a fourth user input at a second time; and
in response to receiving the fourth user input, in accordance with a determination that the fourth user input is a first type of input, placing the second object at a gaze position at the second time.
18. The method of claim 17 , the method further comprising:
in response to receiving the first user input, in accordance with a determination that the gaze position at the first time corresponds to a gaze at only a single selectable object, selecting the single selectable object.
19. The method of claim 17 , further comprising:
in response to receiving the fourth user input, in accordance with a determination that the fourth user input is a second type of input different than the first type of input, designating a placement point corresponding to the gaze position at the second time.
20. The method of claim 19 , further comprising:
while maintaining designation of the placement point, receiving, via the one or more input devices, a fifth user input; and
in response to receiving the fifth user input, placing the second object at a current position of the placement point.
21. The electronic device of claim 1 , wherein the first object of the plurality of selectable objects is designated without designating other objects of the plurality of selectable objects.
22. The non-transitory computer-readable storage medium of claim 9 , wherein the first object of the plurality of selectable objects is designated without designating other objects of the plurality of selectable objects.
23. The method of claim 17 , wherein the first object of the plurality of selectable objects is designated without designating other objects of the plurality of selectable objects.