User interfaces for gesture detection
A computer system detects a gesture, such as an air gesture, and performs an operation based on the gesture.
1 . A computer system configured to communicate with a display generation component and one or more input devices that include a physiological sensor, comprising:
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, via the display generation component, a respective user interface that includes a plurality of representations corresponding to a plurality of detected external devices;
while displaying the respective user interface, detecting, via the one or more input devices, a first air gesture to display a respective indication corresponding to a respective external device from among the plurality of detected external devices;
in response to detecting the first air gesture to display the respective indication corresponding to the respective external device, displaying, in the respective user interface and via the display generation component, the respective indication corresponding to the respective external device;
while displaying the respective indication corresponding to the respective external device in the respective user interface, detecting, via the one or more input devices, a respective air gesture; and
in response to detecting the respective air gesture:
in accordance with a determination that the respective indication corresponds to a first external device, sending a command corresponding to the respective air gesture to the first external device without sending the command corresponding to the respective air gesture to a second external device that is different from the first external device; and
in accordance with a determination that the respective indication corresponds to the second external device, sending the command corresponding to the respective air gesture to the second external device without sending the command corresponding to the respective air gesture to the first external device.
2 . The computer system of claim 1 , wherein:
in accordance with a determination that the respective air gesture is a second air gesture, the command is a first command; and
in accordance with a determination that the respective air gesture is a third air gesture that is different from the second air gesture, the command is a second command that is different from the first command.
3 . The computer system of claim 1 , wherein the one or more input devices include a physiological sensor, the one or more programs further including instructions for:
detecting, via the physiological sensor, a heart rate of a user of the computer system; and
displaying, via the display generation component, the heart rate.
4 . The computer system of claim 1 , wherein the computer system is a wearable device that is being worn by a user of the computer system.
5 . The computer system of claim 1 , wherein the first air gesture to display the respective indication corresponding to the respective external device is a double-pinch air gesture.
6 . The computer system of claim 1 , wherein the first air gesture to display the respective indication corresponding to the respective external device includes a swipe air gesture.
7 . The computer system of claim 1 , wherein:
the plurality of detected external devices are selected based on detected proximity of the plurality of detected external devices to the computer system; and
an order of indications of the plurality of detected external devices is based on states and/or proximity of the plurality of detected external devices.
8 . The computer system of claim 1 , wherein the respective air gesture is a swipe air gesture and the command corresponding to the swipe air gesture is a navigational command to navigate a user interface of the respective external device.
9 . The computer system of claim 1 , the one or more programs further including instructions for:
while displaying the respective indication corresponding to the respective external device, detecting, via the one or more input devices, a double-pinch air gesture; and
in response to detecting the double-pinch air gesture, ceasing to display an indication of an external device of the plurality of detected external devices.
10 . The computer system of claim 1 , the one or more programs further including instructions for:
in response to receiving the first air gesture to display the respective indication corresponding to the respective external device, sending an indication to the respective external device that the computer system is configured to control the respective external device.
11 . The computer system of claim 1 , wherein:
the respective air gesture includes a pinch-and-hold air gesture performed by a hand of a user of the computer system and the respective air gesture includes a first magnitude of rotation of the hand of the user of the computer system, wherein the command corresponding to the respective air gesture that is sent to the respective external device includes a second magnitude, based on the first magnitude, of change for a feature of the respective external device.
12 . The computer system of claim 11 , wherein the first magnitude is an amount of rotation of the hand of the user of the computer system.
13 . The computer system of claim 11 , wherein the first magnitude is a speed of rotation of the hand of the user of the computer system.
14 . The computer system of claim 11 , wherein a rate of change of the feature of the respective external device is limited to a threshold rate based on a value of the feature of the respective external device exceeding a threshold value.
15 . The computer system of claim 11 , the one or more programs further including instructions for:
in response to detecting rotation of the hand of the user of the computer system as part of the respective air gesture, providing tactile feedback.
16 . The computer system of claim 1 , wherein the respective air gesture is a pinch air gesture.
17 . The computer system of claim 1 , wherein the respective air gesture is a pinch-and-hold air gesture and the command corresponding to the pinch-and-hold air gesture is a navigational command to navigate back in a user interface of the respective external device.
18 . The computer system of claim 1 , wherein the respective air gesture is a tap of a finger of a user of the computer system against a palm of the user of the computer system.
19 . The computer system of claim 1 , the one or more programs further including instructions for:
while displaying the respective indication corresponding to the respective external device, detecting, via one or more microphones of the computer system, an utterance; and
in response to detecting the utterance:
in accordance with a determination that the respective indication corresponds to the first external device, sending information based on the utterance to the first external device without sending the information based on the utterance to the second external device; and
in accordance with a determination that the respective indication corresponds to the second external device, sending information based on the utterance to the second external device without sending the information based on the utterance to the first external device.
20 . The computer system of claim 1 , wherein a first indication corresponds to a first application of a first external device and a second indication, different from the first indication, corresponds to a second application, different from the first application, of the first external device.
21 . A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component and one or more input devices, the one or more programs including instructions for:
displaying, via the display generation component, a respective user interface that includes a plurality of representations corresponding to a plurality of detected external devices;
while displaying the respective user interface, detecting, via the one or more input devices, a first air gesture to display a respective indication corresponding to a respective external device from among the plurality of detected external devices;
in response to detecting the first air gesture to display the respective indication corresponding to the respective external device, displaying, in the respective user interface and via the display generation component, the respective indication corresponding to the respective external device;
while displaying the respective indication corresponding to the respective external device in the respective user interface, detecting, via the one or more input devices, a respective air gesture; and
in response to detecting the respective air gesture:
in accordance with a determination that the respective indication corresponds to a first external device, sending a command corresponding to the respective air gesture to the first external device without sending the command corresponding to the respective air gesture to a second external device that is different from the first external device; and
in accordance with a determination that the respective indication corresponds to the second external device, sending a command corresponding to the respective air gesture to the second external device without sending the command corresponding to the respective air gesture to the first external device.
22 . A method, comprising:
at a computer system that is in communication with a display generation component and one or more input devices:
displaying, via the display generation component, a respective user interface that includes a plurality of representations corresponding to a plurality of detected external devices;
while displaying the respective user interface, detecting, via the one or more input devices, a first air gesture to display a respective indication corresponding to a respective external device from among the plurality of detected external devices;
in response to detecting the first air gesture to display the respective indication corresponding to the respective external device, displaying, in the respective user interface and via the display generation component, the respective indication corresponding to the respective external device;
while displaying the respective indication corresponding to the respective external device in the respective user interface, detecting, via the one or more input devices, a respective air gesture; and
in response to detecting the respective air gesture:
in accordance with a determination that the respective indication corresponds to a first external device, sending a command corresponding to the respective air gesture to the first external device without sending the command corresponding to the respective air gesture to a second external device that is different from the first external device; and
in accordance with a determination that the respective indication corresponds to the second external device, sending a command corresponding to the respective air gesture to the second external device without sending the command corresponding to the respective air gesture to the first external device.
23 . The non-transitory computer-readable storage medium of claim 21 , wherein:
in accordance with a determination that the respective air gesture is a second air gesture, the command is a first command; and
in accordance with a determination that the respective air gesture is a third air gesture that is different from the second air gesture, the command is a second command that is different from the first command.
24 . The non-transitory computer-readable storage medium of claim 21 , wherein the one or more input devices include a physiological sensor, the one or more programs further including instructions for:
detecting, via the physiological sensor, a heart rate of a user of the computer system; and
displaying, via the display generation component, the heart rate.
25 . The non-transitory computer-readable storage medium of claim 21 , wherein the computer system is a wearable device that is being worn by a user of the computer system.
26 . The non-transitory computer-readable storage medium of claim 21 , wherein the first air gesture to display the respective indication corresponding to the respective external device is a double-pinch air gesture.
27 . The non-transitory computer-readable storage medium of claim 21 , wherein the first air gesture to display the respective indication corresponding to the respective external device includes a swipe air gesture.
28 . The non-transitory computer-readable storage medium of claim 21 , wherein:
the plurality of detected external devices are selected based on detected proximity of the plurality of detected external devices to the computer system; and
an order of indications of the plurality of detected external devices is based on states and/or proximity of the plurality of detected external devices.
29 . The non-transitory computer-readable storage medium of claim 21 , wherein the respective air gesture is a swipe air gesture and the command corresponding to the swipe air gesture is a navigational command to navigate a user interface of the respective external device.
30 . The non-transitory computer-readable storage medium of claim 21 , the one or more programs further including instructions for:
while displaying the respective indication corresponding to the respective external device, detecting, via the one or more input devices, a double-pinch air gesture; and
in response to detecting the double-pinch air gesture, ceasing to display an indication of an external device of the plurality of detected external devices.
31 . The non-transitory computer-readable storage medium of claim 21 , the one or more programs further including instructions for:
in response to receiving the first air gesture to display the respective indication corresponding to the respective external device, sending an indication to the respective external device that the computer system is configured to control the respective external device.
32 . The non-transitory computer-readable storage medium of claim 21 , wherein:
the respective air gesture includes a pinch-and-hold air gesture performed by a hand of a user of the computer system and the respective air gesture includes a first magnitude of rotation of the hand of the user of the computer system, wherein the command corresponding to the respective air gesture that is sent to the respective external device includes a second magnitude, based on the first magnitude, of change for a feature of the respective external device.
33 . The non-transitory computer-readable storage medium of claim 32 , wherein the first magnitude is an amount of rotation of the hand of the user of the computer system.
34 . The non-transitory computer-readable storage medium of claim 32 , wherein the first magnitude is a speed of rotation of the hand of the user of the computer system.
35 . The non-transitory computer-readable storage medium of claim 32 , wherein a rate of change of the feature of the respective external device is limited to a threshold rate based on a value of the feature of the respective external device exceeding a threshold value.
36 . The non-transitory computer-readable storage medium of claim 32 , the one or more programs further including instructions for:
in response to detecting rotation of the hand of the user of the computer system as part of the respective air gesture, providing tactile feedback.
37 . The non-transitory computer-readable storage medium of claim 21 , wherein the respective air gesture is a pinch air gesture.
38 . The non-transitory computer-readable storage medium of claim 21 , wherein the respective air gesture is a pinch-and-hold air gesture and the command corresponding to the pinch-and-hold air gesture is a navigational command to navigate back in a user interface of the respective external device.
39 . The non-transitory computer-readable storage medium of claim 21 , wherein the respective air gesture is a tap of a finger of a user of the computer system against a palm of the user of the computer system.
40 . The non-transitory computer-readable storage medium of claim 21 , the one or more programs further including instructions for:
while displaying the respective indication corresponding to the respective external device, detecting, via one or more microphones of the computer system, an utterance; and
in response to detecting the utterance:
in accordance with a determination that the respective indication corresponds to the first external device, sending information based on the utterance to the first external device without sending the information based on the utterance to the second external device; and
in accordance with a determination that the respective indication corresponds to the second external device, sending information based on the utterance to the second external device without sending the information based on the utterance to the first external device.
41 . The non-transitory computer-readable storage medium of claim 21 , wherein a first indication corresponds to a first application of a first external device and a second indication, different from the first indication, corresponds to a second application, different from the first application, of the first external device.
42 . The method of claim 22 , wherein:
in accordance with a determination that the respective air gesture is a second air gesture, the command is a first command; and
in accordance with a determination that the respective air gesture is a third air gesture that is different from the second air gesture, the command is a second command that is different from the first command.
43 . The method of claim 22 , wherein the one or more input devices include a physiological sensor, the method further comprising:
detecting, via the physiological sensor, a heart rate of a user of the computer system; and
displaying, via the display generation component, the heart rate.
44 . The method of claim 22 , wherein the computer system is a wearable device that is being worn by a user of the computer system.
45 . The method of claim 22 , wherein the first air gesture to display the respective indication corresponding to the respective external device is a double-pinch air gesture.
46 . The method of claim 22 , wherein the first air gesture to display the respective indication corresponding to the respective external device includes a swipe air gesture.
47 . The method of claim 22 , wherein:
the plurality of detected external devices are selected based on detected proximity of the plurality of detected external devices to the computer system; and
an order of indications of the plurality of detected external devices is based on states and/or proximity of the plurality of detected external devices.
48 . The method of claim 22 , wherein the respective air gesture is a swipe air gesture and the command corresponding to the swipe air gesture is a navigational command to navigate a user interface of the respective external device.
49 . The method of claim 22 , further comprising:
while displaying the respective indication corresponding to the respective external device, detecting, via the one or more input devices, a double-pinch air gesture; and
in response to detecting the double-pinch air gesture, ceasing to display an indication of an external device of the plurality of detected external devices.
50 . The method of claim 22 , further comprising:
in response to receiving the first air gesture to display the respective indication corresponding to the respective external device, sending an indication to the respective external device that the computer system is configured to control the respective external device.
51 . The method of claim 22 , wherein:
the respective air gesture includes a pinch-and-hold air gesture performed by a hand of a user of the computer system and the respective air gesture includes a first magnitude of rotation of the hand of the user of the computer system, wherein the command corresponding to the respective air gesture that is sent to the respective external device includes a second magnitude, based on the first magnitude, of change for a feature of the respective external device.
52 . The method of claim 51 , wherein the first magnitude is an amount of rotation of the hand of the user of the computer system.
53 . The method of claim 51 , wherein the first magnitude is a speed of rotation of the hand of the user of the computer system.
54 . The method of claim 51 , wherein a rate of change of the feature of the respective external device is limited to a threshold rate based on a value of the feature of the respective external device exceeding a threshold value.
55 . The method of claim 51 , further comprising:
in response to detecting rotation of the hand of the user of the computer system as part of the respective air gesture, providing tactile feedback.
56 . The method of claim 22 , wherein the respective air gesture is a pinch air gesture.
57 . The method of claim 22 , wherein the respective air gesture is a pinch-and-hold air gesture and the command corresponding to the pinch-and-hold air gesture is a navigational command to navigate back in a user interface of the respective external device.
58 . The method of claim 22 , wherein the respective air gesture is a tap of a finger of a user of the computer system against a palm of the user of the computer system.
59 . The method of claim 22 , further comprising:
while displaying the respective indication corresponding to the respective external device, detecting, via one or more microphones of the computer system, an utterance; and
in response to detecting the utterance:
in accordance with a determination that the respective indication corresponds to the first external device, sending information based on the utterance to the first external device without sending the information based on the utterance to the second external device; and
in accordance with a determination that the respective indication corresponds to the second external device, sending information based on the utterance to the second external device without sending the information based on the utterance to the first external device.
60 . The method of claim 22 , wherein a first indication corresponds to a first application of a first external device and a second indication, different from the first indication, corresponds to a second application, different from the first application, of the first external device.