Multi-modal inputs for wearable devices, and systems and methods of use thereof
A method of performing input gestures to control user interface elements is described. The method includes, at a first point in time while multi-modal gestures are available via at least two input devices associated with the artificial-reality headset, detecting a first input via an input device of the at least two input devices and performing an action at the artificial-reality headset. In response to detecting a second input via another input device of the at least two input devices, performing another action within a user interface presented via the artificial-reality headset. The method further includes, at a second point in time, after the first point in time, and while multi-modal gestures are no longer available via the at least two input devices associated with the artificial-reality headset, detecting the first input via the input device of the at least two input devices.
1 . A non-transitory computer-readable storage medium comprising instructions which, when executed by one or more processors, causes the one or more processors to:
while an artificial-reality headset is worn by a user:
at a first point in time and while multi-modal gestures are available via at least two input devices associated with the artificial-reality headset:
in response to detecting a first input via a first input device of the at least two input devices, perform a first action at the artificial-reality headset, wherein the first input is one input of a first input tier set including (i) a first input tier including one or more inputs associated with navigation control commands, and the first input tier is associated with inputs performed with a single digit of a hand of the user, or (ii) a second input tier including one or more other inputs associated with system control commands for the artificial-reality headset, and the second input tier is associated with inputs performed with at least two digits of the hand of the user;
in response to detecting a second input via a second input device of the at least two input devices, perform a second action within a user interface presented via the artificial-reality headset; and
at a second point in time, after the first point in time, and while multi-modal gestures are no longer available via the at least two input devices associated with the artificial-reality headset:
in response to detecting the first input via the first input device of the at least two input devices, perform the second action within the user interface presented via the artificial-reality headset.
2 . The non-transitory computer-readable storage medium of claim 1 , wherein the first input tier set includes a third input tier, the third input tier of the first input tier set including one or more inputs associated with media control commands.
3 . The non-transitory computer-readable storage medium of claim 2 , wherein the third input tier of the first input tier set is associated with swipe gestures performed with at least two digits of a hand of the user.
4 . The non-transitory computer-readable storage medium of claim 1 , wherein the second action includes navigation control commands and/or a system control command for the artificial-reality headset.
5 . The non-transitory computer-readable storage medium of claim 1 , wherein:
the second input is one input of a second input tier set including a first input tier and a second input tier,
the first input tier of the second input tier set is associated with hand gestures performed using a first digit and a second digit of a hand of the user, and
the second input tier of the second input tier set is associated with hand gestures performed using the first digit and a third digit of the user.
6 . The non-transitory computer-readable storage medium of claim 5 , wherein:
the second input tier set includes a third input tier associated with hand gestures performed using the first digit and a fourth digit of the user.
7 . The non-transitory computer-readable storage medium of claim 1 , wherein the multi-modal gestures are no longer available via the at least two input devices at the second point in time in accordance with a determination that the second input device is no longer communicatively coupled to or detectable by the artificial-reality headset.
8 . The non-transitory computer-readable storage medium of claim 1 , wherein the at least two input devices include (i) a touch-input surface of the artificial-reality headset including one or more capacitive touch sensors and/or one or more proximity sensors, and (ii) a biopotential-signal-sensing device including one or more biopotential-signal-sensing sensors.
9 . A method, comprising:
while an artificial-reality headset is worn by a user:
at a first point in time and while multi-modal gestures are available via at least two input devices associated with the artificial-reality headset:
in response to detecting a first input via a first input device of the at least two input devices, performing a first action at the artificial-reality headset, wherein the first input is one input of a first input tier set including (i) a first input tier including one or more inputs associated with navigation control commands, and the first input tier is associated with inputs performed with a single digit of a hand of the user, or (ii) a second input tier including one or more other inputs associated with system control commands for the artificial-reality headset, and the second input tier is associated with inputs performed with at least two digits of the hand of the user;
in response to detecting a second input via a second input device of the at least two input devices, performing a second action within a user interface presented via the artificial-reality headset; and
at a second point in time, after the first point in time, and while multi-modal gestures are no longer available via the at least two input devices associated with the artificial-reality headset:
in response to detecting the first input via the first input device of the at least two input devices, performing the second action within the user interface presented via the artificial-reality headset.
10 . The method of claim 9 , wherein the first input tier set includes a third input tier, the third input tier of the first input tier set including one or more inputs associated with media control commands.
11 . The method of claim 10 , wherein the third input tier of the first input tier set is associated with swipe gestures performed with at least two digits of a hand of the user.
12 . The method of claim 9 , wherein the multi-modal gestures are no longer available via the at least two input devices at the second point in time in accordance with a determination that the second input device is no longer communicatively coupled to or detectable by the artificial-reality headset.
13 . The method of claim 9 , wherein the at least two input devices include (i) a touch-input surface of the artificial-reality headset including one or more capacitive touch sensors and/or one or more proximity sensors, and (ii) a biopotential-signal-sensing device including one or more biopotential-signal-sensing sensors.
14 . The method of claim 9 , wherein:
the second input is one input of a second input tier set including a first input tier and a second input tier,
the first input tier of the second input tier set is associated with hand gestures performed using a first digit and a second digit of a hand of the user, and
the second input tier of the second input tier set is associated with hand gestures performed using the first digit and a third digit of the user.
15 . An artificial-reality headset, comprising:
one or more processors; and
memory, comprising instructions which, when executed by the one or more processors, cause the one or more processors to:
while the artificial-reality headset is worn by a user:
at a first point in time and while multi-modal gestures are available via at least two input devices associated with the artificial-reality headset:
in response to detecting a first input via a first input device of the at least two input devices, perform a first action at the artificial-reality headset, wherein the first input is one input of a first input tier set including (i) a first input tier including one or more inputs associated with navigation control commands, and the first input tier is associated with inputs performed with a single digit of a hand of the user, or (ii) a second input tier including one or more other inputs associated with system control commands for the artificial-reality headset, and the second input tier is associated with inputs performed with at least two digits of the hand of the user;
in response to detecting a second input via a second input device of the at least two input devices, perform a second action within a user interface presented via the artificial-reality headset; and
at a second point in time, after the first point in time, and while multi- modal gestures are no longer available via the at least two input devices associated with the artificial-reality headset:
in response to detecting the first input via the first input device of the at least two input devices, perform the second action within the user interface presented via the artificial-reality headset.
16 . The artificial-reality headset of claim 15 , wherein the first input tier set includes a third input tier, the third input tier of the first input tier set including one or more inputs associated with media control commands.
17 . The method of claim 14 , wherein:
the second input tier set includes a third input tier associated with hand gestures performed using the first digit and a fourth digit of the user.
18 . The artificial-reality headset of claim 15 , wherein the multi-modal gestures are no longer available via the at least two input devices at the second point in time in accordance with a determination that the second input device is no longer communicatively coupled to or detectable by the artificial-reality headset.
19 . The artificial-reality headset of claim 15 , wherein the at least two input devices include (i) a touch-input surface of the artificial-reality headset including one or more capacitive touch sensors and/or one or more proximity sensors, and (ii) a biopotential-signal-sensing device including one or more biopotential-signal-sensing sensors.
20 . The artificial-reality headset of claim 15 , wherein:
the second input is one input of a second input tier set including a first input tier and a second input tier,
the first input tier of the second input tier set is associated with hand gestures performed using a first digit and a second digit of a hand of the user, and
the second input tier of the second input tier set is associated with hand gestures performed using the first digit and a third digit of the user.