Systems and methods of mapping a gesture to respective actions of respective applications
Wearable devices for sensing neuromuscular signals using a small number of sensor pairs are disclosed. One example wrist-wearable device a band. The band includes a plurality of sensors arranged in the band configured to be worn on a wrist of a user, the plurality of sensors configured to sense electrical signals travelling through the wrist of the user and to output signals comprising information indicating a movement of the wrist, a hand, and/or fingers of the user. The band further includes one or more processors configured to determine a gesture of the user based at least in part on the information indicating the movement of the wrist, the hand, and/or the fingers of the user. The one or more processors are further configured to output a flag that identifies the determined gesture.
1 . A band of a wrist-wearable device, the band comprising:
a plurality of sensors arranged in the band configured to be worn on a wrist of a user, the plurality of sensors configured to sense first electrical signals travelling through the wrist of the user and to output signals comprising information indicating a first movement of at least one of the wrist, a hand, and fingers of the user; and
one or more processors configured to:
determine a first gesture of the user based at least in part on the information indicating the first movement of at least one of the wrist, the hand, and the fingers of the user;
generate a first flag of a plurality of flags that identifies the first gesture of the user, wherein:
each respective flag of the plurality of flags is mapped to a plurality of actions associated with the respective flag, including:
a first action associated with a first end user application at an electronic device that is communicatively coupled to the wrist-wearable device; and
a second action associated with a second end user application at the electronic device that is communicatively coupled to the wrist-wearable device, wherein the second end user application is distinct from the first end user application; and
output the first flag that identifies the first gesture of the user;
wherein the plurality of sensors is further configured to sense second electrical signals travelling through the wrist of the user and to output signals comprising information indicating a second movement, distinct from the first movement, of at least one of the wrist, the hand, and the fingers of the user; and
the one or more processors are further configured to:
determine a second gesture, distinct from the first gesture, of the user based at least in part on the information indicating the second movement of at least one of the wrist, the hand, and the fingers of the user;
map the first flag to the second gesture of the user, wherein the first flag is mapped to the first gesture and the second gesture; and
output the first flag that identifies the second gesture of the user.
2 . The band of claim 1 , wherein the one or more processors are configured to determine that the first gesture and the second gesture of the user correspond to a scroll command.
3 . The band of claim 1 , wherein the one or more processors are configured to determine that the first gesture and the second gesture of the user correspond to a command to select and highlight a menu item on a display of an external device.
4 . The band of claim 1 , wherein at least one of the one or more processors is configured to transmit the first flag to an external device.
5 . The band of claim 4 , wherein the first flag is transmitted in a format independent of the external device.
6 . The band of claim 4 , wherein the at least one of the one or more processors is further configured to transmit an identifier of the external device to the external device with the first flag.
7 . The band of claim 1 , wherein the one or more processors are further configured to:
output a second flag, different from the first flag, that identifies a third gesture different from the first gesture and the second gesture.
8 . The band of claim 7 , wherein the first gesture corresponds to a scroll command and the third gesture corresponds to a command to select and highlight a menu item on a display of an external device.
9 . The band of claim 1 , wherein the plurality of sensors includes at least two pairs of sensors arranged along a circumference of the band in which each pair of sensors is configured to be positioned over a respective distinct portion of the wrist of the user while the band is worn by the user.
10 . The band of claim 1 , wherein the first action is distinct from the second action.
11 . The band of claim 1 , wherein the first gesture is determined to be an extension of two non-adjacent fingers.
12 . A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of a band of a wrist-wearable device, cause the one or more processors to:
sense, with a plurality of sensors arranged in the band, first electrical signals travelling through a wrist of a user when wearing the band;
output, from the plurality of sensors, signals comprising information indicating a first movement of at least one of the wrist, a hand, and fingers of the user;
determine a first gesture of the user based at least in part on the information indicating the first movement of at least one of the wrist, the hand, and the fingers of the user;
generate a first flag of a plurality of flags that identifies the first gesture of the user, wherein:
each respective flag of the plurality of flags is mapped to a plurality of actions associated with the respective flag, including:
a first action associated with a first end user application at an electronic device that is communicatively coupled to the wrist-wearable device; and
a second action associated with a second end user application at the electronic device that is communicatively coupled to the wrist-wearable device, wherein the second end user application is distinct from the first end user application; and
output the first flag that identifies the first gesture;
sense, with the plurality of sensors arranged in the band, second electrical signals travelling through the wrist of the user when wearing the band;
output, from the plurality of sensors, signals comprising information indicating a second movement, distinct from the first movement, of at least one of the wrist, the hand, and the fingers of the user;
determine a second gesture, distinct from the first gesture, of the user based at least in part on the information indicating the second movement of at least one of the wrist, the hand, and the fingers of the user;
map the first flag to the second gesture of the user, wherein the first flag is mapped to the first gesture and the second gesture; and
output the first flag that identifies the second gesture of the user.
13 . The non-transitory computer-readable medium of claim 12 , wherein the one or more processors are further configured to determine that the first gesture and the second gesture of the user correspond to a scroll command.
14 . The non-transitory computer-readable medium of claim 12 , wherein the one or more processors are further configured to determine that the first gesture and the second gesture of the user correspond to a command to select and highlight a menu item on a display of an external device.
15 . The non-transitory computer-readable medium of claim 12 , wherein the one or more processors are further configured to transmit the first flag to an external device.
16 . The non-transitory computer-readable medium of claim 12 , wherein the one or more processors are further configured to:
output a second flag, different from the first flag, that identifies a third gesture different from the first gesture and the second gesture.
17 . A method of operating a band of a wrist-wearable device, the method comprising:
sensing, with a plurality of sensors arranged in the band, first electrical signals travelling through a wrist of a user when wearing the band;
outputting, from the plurality of sensors, signals comprising information indicating a first movement of at least one of the wrist, a hand, and fingers of the user;
determining a first gesture of the user based at least in part on the information indicating the first movement of at least one of the wrist, the hand, and the fingers of the user;
generating a first flag of a plurality of flags that identifies the first gesture of the user, wherein:
each respective flag of the plurality of flags is mapped to a plurality of actions associated with the respective flag, including:
a first action associated with a first end user application at an electronic device that is communicatively coupled to the wrist-wearable device; and
a second action associated with a second end user application at the electronic device that is communicatively coupled to the wrist-wearable device, wherein the second end user application is distinct from the first end user application; and
outputting the first flag that identifies the first gesture;
sensing, with the plurality of sensors arranged in the band, second electrical signals travelling through the wrist of the user when wearing the band;
outputting, from the plurality of sensors, signals comprising information indicating a second movement, distinct from the first movement, of at least one of the wrist, the hand, and the fingers of the user;
determining a second gesture, distinct from the first gesture, of the user based at least in part on the information indicating the second movement of at least one of the wrist, the hand, and the fingers of the user;
mapping the first flag of the plurality of flags to the second gesture of the user, wherein the first flag is mapped to the first gesture and the second gesture; and
outputting the first flag that identifies the second gesture of the user.
18 . The method of claim 17 , further comprising determining that the first gesture and the second gesture of the user correspond to:
a scroll command; or
a command to select and highlight a menu item on a display of an external device.
19 . The method of claim 17 , further comprising transmitting the first flag to an external device.
20 . The method of claim 17 , further comprising:
outputting a second flag, different from the first flag, that identifies a third gesture different from the first gesture and the second gesture.