IP Library Granted Patent US 11,868,531
Granted Patent B1
US 11,868,531 · App. 17/576,815 · Granted Jan 9, 2024

Wearable device providing for thumb-to-finger-based input gestures detected based on neuromuscular signals, and systems and methods of use thereof

Inventor: Tugce Tasci (New York, NY)
Assignee: META PLATFORMS TECHNOLOGIES, LLC
G06F3/015G06F1/163G06F3/014G06F3/017G06F3/023G06N20/00G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,868,531
App. No.
17/576,815
Granted
Jan 9, 2024
Kind
B1
Abstract

Methods of causing performance of commands at a computing device based on neuromuscular signals from thumb-initiated gestures are provided. A method includes receiving, by a wearable device, a sequence of neuromuscular signals indicating that a user is instructing a thumb on the user's hand to contact a portion of the user's hand. The portion of the user's hand is associated with at least one input command available at a computing device. The method further includes responsive to receiving the sequence of neuromuscular signals, providing, by the wearable device, data to cause the computing device to perform the at least one input command. The method also includes in response to receiving a second sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the portion of the user's hand twice, providing data to cause the computing device to perform a second input command.

Claims (50)

1. A method of causing performance of commands at a computing device based on neuromuscular signals from thumb-initiated gestures, the method comprising:

receiving a sequence of neuromuscular signals indicating that a user is instructing a thumb on the user's hand to contact a portion of the user's hand, wherein the portion of the user's hand is associated with at least one input command available at a computing device;

in response to receiving the sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the portion of the user's hand, providing data to the computing device to cause the computing device to perform the at least one input command;

receiving a second sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the portion of the user's hand twice, wherein the portion of the user's hand is also associated with a second input command available at the computing device, and the second input command is distinct from the at least one input command; and

in response to receiving the second sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the portion of the user's hand twice, providing data to the computing device to cause the computing device to perform the second input command.

2. The method of claim 1 , further comprising:

receiving a third sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the portion of the user's hand thrice, wherein the portion of the user's hand is also associated with a third input command available at the computing device, and the third input command is distinct from the at least one input command and the second input command; and

in response to receiving the third sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the portion of the user's hand thrice, providing data to the computing device to cause the computing device to perform the third input command.

3. The method of claim 1 , further comprising:

receiving another sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact a different portion of the user's hand, wherein the different portion of the user's hand is distinct from the portion of the user's hand, and the different portion of the user's hand is associated with an additional input command available at the computing device; and

in response to receiving the other sequence of the neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the different portion of the user's hand, providing data to the computing device to cause the computing device to perform the additional input command.

4. The method of claim 3 , further comprising:

receiving an additional sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the different portion of the user's hand twice, wherein a different portion of the user's hand is also associated with a first additional input command available at the computing device, the first additional input command being distinct from the additional input command; and

in response to receiving the additional sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the different portion of the user's hand twice, providing data to the computing device to cause the computing device to perform the first additional input command.

5. The method of claim 4 , further comprising:

receiving one more sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the different portion of the user's hand thrice, wherein the different portion of the user's hand is also associated with a second additional input command available at the computing device, the second additional input command being distinct from the additional input command and the first additional input command; and

in response to receiving the one more sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the different portion of the user's hand thrice, providing data to the computing device to cause the computing device to perform the second additional input command.

6. The method of claim 3 , wherein:

the portion of the user's hand is a palm-side portion of a first finger of the user's hand, and

the different portion of the user's hand is a palm-side portion of a second finger of the user's hand.

7. The method of claim 6 , wherein:

the portion of the user's hand is a palm-side portion of the first finger that is located above one of a distal phalange of the first finger, an intermediate phalange of the first finger, or a proximal phalange of the first finger, and

the different portion of the user's hand is a palm-side portion of the second finger that is located above one of the distal phalange of the second finger, the intermediate phalange of the second finger, or the proximal phalange of the second finger.

8. The method of claim 7 , wherein each finger of the user's hand is associated with a different command available at the computing device.

9. The method of claim 1 , wherein the at least one input command and the second input command each correspond to typing commands.

10. The method of claim 9 , wherein performing the at least one input command at the computing device comprises causing selection of an alphanumeric symbol and updating a user interface presented by the computing device to reflect selection of the alphanumeric symbol.

11. The method of claim 9 , wherein performing the at least one input command at the computing device comprises performing an action associated with a modifier key.

12. The method of claim 1 , wherein the sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the portion of the user's hand are received without requiring the thumb to make contact with the portion of the user's hand.

13. The method of claim 1 , wherein the sequence of neuromuscular signals is processed using a trained statistical model that was determined using stored sequences of neuromuscular signals to determine that the user is instructing the thumb on the user's hand to contact the portion of the user's hand.

14. The method of claim 1 , wherein the sequence of neuromuscular signals is received without requiring the user to wear sensors on any part of the user's hand.

15. The method of claim 1 , wherein performance of the at least one command at the computing device includes causing a visual change within an artificial-reality interface controlled at least in part by the computing device.

16. The method of claim 15 , wherein causing the change within the artificial-reality interface includes causing the visual change within a messaging application available with the artificial-reality interface.

17. The method of claim 1 , wherein the portion of the user's hand that is associated with the at least one input command and the portion of the user's hand that is associated with the second input command are a same portion of a finger of the user's hand.

18. The method of claim 17 , wherein the same portion of the finger of the user's hand is at least one of a distal phalange portion of the finger, a medial phalange portion of the finger, and a proximal phalange portion of the finger.

19. A wearable device for causing performance of commands at a computing device based on neuromuscular signals from thumb-initiated gestures, the wearable device comprising:

a plurality of electrodes for detecting a sequence of neuromuscular signals indicating that a user is instructing a thumb on the user's hand to contact a portion of the user's hand, wherein the portion of the user's hand is associated with at least one input command available at a computing device; and

a processor communicatively coupled with the plurality of electrodes, the processor configured to:

receive the sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact a portion of the user's hand; and

in response to receiving the sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the portion of the user's hand, provide data to the computing device to cause the computing device to perform the at least one input command;

receive a second sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the portion of the user's hand twice, wherein the portion of the user's hand is also associated with a second input command available at the computing device, and the second input command is distinct from the at least one input command; and

in response to receiving the second sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the portion of the user's hand twice, provide data to the computing device to cause the computing device to perform the second input command.

20. A system for performing commands at a computing device based on neuromuscular signals from thumb-initiated gestures detected by a wearable device, the system comprising:

a wearable device, the wearable device including:

a plurality of electrodes for detecting a sequence of neuromuscular signals indicating that a user is instructing a thumb on the user's hand to contact a portion of the user's hand, wherein the portion of the user's hand is associated with at least one input command available at a computing device; and

a processor communicatively coupled with the plurality of electrodes, the processor configured to:

receive the sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact a portion of the user's hand; and

in response to receiving the sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the portion of the user's hand, 6 Response to Final Office Action provide data to the computing device to cause the computing device to perform the at least one input command;

receive a second sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the portion of the user's hand twice, wherein the portion of the user's hand is also associated with a second input command available at the computing device, and the second input command is distinct from the at least one input command; and

in response to receiving the second sequence of neuromuscular signals indicating that the user is instructing the thumb on the user's hand to contact the portion of the user's hand twice, provide data to the computing device to cause the computing device to perform the second input command; and

the computing device configured to receive the data and perform the at least one input command and the second input command, respectively, within a user interface generated at least in part by the computing device.

Assignments (3)
CHANGE OF NAME Recorded Jun 24, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060440/0884 →
CHANGE OF NAME Recorded Jun 7, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060306/0247 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2022
From: TASCI, TUGCE
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 058882/0057 →
Continuity (1)
Provisional Application 63172588 · Apr 8, 2021
Cited By (13)
US 12,340,142 US 12,386,428 US 12,411,555 US 12,449,907 US 12,504,944 US 12,511,021 US 12,543,973 US 12,554,382 US 12,579,758 US 12,619,303 US 12,629,095 US 12,650,801 US 12,663,881