IP Library Granted Patent US 9,037,530
Granted Patent B2
US 9,037,530 · App. 13/433,845 · Granted May 19, 2015

Wearable electromyography-based human-computer interface

Inventors: Desney Tan (Kirkland, WA); T. Scott Saponas (Seattle, WA); Dan Morris (Bellevue, WA); Jim Turner (Monroe, WA)
Assignee: Microsoft Technology Licensing, LLC
G06F3/017A61B5/0488A61B5/6824A61B5/6828G06F3/015G06N5/00G06N99/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,037,530
App. No.
13/433,845
Granted
May 19, 2015
Kind
B2
Abstract

A “Wearable Electromyography-Based Controller” includes a plurality of Electromyography (EMG) sensors and provides a wired or wireless human-computer interface (HCI) for interacting with computing systems and attached devices via electrical signals generated by specific movement of the user's muscles. Following initial automated self-calibration and positional localization processes, measurement and interpretation of muscle generated electrical signals is accomplished by sampling signals from the EMG sensors of the Wearable Electromyography-Based Controller. In operation, the Wearable Electromyography-Based Controller is donned by the user and placed into a coarsely approximate position on the surface of the user's skin. Automated cues or instructions are then provided to the user for fine-tuning placement of the Wearable Electromyography-Based Controller. Examples of Wearable Electromyography-Based Controllers include articles of manufacture, such as an armband, wristwatch, or article of clothing having a plurality of integrated EMG-based sensor nodes and associated electronics.

Claims (34)

1. A human-computer interface, comprising:

an arbitrarily positionable wearable device having a plurality of sensor nodes, wherein each sensor node further includes one or more Electromyography (EMG) sensors;

a module for automatically evaluating one or more signals generated by one or more of the sensor nodes and received by one or more of the other sensor nodes to determine relative positions of each sensor node;

a module for automatically measuring muscle generated electrical signals using one or more of the EMG sensors;

a module for automatically determining which muscle generated electrical signals correspond to one or more specific user gestures; and

a module for causing one or more computing devices to automatically execute one or more specific commands corresponding to one or more of the specific user gestures.

2. The human-computer interface of claim 1 further comprising a calibration phase that automatically identifies one or more specific user muscles that generate the electrical signals measured by one or more specific EMG sensors, and wherein the user performs one or more specific gestures as part of a training phase for the calibration.

3. The human-computer interface of claim 1 wherein a subset of the EMG sensors is identified by an automated multiplexing process which determines which EMG sensors are sufficient to measure the muscle generated electrical signals that are associated with one or more of the specific user gestures.

4. The human-computer interface of claim 3 further comprising a module for automatically disabling all EMG sensors not included in the subset of EMG sensors.

5. The human-computer interface of claim 1 further comprising a module for automatically determining an approximate position of the wearable device on the surface of the skin of the user's body.

6. The human-computer interface of claim 1 wherein the relative positions of the sensor nodes to each other are used to automatically disable one or more EMG sensors that are identified as providing information that is not needed to determine which muscle generated electrical signals correspond to one or more specific user gestures.

7. The human-computer interface of claim 1 wherein the wearable device communicates wirelessly with one or more of the computing devices.

8. The human-computer interface of claim 1 further comprising a module that provides automatic feedback to the user for directing the user to refine placement of a position of the wearable device on the surface of the user's skin.

9. The human-computer interface of claim 1 further comprising a module for providing automatic feedback to the user to indicate whether one or more of the specific commands were successfully executed in response to one or more specific user gestures.

10. The human-computer interface of claim 1 further comprising a module for deactivating the wearable device following receipt of an explicit indication provided by the user.

11. A process for sending commands to one or more computing devices, comprising:

arbitrarily positioning a wearable device in contact with an outer surface of a user's skin, said wearable device having a plurality of Electromyography (EMG) sensors for measuring muscle generated electrical activity via a skin of the user;

providing automatic feedback to the user for directing the user to refine placement of the wearable device on a surface of the user's skin to position one or more of the sensors nodes to capture particular muscle generated electrical signals;

automatically evaluating muscle-generated electrical signals of the user measured via one or more of the EMG sensors to automatically identify one or more specific gestures of the user from a predefined set of gestures; and

automatically directing one or more computing devices to execute one or more specific commands corresponding to one or more of the identified gestures.

12. The process of claim 11 further comprising performing an initial calibration process which evaluates muscle generated electrical signals associated with a subset of gestures to determine expected muscle generated electrical signals for the complete set of gestures.

13. The process of claim 11 wherein commands associated with one or more of the gestures of the set of gestures is user definable.

14. The process of claim 11 wherein the automatic feedback to the user for directing the user to refine placement of the position of the wearable device on a surface of the user's skin is a visual feedback.

15. A system for providing a human-computer interface (HCI), comprising:

an arbitrarily positionable wearable device having a plurality of sensor nodes, wherein each sensor node further includes one or more Electromyography (EMG) sensors;

a device which provides automatic feedback to the user for directing the user to refine placement of a position of the wearable device on a surface of the user's skin to ensure adequate signal strength of the muscle generated electrical signals measured using one or more of the EMG sensors;

a device for automatically measuring muscle generated electrical signals using one or more of the EMG sensors;

a device for automatically determining which muscle generated electrical signals correspond to one or more specific user gestures; and

a device for causing one or more computing devices to automatically execute one or more specific commands corresponding to one or more of the specific user gestures.

16. The system of claim 15 wherein the automatic feedback to the user for directing the user to refine placement of the position of the wearable device is provided via a visual indication.

17. The system of claim 15 wherein the automatic feedback to the user for directing the user to refine placement of the position of the wearable device is provided via an auditory indication.

18. The system of claim 15 wherein the automatic feedback to the user for directing the user to refine placement of the position of the wearable device is provided via a haptic indication applied to the user's skin by the wearable device.

19. The system of claim 15 wherein one or more of the specific commands corresponding to one or more of the specific user gestures are user definable.

20. The system of claim 15 wherein one or more of the specific user gestures are user definable.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2014
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 034544/0541 →
Continuity (3)
Continuation In Part 12146471 · Jun 26, 2008
Continuation 12404223 · Mar 13, 2009
Related Publication 20120188158A1 · Jul 26, 2012