IP Library Granted Patent US 11,967,247
Granted Patent B2
US 11,967,247 · App. 17/063,217 · Granted Apr 23, 2024

Prosthetic virtual reality training interface and related methods

Inventors: Levi J. Hargrove (Chicago, IL); Richard B. Woodward (Chicago, IL)
Assignee: Rehabilitation Institute of Chicago
G09B19/003A61B5/296A61B5/389A61B5/681A61B5/6811A61B5/6824A61B5/7405G06F3/017G06T19/003G16H20/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,967,247
App. No.
17/063,217
Granted
Apr 23, 2024
Kind
B2
Abstract

An apparatus comprising an arm band and an electromyographic (EMG) control module is disclosed. The apparatus includes an electromygraphic (EMG) control module configured to receive EMG information generated by an individual; identify a gesture class based on the EMG information, and train using the received EMG information and the gesture class. The gesture class corresponds to an intended gesture made by the individual.

Claims (60)

1. An apparatus for prosthetic training, comprising:

an arm band for training a control module associated with a prosthetic limb including:

a plurality of housing elements defining a housing,

one or more electromyography (EMG) sensors provided in at least one of the plurality of housing elements, and

one or more kinematic sensors;

one or more processing units in operable communication with the one or more EMG sensors of the arm band and the control module of the prosthetic limb, the one or more processing units configured to:

receive EMG data of a residual limb from the one or more EMG sensors, predict an intended gesture of a user wearing the arm band from the EMG data, and generate a gesture instruction in response to a user performing a training gesture; and

a virtual reality (VR) system configured for training the control module of the prosthetic limb using the arm band, comprising:

a visual display,

one or more detectors for motion tracking, configured to:

receive data from the one or more kinematic sensors to determine a position or orientation of the arm band relative to the VR system, and

a VR control module in operative communication with the one or more processing units and configured to:

prompt to the user wearing the arm band to perform the training gesture;

receive the gesture instruction, and

alter the visual display based on the gesture instruction to display a virtual representation of the intended gesture,

wherein engagement with the VR system by the user wearing the arm band trains the control module to identify the intended gesture of the user based on the EMG data and the training gesture.

2. The apparatus of claim 1 further comprising:

the arm band including:

the plurality of housing elements defining the housing,

wherein the plurality of housing elements is modifiable to assume a predetermined weight, wherein a total weight of the arm band simulates a feeling of an assistive device prescribed for a particular user, wherein the predetermined weight is modifiable incrementally.

3. The apparatus of claim 1 , wherein the arm band includes a wireless transmitter that allows for EMG information to be transmitted wirelessly.

4. The apparatus of claim 3 , wherein the arm band includes a myoelectric control interface, and the wireless transmitter transmits a gesture instruction produced by the myoelectric control interface.

5. The apparatus of claim 1 , wherein the arm band is wrapped around the residual limb of a user.

6. The apparatus of claim 1 , wherein the arm band includes amplification and processing electronics, contained within the plurality of housing elements for processing EMG signals.

7. An apparatus for prosthetic training, comprising:

an arm band for training use of a prosthetic limb configured to be coupled to a residual limb of a user including:

a plurality of housing elements defining a housing,

one or more EMG sensors provided in at least one of the plurality of housing elements; and

one or more kinematic sensors;

one or more processing units in operable communication with the one or more EMG sensors of the arm band, the one or more processing units configured to:

receive EMG data of the residual limb from the one or more EMG sensors, predict an intended gesture of the user wearing the arm band for training use of the prosthetic limb from the EMG data; and

generate a gesture instruction in response to the user performing a training gesture; and

a virtual reality (VR) system including:

one or more detectors for motion tracking, configured to receive data from the one or more kinematic sensors to determine a position or orientation of the arm band relative to the VR system; and

a VR control module in operative communication with a VR display and the one or more processing units, said VR control module configured to prompt the user to perform the training gesture and generate instructions to control movement of a virtual reality limb displayed on the VR display based at least on the gesture instruction received from the one or more processing units.

8. The apparatus of claim 7 , further comprising a flexible connector interconnecting the plurality of housing elements.

9. The apparatus of claim 7 , wherein at least one of the plurality of housing elements includes the one or more kinematic sensors for tracking of an orientation of the housing.

10. The apparatus of claim 9 , wherein the tracking is performed using virtual reality tracking employed by the VR system, and wherein the VR control module is in operative communication with the one or more kinematic sensors.

11. The apparatus of claim 7 , wherein at least one instruction from the one or more processing units is based on the intended gesture predicted by the one or more processing units.

12. The apparatus of claim 10 , wherein the instructions to control movement of a virtual reality limb are generated by the VR control module based on an input from the one or more kinematic sensors.

13. An apparatus, comprising:

an arm band configured for prosthetic training including a plurality of housing elements, an electromyography (EMG) sensor, at least one kinematic sensor, and a processing element;

an electromyography (EMG) control module in communication with the processing element of the arm band configured to:

receive EMG information generated by the EMG sensor in response to movement of a residual limb of a user wearing the arm band in one or more physical dimensions; and

identify a gesture class based on the EMG information; and

a virtual reality (VR) system including:

a VR display;

one or more VR detectors configured to receive data from the one or more kinematic sensors; and

a VR control module in operative communication with:

the one or more VR detectors for determining a position of the arm band with respect to the VR system;

the VR display; and

the EMG control module,

the VR control module being configured to prompt the user to perform a training gesture within the gesture class in each of the one or more physical dimensions and generate instructions to control movement of a virtual reality limb displayed on the VR display based at least on a gesture instruction generated by the EMG control module in response to the user performing the training gesture; and

wherein the EMG control module is further configured to:

train based on the gesture class and the EMG information received in response to the user performing the training gesture,

wherein the gesture class is trained using EMG information received from user movement in each of the one or more physical dimensions, and

wherein the EMG control module as trained is configured to provide the gesture instruction to a prosthetic device worn by the user in response to the user performing the identified intended gesture.

14. The apparatus of claim 13 , wherein the EMG control module is provided as a myoelectric control interface on the arm band that receives EMG information from the EMG sensor and predicts a gesture associated with the user based on movement of the arm band.

15. The apparatus of claim 13 , wherein the EMG control module is further configured to modulate a speed of actuation of the prosthetic device by using an amplitude of an EMG signal represented in the EMG information and provide an instruction to the prosthetic device.

16. The apparatus of claim 13 , wherein the one or more kinematic sensors provides a proportional control value to the VR control module to control speed of the virtual reality limb displayed on the VR display.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 7, 2022
From: HARGROVE, LEVI J.; WOODWARD, RICHARD B.
To: REHABILITATION INSTITUTE OF CHICAGO D/B/A/ SHIRLEY RYAN ABILITYLAB
Reel/Frame 060122/0381 →
CONFIRMATORY LICENSE Recorded May 23, 2022
From: REHABILITATION INSTITUTE OF CHICAGO D/B/A/ SHIRLEY RYAN ABILITY LAB
To: UNITED STATES GOVERNMENT
Reel/Frame 060385/0170 →
Continuity (3)
Division 15954417 · Apr 16, 2018
Provisional Application 62485885 · Apr 14, 2017
Related Publication 20210049928A1 · Feb 18, 2021