IP Library Granted Patent US 11,397,470
Granted Patent B2
US 11,397,470 · App. 16/875,808 · Granted Jul 26, 2022

Tongue localization, teeth interaction, and detection system

Inventors: Tam Vu (Boulder, CO); Phuc Nguyen (Denver, CO); Nam Bui (Broomfield, CO); Robin Deterding (Boulder, CO)
Assignee: THE REGENTS OF THE UNIVERSITY OF COLORADO, A BODY CORPORATE
G06F3/015A61B5/1107A61B5/369A61B5/394A61B5/4547A61B5/4552A61B5/7246G06F3/017
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,397,470
App. No.
16/875,808
Granted
Jul 26, 2022
Kind
B2
Abstract

A computer-implemented method for identifying tongue movement comprises detecting an electroencephalography (“EEG”) signal from an EEG sensor. The EEG sensor is configured to sense the EEG signal generated by a brain in association with a tongue movement. The method also comprises detecting the EMG signal from the EMG sensor. The EMG sensor is configured to sense the EMG signal generated by cranial nerve stimulation of muscles associated with the tongue movement. The method also includes identifying the tongue movement based on the EEG signal and the EMG signal. The method then includes correlating the tongue movement with one of a plurality of tongue location areas.

Claims (48)

1. A computer system for identifying tongue movement, comprising:

an electroencephalography (“EEG”) sensor configured to sense an EEG signal generated by a brain in association with a tongue movement;

an electromyography (“EMG”) sensor configured to sense an EMG signal generated by cranial nerve stimulation of muscles associated with the tongue movement;

one or more processors; and

one or more computer-readable media having stored thereon executable instructions that when executed by the one or more processors configure the computer system to perform at least the following:

detect the EEG signal from the EEG sensor;

detect the EMG signal from the EMG sensor;

based on the EEG signal and the EMG signal, identify the tongue movement; and

correlate the tongue movement with one of a plurality of tongue location areas.

2. The computer system of claim 1 , further comprising a skin deformation (SKD) sensor configured to sense a SKD signal that varies based on skin deformation.

3. The computer system of claim 2 , wherein the EEG sensor, the EMG sensor, and the SKD sensor comprise a pair of EEG sensors, a pair of EMG sensors, and a pair of SKD sensors.

4. The computer system of claim 1 , wherein the executable instructions include instructions that are executable to configure the computer system to:

detect the SKD signal from the SKD sensor;

based on the SKD signal, the EEG signal and the EMG signal, identify the tongue movement; and

correlate the tongue movement with one of the plurality of tongue location areas.

5. The computer system of claim 1 , wherein the plurality of tongue location areas comprise a set of predefined areas.

6. The computer system of claim 5 , wherein each predefined areas within the set of predefined areas is associated with particular entry in a key map that interfaces with a computer.

7. The computer system of claim 5 , wherein at least one predefined areas within the set of predefined areas is associated with the tongue movement articulating outside a user's teeth.

8. The computer system of claim 1 , wherein the executable instructions include instructions that are executable to configure the computer system to:

detect the EEG signal and the EMG signal;

based on the EEG signal and the EMG signal, identify a particular oral movement; and

correlate the particular oral movement to a command to start or stop said computing device.

9. The computer system of claim 8 , wherein the particular oral movement comprises a teeth-gritting event.

10. The computer system of claim 8 , wherein the particular oral movement comprises correlating the tongue movement with a particular tongue location area.

11. A computer-implemented method for identifying tongue movement, the computer-implemented method executed on one or more processors, the computer-implemented comprising:

detecting an electroencephalography (“EEG”) signal from an EEG sensor, wherein the EEG sensor configured to sense the EEG signal generated by a brain in association with a tongue movement;

detecting an EMG signal from an EMG sensor, wherein the EMG sensor configured to sense the EMG signal generated by cranial nerve stimulation of muscles associated with the tongue movement;

based on the EEG signal and the EMG signal, identifying the tongue movement; and

correlating the tongue movement with one of a plurality of tongue location areas.

12. The computer-implemented method of claim 11 , further comprising a skin deformation (SKD) sensor configured to sense a SKD signal that varies based on skin deformation.

13. The computer-implemented method of claim 12 , wherein the EEG sensor, the EMG sensor, and the SKD sensor comprise a pair of EEG sensors, a pair of EMG sensors, and a pair of SKD sensors.

14. The computer-implemented method of claim 11 , further comprising:

detecting the SKD signal from the SKD sensor;

based on the SKD signal, the EEG signal and the EMG signal, identifying the tongue movement; and

correlating the tongue movement with one of the plurality of tongue location areas.

15. The computer-implemented method of claim 11 , wherein the plurality of tongue location areas comprise a set of predefined areas.

16. The computer-implemented method of claim 15 , wherein each predefined areas within the set of predefined areas is associated with particular entry in a key map that interfaces with a computer.

17. The computer-implemented method of claim 11 , further comprising:

detecting the EEG signal and the EMG signal;

based on the EEG signal and the EMG signal, identifying a particular oral movement; and

correlating the particular oral movement to a command to start or stop said computing device.

18. The computer-implemented method of claim 17 , wherein the particular oral movement comprises a teeth-gritting event.

19. The computer-implemented method of claim 17 , wherein the particular oral movement comprises correlating the tongue movement with a particular tongue location area.

20. A computer program product comprising one or more computer storage media having stored thereon computer-executable instructions that, when executed at a processor, cause the computer system to perform a method for identifying tongue movement, the method comprising:

detecting an electroencephalography (“EEG”) signal from an EEG sensor, wherein the EEG sensor configured to sense the EEG signal generated by a brain in association with a tongue movement;

detecting an EMG signal from an EMG sensor, wherein the EMG sensor configured to sense the EMG signal generated by cranial nerve stimulation of muscles associated with the tongue movement;

based on the EEG signal and the EMG signal, identifying the tongue movement; and

correlating the tongue movement with one of a plurality of tongue location areas.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2022
From: DETERDING, ROBIN
To: THE REGENTS OF THE UNIVERSITY OF COLORADO, A BODY CORPORATE
Reel/Frame 060253/0647 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 15, 2022
From: VU, TAM, DR.; NGUYEN, PHUC; BUI, NAM
To: THE REGENTS OF THE UNIVERSITY OF COLORADO, A BODY CORPORATE
Reel/Frame 060749/0825 →
CONFIRMATORY LICENSE Recorded May 22, 2020
From: UNIVERSITY OF COLORADO
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 052742/0902 →
Continuity (2)
Provisional Application 62849325 · May 17, 2019
Related Publication 20200363871A1 · Nov 19, 2020