IP Library Granted Patent US 11,294,466
Granted Patent B2
US 11,294,466 · App. 17/102,864 · Granted Apr 5, 2022

Measurement of facial muscle EMG potentials for predictive analysis using a smart wearable system and method

Inventors: Julius Friedrich Rüdiger (Munich, DE); Peter Vincent Boesen (Munich, DE)
Assignee: BRAGI GmbH
G06F3/015G06F1/163G06F1/1694G06F3/017H04R1/1016H04R1/1041G06F2200/1637H04R5/033H04R2420/07H04R2460/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,294,466
App. No.
17/102,864
Granted
Apr 5, 2022
Kind
B2
Abstract

A system includes at least one wearable device having a housing, at least one sensor disposed within the housing, at least one output device disposed within the housing, and at least one processor operatively connected to the sensors and output devices, wherein one or more sensors are configured to detect electrical activity from a user's facial muscles and to transmit a data signal concerning the electrical activity of the user's facial muscles to one of more of the processors. A method of controlling a wearable device includes determining facial muscular electrical data of a facial gesture made by a user, interpreting the facial muscular electrical data to determine a user response, and performing an action based on the user response.

Claims (36)

1. A system comprising:

a set of earpieces comprising a first earpiece and a second earpiece, wherein each earpiece comprises:

a) an earpiece housing;

b) a processor disposed within the earpiece housing,

c) a gesture control interface operatively connected to the processor,

d) at least one sensor, located at an external surface of the earpiece housing, configured to detect electrical activity from a user's facial muscles, the at least one sensor operatively connected to the processor and wherein the at least one sensor is an electromyogram (EMG) sensor,

e) wherein the processor is configured to interpret the electrical activity from the user's facial muscles as a first command to perform action according to a pre-determined user setting,

f) an inertial sensor operatively connected to the processor and wherein the processor is further configured to interpret the electrical activity from the user's facial muscles in combination with at least one of head orientation or movement as a second command,

g) at least one microphone operatively connected to the processor;

h) at least one speaker operatively connected to the processor.

2. The system of claim 1 wherein each wearable device further comprises a transceiver operatively connected to the processor.

3. The system of claim 1 wherein the first earpiece is configured not to interpret the electrical activity from the user's facial muscles as a command if the user is talking as determined using the at least one microphone.

4. The system of claim 1 further comprising a software application executing on a mobile device configured to provide for modifying the pre-determined user setting.

5. A method for using facial muscle electromyogram (EMG) potential as input for a set of earpieces comprising a first earpiece and a second earpiece, the first earpiece comprising:

a) an earpiece housing,

b) a processor disposed within the earpiece housing,

c) a gesture control interface operatively connected to the processor,

d) at least one EMG sensor, placed on an external surface of the earpiece housing, configured to detect electrical activity from a user's facial muscles, the at least one EMG sensor operatively connected to the processor, and

e) at least one inertial sensor configured to detect a user's head movement, the at least one inertial sensor operatively connected to the processor,

f) at least one microphone operatively connected to the processor and at least one speaker operatively connected to the processor,

generating voice feedback at the at least one speaker;

receiving the facial muscle EMG potentials at the at least one EMG sensor in response to the voice feedback;

receiving audio input from the at least one microphone at the processor in response to the voice feedback;

receiving inertial data indicative of the user's head movement from the at least one inertial sensor at the processor in response to the voice feedback; and

interpreting at the processor the facial muscle EMG potentials, the audio input, and the inertial data to determine occurrence of a command to perform an action according to a pre-determined user setting.

6. The method of claim 5 wherein the first earpiece further comprises a transceiver operatively connected to the processor.

7. The method of claim 5 wherein the interpreting at the processors includes determining if the user is talking and if the user is talking determining the facial muscle EMG potentials are not indicative of the occurrence of the command.

8. A method for using facial muscle electromyogram (EMG) potential as input for an earpiece, the method comprising:

receiving facial muscle EMG potentials by at least one EMG sensor of the earpiece;

receiving audio input from at least one microphone of the earpiece at a processor of the earpiece;

receiving inertial data indicative of the user's head movement from the at least one inertial sensor of the earpiece at the processor of the earpiece; and

interpreting at the processor of the earpiece the facial muscle EMG potentials, the audio input, and the inertial data to determine occurrence of a command to perform an action according to a pre-determined user setting.

9. The method of claim 8 wherein the first earpiece comprises a transceiver operatively connected to the processor.

10. The method of claim 8 wherein the interpreting at the processor of the earpiece includes determining if the user is talking and if the user is talking determining the facial muscle EMG potentials are not indicative of the occurrence of the command.

11. The method of claim 8 wherein the processor is disposed within an earpiece housing of the earpiece.

12. The method of claim 11 wherein the at least one EMG sensor of the earpiece is placed on an external surface of the earpiece housing.

Assignments (1)
EMPLOYMENT DOCUMENT Recorded Dec 7, 2020
From: RÜDIGER, JULIUS FRIEDRICH; BOESEN, PETER VINCENT
To: BRAGI GMBH
Reel/Frame 054661/0858 →
Continuity (3)
Continuation 15703811 · Sep 13, 2017
Provisional Application 62393926 · Sep 13, 2016
Related Publication 20210081044A1 · Mar 18, 2021
Cited By (1)
US 12,675,163