IP Library Granted Patent US 11,675,437
Granted Patent B2
US 11,675,437 · App. 17/700,248 · Granted Jun 13, 2023

Measurement of facial muscle EMG potentials for predictive analysis using a smart wearable system and method

Inventors: Julius Friedrich Rüdiger (Munich, DE); Peter Vincent Boesen (Munich, DE)
Assignee: BRAGI GMBH
G06F3/015G06F1/163G06F1/1694G06F3/017H04R1/1016H04R1/1041G06F2200/1637H04R5/033H04R2420/07H04R2460/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,675,437
App. No.
17/700,248
Granted
Jun 13, 2023
Kind
B2
Abstract

A system includes at least one wearable device having a housing, at least one sensor disposed within the housing, at least one output device disposed within the housing, and at least one processor operatively connected to the sensors and output devices, wherein one or more sensors are configured to detect electrical activity from a user's facial muscles and to transmit a data signal concerning the electrical activity of the user's facial muscles to one of more of the processors. A method of controlling a wearable device includes determining facial muscular electrical data of a facial gesture made by a user, interpreting the facial muscular electrical data to determine a user response, and performing an action based on the user response.

Claims (57)

1. A system comprising:

a set of earpieces comprising a first earpiece and a second earpiece, wherein the first earpiece comprises:

a) an earpiece housing,

b) a processor disposed within the earpiece housing,

c) at least one sensor, located at an external surface of the earpiece housing, configured to detect electrical activity from a user's facial muscles, the at least one sensor operatively connected to the processor and wherein the at least one sensor is an electromyogram (EMG) sensor,

d) wherein the processor is configured to interpret the electrical activity from the user's facial muscles as a first command to perform action according to a pre-determined user setting,

e) an inertial sensor operatively connected to the processor and wherein the processor is further configured to interpret the electrical activity from the user's facial muscles in combination with at least one of head orientation or movement as a second command,

f) at least one microphone operatively connected to the processor,

g) at least one speaker operatively connected to the processor.

2. The system of claim 1 wherein each wearable device further comprises a transceiver operatively connected to the processor.

3. The system of claim 1 wherein the first earpiece is configured not to interpret the electrical activity from the user's facial muscles as a command if the user is talking as determined using the at least one microphone.

4. The system of claim 1 further comprising a software application executing on a mobile device configured to provide for modifying the pre-determined user setting.

5. The system of claim 1 wherein the second earpiece comprises:

a) an earpiece housing,

b) a processor disposed within the earpiece housing,

c) at least one sensor, located at an external surface of the earpiece housing, configured to detect electrical activity from a user's facial muscles, the at least one sensor operatively connected to the processor and wherein the at least one sensor is an electromyogram (EMG) sensor,

d) wherein the processor is configured to interpret the electrical activity from the user's facial muscles as a first command to perform action according to a pre-determined user setting,

e) an inertial sensor operatively connected to the processor and wherein the processor is further configured to interpret the electrical activity from the user's facial muscles in combination with at least one of head orientation or movement as a second command,

f) at least one microphone operatively connected to the processor,

g) at least one speaker operatively connected to the processor.

6. A method for using facial muscle electromyogram (EMG) potential as input for a set of earpieces comprising a first earpiece and a second earpiece, the first earpiece comprising:

a) an earpiece housing,

b) a processor disposed within the earpiece housing,

c) at least one EMG sensor, placed on an external surface of the earpiece housing, configured to detect electrical activity from a user's facial muscles, the at least one EMG sensor operatively connected to the processor, and

d) at least one inertial sensor configured to detect a user's head movement, the at least one inertial sensor operatively connected to the processor,

e) at least one microphone operatively connected to the processor and at least one speaker operatively connected to the processor,

generating voice feedback at the at least one speaker;

receiving the facial muscle EMG potentials at the at least one EMG sensor in response to the voice feedback;

receiving audio input from the at least one microphone at the processor in response to the voice feedback;

receiving inertial data indicative of the user's head movement from the at least one inertial sensor at the processor in response to the voice feedback; and

interpreting at the processor the facial muscle EMG potentials, the audio input, and the inertial data to determine occurrence of a command to perform an action according to a pre-determined user setting.

7. The method of claim 6 wherein the first earpiece further comprises a transceiver operatively connected to the processor.

8. The method of claim 6 wherein the interpreting at the processor includes determining if the user is talking and if the user is talking determining the facial muscle EMG potentials are not indicative of the occurrence of the command.

9. The method of claim 6 further comprising receiving a modification of the pre-determined user setting from a software application executing on a mobile device configured to provide for modifying the pre-determined user setting.

10. The method of claim 9 wherein the receiving is receiving through a wireless communication from the mobile device.

11. A method for using facial muscle electromyogram (EMG) potential as input for an earpiece, the method comprising:

receiving a pre-determined setting at the earpiece;

receiving facial muscle EMG potentials by at least one EMG sensor of the earpiece;

receiving audio input from at least one microphone of the earpiece at a processor of the earpiece;

receiving inertial data indicative of the user's head movement from the at least one inertial sensor of the earpiece at the processor of the earpiece; and

interpreting at the processor of the earpiece the facial muscle EMG potentials, the audio input, and the inertial data to determine occurrence of a command to perform an action according to the pre-determined user setting.

12. The method of claim 11 wherein the first earpiece comprises a transceiver operatively connected to the processor.

13. The method of claim 11 wherein the interpreting at the processor of the earpiece includes determining if the user is talking and if the user is talking determining the facial muscle EMG potentials are not indicative of the occurrence of the command.

14. The method of claim 11 wherein the processor is disposed within an earpiece housing of the earpiece.

15. The method of claim 14 wherein the at least one EMG sensor of the earpiece is placed on an external surface of the earpiece housing.

16. The method of claim 11 wherein the receiving the pre-determined setting at the earpiece comprises receiving the pre-determined setting at the earpiece through a wireless communication.

17. The method of claim 16 wherein the wireless communication is a wireless communication with a mobile device executing a software application configured for modifying the pre-determined setting.

18. A system comprising:

a wearable device comprising:

a housing,

a processor disposed within the housing,

at least one sensor, located at an external surface of the housing, configured to detect electrical activity from a user's facial muscles, the at least one sensor operatively connected to the processor and wherein the at least one sensor is an electromyogram (EMG) sensor,

wherein the processor is configured to interpret the electrical activity from the user's facial muscles as a first command to perform action according to a pre-determined user setting,

an inertial sensor operatively connected to the processor and wherein the processor is further configured to interpret the electrical activity from the user's facial muscles in combination with at least one of head orientation or movement as a second command,

at least one microphone operatively connected to the processor,

at least one speaker operatively connected to the processor.

19. The system of claim 18 further comprising a software application executing on a mobile device configured to provide for modifying the pre-determined user setting.

Assignments (2)
EMPLOYMENT DOCUMENT Recorded Apr 27, 2023
From: BOESEN, PETER VINCENT
To: BRAGI GMBH
Reel/Frame 063474/0416 →
EMPLOYMENT DOCUMENT Recorded Mar 31, 2022
From: RÜDIGER, JULIUS FRIEDRICH
To: BRAGI GMBH
Reel/Frame 060270/0844 →
Continuity (4)
Continuation 17102864 · Nov 24, 2020
Continuation 15703811 · Sep 13, 2017
Provisional Application 62393926 · Sep 13, 2016
Related Publication 20220214748A1 · Jul 7, 2022
Cited By (1)
US 12,382,208