IP Library Granted Patent US 10,771,881
Granted Patent B2
US 10,771,881 · App. 15/903,145 · Granted Sep 8, 2020

Earpiece with audio 3D menu

Inventors: Jake Berry Turner (Munich, DE); Alex Pohl (Munich, DE); Ye Li (Munich, DE); David K Dohmen (Munich, DE); Gwenael Kosider (Munich, DE)
Assignee: BRAGI GmbH
H04R1/1041G06F3/012G06F3/0346H04R1/1016H04R5/033H04R2420/07H04S7/304H04S2400/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,771,881
App. No.
15/903,145
Granted
Sep 8, 2020
Kind
B2
Abstract

An earpiece includes an earpiece housing, an intelligent control system disposed within the earpiece housing, a speaker operatively connected to the intelligent control system, a microphone operatively connected to the intelligent control system, and at least one sensor operatively connected to the intelligent control system for providing sensor data. The intelligent control system of the earpiece is configured to interface with a user of the earpiece by determining at least one of attention or intention of the user using the sensor data without receiving manual input at the earpiece and without receiving voice input from the user. The earpiece may be further configured to present an audio menu and use the attention or intention of the user to select one or more items from the audio menu.

Claims (46)

1. An earpiece comprising:

an earpiece housing;

an intelligent control system disposed within the earpiece housing;

a speaker operatively connected to the intelligent control system;

a microphone operatively connected to the intelligent control system;

at least one sensor operatively connected to the intelligent control system for providing sensor data, wherein the at least one sensor includes an inertial sensor and wherein the sensor data includes inertial sensor data;

wherein the intelligent control system is configured to determine, using the inertial sensor data, if the user movement detected with the at least one sensor is indicative that the user intends to awaken an audio menu interface comprising an audio menu, the audio menu interface providing a hierarchy of menu selections having a plurality of levels with a plurality of menu selections present at each of the plurality of levels;

wherein the intelligent control system of the earpiece is configured to interface with a user of the earpiece by determining at least one of attention or intention of the user using the sensor data without receiving manual input at the earpiece and without receiving voice input from the user;

wherein the earpiece is configured to present the audio menu when the audio menu interface is awakened and use the attention or intention of the user to select a first item from the audio menu by sensing a first head movement of the user and confirm selection of the first item by sensing a second head movement of the user;

wherein the earpiece is further configured to present a second plurality of menu selections in response to a confirmation of the selection of the first item;

wherein each of the plurality of menu selections is positioned in a different location in 3D space relative to the user using a psychoacoustic model.

2. The earpiece of claim 1 wherein the determining the attention or intention of the user is based at least in part on head orientation and/or head movement.

3. The earpiece of claim 2 wherein the at least one sensor further includes at least one biometric sensor and wherein the determining the attention or intention of the user is based at least in part on biometric data from the at least one biometric sensor.

4. The earpiece of claim 3 wherein the at least one sensor further includes at least one environmental sensor and wherein the determining the attention or intention of the user is based at least in part on environmental data from the at least one environmental sensor.

5. The earpiece of claim 1 further comprising at least one wireless transceiver disposed within the earpiece housing and operatively connected to the intelligent control system.

6. The earpiece of claim 1 wherein the audio menu comprises a plurality of item selections and wherein the item selections are arranged in part based on the sensor data.

7. The earpiece of claim 1 wherein the audio menu comprises a plurality of levels.

8. An earpiece comprising:

an earpiece housing;

an intelligent control system disposed within the earpiece housing;

a speaker operatively connected to the intelligent control system;

a microphone operatively connected to the intelligent control system;

at least one inertial sensor operatively connected to the intelligent control system for providing inertial sensor data;

wherein the intelligent control system is configured to determine, using the inertial sensor data, if the user movement detected with the at least one sensor is indicative that the user intends to awaken an audio menu interface comprising an audio menu;

wherein the intelligent control system of the earpiece is configured to interface with a user of the earpiece by:

providing audio cues associated with the audio menu containing a plurality of selections;

receiving a selection of one of the plurality of the selections within the audio menu at least partially based on the inertial sensor data without receiving manual input at the earpiece and without receiving voice input from the user;

receiving a confirmation of the selection of one of the plurality of the selections from the user, wherein the confirmation is based on head movement of the user;

providing audio cues associated with a plurality of sub menu items in response to the confirmation of the selection of one of the plurality of selections.

9. The earpiece of claim 8 wherein the menu comprises a plurality of levels.

10. The earpiece of claim 9 wherein each of the selections within a first level of the menu is associated with a different head position.

11. The earpiece of claim 10 wherein each of the selections within a second level of the menu is associated with a different head position.

12. The earpiece of claim 8 wherein the intelligent control of the earpiece is further configured to interface with the user of the earpiece by receiving a confirmation of the selection of one of the plurality of the selections within the menu based on the inertial sensor data.

13. A system comprising:

a first earpiece and a second earpiece wherein each of the first earpiece and the second earpiece comprises an earpiece housing sized and shaped for fitting into an ear of the user, a speaker, a microphone, and a transceiver;

wherein the first earpiece further comprises at least an accelerometer, a gyrometer, and a magnetometer for providing first sensor data;

wherein the second earpiece further comprises at least an accelerometer, a gyrometer, and a magnetometer for providing second sensor data;

wherein at least one of the first earpiece and the second earpiece further comprises an intelligent control system to interface with a user of the earpiece by determining at least one of attention or intention of the user using the first sensor data and the second sensor data without receiving manual input at the earpiece and without receiving voice input from the user;

wherein the system is configured to present an audio menu and use the attention or intention of the user to select at least one item from the audio menu, the system providing a hierarchy of menu selections having a plurality of levels with a plurality of the menu selections present at each of the plurality of levels;

wherein the system is configured to confirm the selection of the at least one item from the audio selections, wherein the confirmation is based at least in part on head movement of the user;

wherein the system is further configured to present a second plurality of menu selections in response to the confirmation of the at least one item from the audio menu.

14. The system of claim 13 wherein the audio menu comprises a plurality of audio cues and wherein the audio cues are processed with a psychoacoustic model to virtually place or move sounds in 3D space relative to the user.

15. The system of claim 13 wherein the determining the attention or intention of the user is based at least in part on head orientation and/or head movement.

16. The system of claim 15 wherein the first earpiece further comprises at least one biometric sensor and wherein the determining the attention or intention of the user is based at least in part on biometric data from the at least one biometric sensor of the first earpiece.

17. The system of claim 16 wherein the first earpiece further includes at least one environmental sensor and wherein the determining the attention or intention of the user is based at least in part on environmental data from the at least one environmental sensor.

18. The system of claim 13 wherein the audio menu is configured to include seven different items.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2020
From: LI, YE
To: BRAGI GMBH
Reel/Frame 052494/0551 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2020
From: TURNER, JAKE BERRY
To: BRAGI GMBH
Reel/Frame 052472/0282 →
EMPLOYEE AGREEMENT Recorded Apr 21, 2020
From: KOSIDER, GWENAEL
To: BRAGI GMBH
Reel/Frame 052643/0324 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2019
From: POHL, ALEX
To: BRAGI GMBH
Reel/Frame 048809/0525 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 6, 2018
From: DOHMEN, DAVID K
To: BRAGI GMBH
Reel/Frame 046279/0006 →
Continuity (2)
Provisional Application 62464337 · Feb 27, 2017
Related Publication 20180249239A1 · Aug 30, 2018
Cited By (1)
US 12,248,636