IP Library Granted Patent US 10,224,019
Granted Patent B2
US 10,224,019 · App. 15/893,015 · Granted Mar 5, 2019

Wearable audio device

Inventors: Chris James Mitchell (Cambridge, GB); Joe Patrick Lynas (Cambridge, GB); Julian Harris (Cambridge, GB); Arnoldas Jasonas (Cambridge, GB); Sacha Krstulovic (Cambridge, GB)
Assignee: AUDIO ANALYTIC LTD.
G10K11/17827G10L25/21G10L25/51G10L25/78H04R1/406H04R3/005H04S7/304G10K2210/1081H04S2400/11H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,224,019
App. No.
15/893,015
Granted
Mar 5, 2019
Kind
B2
Abstract

Broadly speaking, embodiments of the present invention provide a wearable audio device including one or a plurality of microphones, a sound recognition systems and a controller to control the device based on one or more recognized sounds or classes of sound. Embodiments use stored sound models.

Claims (81)

1. A system comprising at least one microphone, a sound identifier, a wearable audio device, and at least one classifier, wherein:

the wearable audio device comprises at least one transducer; and

the sound identifier is configured to:

identify a target sound detected by the at least one microphone; and

in response to identification of the target sound, adjust at least one of:

a setting of the wearable audio device;

a parameter of the wearable audio device; and

an audio signal provided to the wearable audio device;

the at least one classifier is configured to:

distinguish speech of a wearer of the wearable audio device from the speech of another speaker by processing at least one of:

an amplitude of a detected speech signal; and

an energy of a detected speech signal;

allocate a label to the distinguished speech, wherein the label comprises an indication that the detected speech signal is:

speech of a wearer; or

speech of another; and

use the label to adjust at least one of:

a setting of the wearable audio device;

a parameter of the wearable audio device; and

an audio signal provided to the wearable audio device,

wherein the at least one classifier comprises a model of a conversation comprising two speakers, and

wherein the at least one classifier is further configured to distinguish speech of the wearer of the wearable audio device from the speech of another speaker by processing the detected speech signal using the model.

2. The system of claim 1 , wherein the wearable device comprises noise cancelling headphones.

3. The system of claim 1 , wherein the sound identifier is further configured to:

distinguish between two or more sounds; and

take one of two or more actions dependent on the distinguished sounds.

4. The system of claim 1 , wherein the at least one classifier is configured to:

detect an intonation of the detected speech;

allocate a label to the detected speech, wherein the label comprises an indication of the detected intonation of the detected speech; and

use the label to adjust at least one of:

a setting of the wearable audio device;

a parameter of the wearable audio device; and

an audio signal provided to the wearable audio device.

5. The system of claim 1 wherein the sound identifier identifies presence of a conversation, the conversation comprising speech of a first speaker is followed by speech of a second, different speaker, and vice-versa.

6. The system of claim 1 , wherein the system further comprises a personal assistant system:

wherein the personal assistant system is configured to communicate a message to the user in response to a detected sound or a detected sound environment; and

wherein identification of a detected sound or a detected sound environment determines at least one of semantic content, intonation, pitch and another property of the message.

7. The system of claim 6 , wherein at least one of:

the message comprises a description of a location of the detected sound; and

the message is presented to the wearer's ears to give the impression of coming from the direction of the detected sound; and

the message is synthesized speech.

8. The system of claim 7 , wherein the location of the detected sound is determined by at least one of:

selecting at least one of a plurality of directional microphones pointing in different directions; and

controlling beam forming using an array of microphones.

9. The system of claim 7 , wherein the message is presented to the wearer's ears to give the impression of coming from the direction of the detected sound by at least one of:

controlling the filtering of signals delivered to ears of the wearer;

controlling the timing of signals delivered to the ears of the wearer; and

applying one or more head-related transfer functions to the message.

10. The system of claim 1 wherein, in response to the identification of the target sound, the system is configured to:

determine the location of the target sound by at least one of:

selecting at least one of a plurality of directional microphones pointing in different directions; and

controlling beam forming using an array of microphones; and

apply one or more head-related transfer functions to the target sound to give the impression to the wearer that the target sound is coming from the direction of the detected sound.

11. The system of claim 1 , wherein the wearable audio device is configured to:

reside in a low powered state;

upon detecting a wake sound, boot up a processor of the wearable audio device into a higher powered state, wherein the processor when in the higher powered state is configured to:

identify a target sound detected by the at least one transducer; and

in response to identification of the target sound, adjust at least one of:

a setting of the wearable audio device;

a parameter of the wearable audio device; and

an audio signal provided to the wearable audio device; and

return to a low powered state after a duration of time in which it is has been determined that no sound has originated from the wearer.

12. A noise cancelling headphone system comprising at least one microphone, a sound identifier, and at least one transducer:

wherein the sound identifier is configured to identify a target sound detected by the at least one microphone; and

in response to identification of the target sound, adjust a degree of noise cancellation applied by the noise cancelling headphone system to allow more external sound to reach a wearer's ear;

wherein the sound identifier is further configured to:

identify presence of speech;

differentiate between speech from the wearer and speech from an interlocutor;

in response to the identification of presence of speech originating from the interlocutor, adjust the degree of noise cancellation applied to allow more external sound to reach the wearer's ear; and

in response to the identification of presence of speech originating from the wearer, adjust the degree of noise cancellation applied to allow less external sound to reach the wearer's ear.

13. The system of claim 12 wherein adjustment of the degree of noise cancellation applied comprises allowing only a selected portion of the external sound to reach the wearer's ear, wherein the selected portion of external sound corresponds to the target sound.

14. The system of claim 12 , wherein the sound identifier is configured to distinguish between presence of speech originating from a background source and presence of speech originating from a foreground sound;

in response to the identification of presence of speech originating from a background source, adjust the degree of noise cancellation applied to allow less external sound to reach the wearer's ear; and

in response to the identification of presence of speech originating a foreground source, adjust the degree of noise cancellation applied to allow more external sound to reach the wearer's ear.

15. A method of responding to external sound, the method comprising steps of:

capturing a target sound at a noise cancelling headphone;

identifying the target sound by comparing the target sound to a sound model;

adjusting a degree of noise cancellation applied by the noise cancelling headphone system to allow more external sound to reach a wearer's ear;

identifying presence of speech;

differentiating between speech from the wearer and speech from an interlocutor;

in response to the identification of presence of speech originating from the interlocutor, adjusting the degree of noise cancellation applied to allow more external sound to reach the wearer's ear; and

in response to the identification of presence of speech originating from the wearer, adjusting the degree of noise cancellation applied to allow less external sound to reach the wearer's ear.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2023
From: AUDIO ANALYTIC LIMITED
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 062350/0035 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2018
From: MITCHELL, CHRISTOPHER JAMES; LYNAS, JOE PATRICK; HARRIS, JULIAN; JASONAS, ARNOLDAS; KRSTULOVIC, SACHA
To: AUDIO ANALYTIC LTD.
Reel/Frame 045347/0321 →
Continuity (2)
Provisional Application 62457535 · Feb 10, 2017
Related Publication 20180233125A1 · Aug 16, 2018
Cited By (6)
US 12,289,666 US 12,289,667 US 12,289,668 US 12,293,772 US 12,581,225 US 12,718,559