IP Library Granted Patent US 9,066,167
Granted Patent B2
US 9,066,167 · App. 14/036,198 · Granted Jun 23, 2015

Method and device for personalized voice operated control

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,066,167
App. No.
14/036,198
Granted
Jun 23, 2015
Kind
B2
Abstract

An earpiece ( 100 ) and a method ( 300 ) personalized voice operable control can include capturing ( 302 ) an ambient sound from an Ambient Sound Microphone ( 111 ) to produce an electronic ambient signal ( 426 ), delivering ( 304 ) audio content ( 402 ) to an ear canal ( 131 ) by way of an Ear Canal Receiver ( 125 ) to produce an acoustic audio content ( 404 ) and capturing ( 306 ) in the ear canal an internal sound ( 402 ) from an Ear Canal Microphone ( 123 ) to produce an electronic internal signal ( 410 ). The electronic internal signal includes an echo of the acoustic audio content and a spoken voice generated by a wearer of the earpiece. The Method also includes detecting ( 312 ) the spoken voice in the electronic internal signal in the presence of the echo, and controlling ( 314 ) a voice operation of the earpiece when the spoken voice is detected.

Claims (34)

1. A method for personalized voice operable control, the method comprising the steps of:

capturing an ambient sound from at least one Ambient Sound Microphone (ASM) to produce an electronic ambient signal;

delivering audio content to an ear canal by way of an Ear Canal Receiver (ECR) of an earpiece to produce an acoustic audio content;

capturing in the ear canal an internal sound from at least one Ear Canal Microphone (ECM) of the earpiece to produce an electronic internal signal, wherein the electronic internal signal includes an echo of the acoustic audio content and a sound signal;

suppressing the echo of the acoustic audio content in the electronic internal signal to produce a modified electronic internal signal containing the sound signal;

detecting a presence of a spoken voice signal generated by a wearer of the earpiece in the modified electronic internal signal based on an analysis of both the electronic ambient signal and the modified electronic internal signal for a characteristic of the sound signal;

controlling at least one voice operation of at least one of a mobile device or the earpiece if the spoken voice signal is detected;

generating a voice activity level of the spoken voice signal based on the electronic ambient signal and the modified electronic internal signal; and

controlling a mixing of the electronic ambient signal and the modified electronic internal signal based on the voice activity level for producing a mixed signal with reduced echo from the acoustic audio content and resulting in detection of the spoken voice signal with minimal echo.

2. The method of claim 1 , wherein the analysis includes comparing the modified electronic internal signal to the electronic ambient signal to determine whether the sound signal originates in the ear canal or external to the ear canal, the sound signal indicating the presence of the spoken voice signal when the sound signal originates in the ear canal.

3. The method of claim 1 , wherein the ambient sound microphone is a part of a mobile phone.

4. The method of claim 3 , comprising adjusting a volume level of the audio content that is delivered to the ear canal based on the voice activity level.

5. The method of claim 1 , wherein the ambient sound microphone is a part of an earpiece.

6. The method of claim 5 , comprising transmitting the mixed signal to at least one among the mobile device, a cell phone, a media player, a portable computing device, a personal digital assistant and a further earpiece.

7. The method of claim 5 , comprising controlling a further mixing of the audio content and the mixed signal to form a further mixed signal.

8. The method of claim 7 , comprising delivering the further mixed signal to the ear canal via the ECR.

9. The method of claim 1 , wherein the audio content is at least one among a phone call, a voice message, a music signal, and the spoken voice signal received from the ASM.

10. The method of claim 1 , comprising suppressing the echo in the electronic internal signal by way of a least mean squares algorithm.

11. The method of claim 1 , comprising estimating an ear canal transfer function from the audio content and the electronic internal signal.

12. A system for personalized voice operable control, comprising:

an Ambient Sound Microphone (ASM) configured to capture ambient sound and produce an electronic ambient signal;

an Ear Canal Receiver (ECR) of an earpiece configured to deliver audio content to an ear canal to produce an acoustic audio content;

an Ear Canal Microphone (ECM) of the earpiece configured to capture internal sound in the ear canal and produce an electronic internal signal, wherein the electronic internal signal includes an echo of the acoustic audio content and a sound signal;

an echo canceller configured to suppress the echo of the acoustic audio content in the electronic internal signal to produce a modified electronic internal signal containing the sound signal;

a processor operatively coupled to the ASM, the ECM, the ECR and the echo canceller where the processor is configured to detect a presence of a spoken voice signal generated by a wearer of the earpiece in the modified electronic internal signal based on an analysis of both the electronic ambient signal and the modified electronic internal signal for a characteristic of the sound signal; and

a voice operated control (VOC) operatively coupled to the processor, the VOC configured to control at least one voice operation of at least one of a mobile device or the earpiece if the spoken voice signal is detected, to generate a voice activity level of the spoken voice signal based on the electronic ambient signal and the modified electronic internal signal and to control a mixing of the electronic ambient signal and the modified electronic internal signal based on the voice activity level for producing a mixed signal with reduced echo resulting in detection of the spoken voice signal sufficiently free of the echo.

13. The system of claim 12 , wherein, the analysis, by the processor, includes comparing the modified electronic internal signal to the electronic ambient signal to determine whether the sound signal originates in the ear canal or external to the ear canal, the sound signal indicating the presence of the spoken voice signal when the sound signal originates in the ear canal.

14. The system of claim 12 , wherein the processor is configured to adjust a level of the audio content responsive to detecting the presence of the spoken voice signal.

15. The system of claim 12 , wherein the audio content is at least one among a phone call, a voice message, a music signal, and the spoken voice signal received from the ASM.

16. The system of claim 12 , wherein the VOC is configured to accept communications from at least one among the mobile device, a cell phone, a media player, a portable computing device, a personal digital assistant and a further earpiece for providing the audio content.

17. The system of claim 12 , wherein the ambient sound microphone is part of a mobile device.

18. The system of claim 17 , where the ambient sound microphone is part of the earpiece.

19. The system of claim 18 , further comprising a transceiver operatively coupled to the processor and configured to transmit the mixed signal to at least one among the mobile device, a cell phone, a media player, a portable computing device, a personal digital assistant and a further earpiece.

20. The system of claim 18 , wherein the VOC controls a further mixing of the audio content and the mixed signal delivered together to the ECR.

Assignments (11)
MERGER Recorded May 9, 2026
From: ST CASE1TECH, LLC; ST CASESTECH, LLC; ST FAMTECH, LLC; ST R&DTECH, LLC; ST TIPTECH, LLC; ST SEALTECH, LLC; ST BIOTECH, LLC; ST EARTECH, LLC; ST DETECTTECH, LLC; ST VRTECH, LLC; ST AWARETECH, LLC; CASES2TECH, LLC
To: ST PORTFOLIO HOLDINGS, LLC
Reel/Frame 075533/0472 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2024
From: ST PORTFOLIO HOLDINGS, LLC
To: ST R&DTECH, LLC
Reel/Frame 067806/0751 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2024
From: STATON TECHIYA, LLC
To: ST PORTFOLIO HOLDINGS, LLC
Reel/Frame 067806/0722 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNOR'S NAME PREVIOUSLY RECORDED ON REEL 042992 FRAME 0524. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF THE ENTIRE INTEREST AND GOOD WILL. Recorded Aug 1, 2017
From: DM STATON FAMILY LIMITED PARTNERSHIP, ASSIGNEE OF STATON FAMILY INVESTMENTS, LTD.
To: STATON TECHIYA, LLC
Reel/Frame 043393/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 042992 FRAME: 0493. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 1, 2017
From: PERSONICS HOLDINGS, INC.; PERSONICS HOLDINGS, LLC
To: DM STATON FAMILY LIMITED PARTNERSHIP, ASSIGNEE OF STATON FAMILY INVESTMENTS, LTD.
Reel/Frame 043392/0961 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2017
From: DM STATION FAMILY LIMITED PARTNERSHIP, ASSIGNEE OF STATON FAMILY INVESTMENTS, LTD.
To: STATON TECHIYA, LLC
Reel/Frame 042992/0524 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2017
From: PERSONICS HOLDINGS, INC.; PERSONICS HOLDINGS, LLC
To: DM STATION FAMILY LIMITED PARTNERSHIP, ASSIGNEE OF STATON FAMILY INVESTMENTS, LTD.
Reel/Frame 042992/0493 →
SECURITY INTEREST Recorded Nov 5, 2014
From: PERSONICS HOLDINGS, LLC
To: DM STATON FAMILY LIMITED PARTNERSHIP (AS ASSIGNEE OF MARIA B. STATON)
Reel/Frame 034170/0933 →
SECURITY INTEREST Recorded Nov 5, 2014
From: PERSONICS HOLDINGS, LLC
To: DM STATON FAMILY LIMITED PARTNERSHIP (AS ASSIGNEE OF MARIA B. STATON)
Reel/Frame 034170/0771 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2014
From: GOLDSTEIN, STEVEN WAYNE; USHER, JOHN; BOILLOT, MARC ANDRE
To: PERSONICS HOLDINGS, INC.
Reel/Frame 033615/0660 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2014
From: PERSONICS HOLDINGS, INC.
To: PERSONICS HOLDINGS, LLC
Reel/Frame 032189/0304 →