IP Library Granted Patent US 10,230,346
Granted Patent B2
US 10,230,346 · App. 13/346,719 · Granted Mar 12, 2019

Acoustic voice activity detection

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,230,346
App. No.
13/346,719
Granted
Mar 12, 2019
Kind
B2
Abstract

Techniques for acoustic voice activity detection (AVAD) is described, including detecting a signal associated with a subband from a microphone, performing an operation on data associated with the signal, the operation generating a value associated with the subband, and determining whether the value distinguishes the signal from noise by using the value to determine a signal-to-noise ratio and comparing the value to a threshold.

Claims (43)

1. A method, comprising:

receiving a plurality of signals associated with a plurality of subbands, each of the plurality of signals being associated with one of the plurality of subbands;

detecting, at an acoustic voice activity detector, a signal from an omnidirectional microphone;

performing an operation using the plurality of signals to determine a plurality of values, each of the plurality of values being a binary value associated with one of the plurality of signals;

comparing each of the plurality of values using autocorrelation and cross-correlation to determine whether speech is detected in the signal, and, if speech is detected in the signal and scratch noise is not detected in the signal, generating a first signal;

receiving, at a vibration voice activity detector, the signal and, a second signal generated by a skin surface microphone, and generating, by a contact detector that receives the first signal and the second signal, a third signal indicating that speech is detected if the second signal exceeds a threshold, the contact detector configured to determine a state of contact with a skin surface; and

generating a final voice activity detected signal indicating that speech is detected if either the first signal is generated, or the second signal is generated, or both.

2. The method of claim 1 , wherein each of the plurality of signals is associated with at least one of the plurality of subbands, the plurality of subbands being configured for a format frequency that corresponds to the speech.

3. The method of claim 1 , wherein the omnidirectional microphone comprises a dual omnidirectional microphone array.

4. The method of claim 1 , wherein each of the plurality of signals comprises a subbanded signal, the subbanded signal being used to evaluate a frequency range of substantially 0 to 1500 Hz.

5. The method of claim 1 , wherein the operation comprises generating a signal-to-noise ratio.

6. The method of claim 1 , wherein performing the operation further comprises:

determining a ratio;

referencing a threshold; and

comparing the ratio to the threshold to generate a result, the result being configured to indicate whether the speech is detected on one of the plurality of subbands.

7. The method of claim 1 , wherein at least two of the plurality of signals indicates detection of the speech.

8. A method, comprising:

receiving a plurality of signals, each of the plurality of signals being associated with one of a plurality of subbands;

detecting, at an acoustic voice activity detector, a signal from a microphone associated with an omnidirectional microphone array;

performing an operation using the plurality of signals to determine a binary value associated with each of the plurality of subbands;

performing another operation using the signal from the microphone associated with the omnidirectional microphone array after performing the operation;

evaluating, using autocorrelation and a cross-correlation, a result associated with the operation to determine if speech is detected, and, if speech is detected in the signal and scratch noise is not detected in the signal, generating a first signal;

comparing another result of the another operation to generate a ratio, the ratio being compared to a threshold to determine whether the signal is devoiced;

receiving, at a vibration voice activity detector, the first signal and a second signal generated by a skin surface microphone, and generating, by a contact detector that receives the first signal and the second signal, a third signal indicating that speech is detected if the second signal exceeds a threshold, the contact detector configured to determine a state of contact with a skin surface; and

generating a final voice activity detected signal indicating that speech is detected if either the first signal is generated, or the second signal is generated, or both.

9. The method of claim 8 , further comprising evaluating the binary value associated with each of the plurality of values to determine a final acoustic voice activity detector.

10. The method of claim 8 , wherein the microphone is an omnidirectional microphone.

11. The method of claim 8 , wherein the omnidirectional microphone array comprises a dual omnidirectional microphone array.

12. The method of claim 8 , wherein the microphone comprises a skin surface microphone.

13. A method, comprising:

detecting, at an acoustic voice activity detector, a signal associated with a subband from a microphone;

performing an operation on data associated with the signal, the operation generating a value associated with the subband;

determining whether the value distinguishes the signal from noise by using the value to determine a signal-to-noise ratio and comparing the value to a threshold;

comparing, using autocorrelation and cross-correlation, the value to a threshold to determine whether speech is detected, and, if speech is detected in the signal and scratch noise is not detected in the signal, generating a first signal;

receiving, at a vibration voice activity detector, the signal and a second signal generated by a skin surface microphone, and generating, by a contact detector that receives the first signal and the second signal, a third signal indicating that speech is detected if the second signal exceeds a threshold, the contact detector configured to determine a state of contact with a skin surface; and

generating a final voice activity detected signal indicating that speech is detected if either the first signal is generated, or the second signal is generated, or both.

14. The method of claim 13 , wherein the microphone comprises one or more omnidirectional microphones.

15. The method of claim 13 , further comprising determining a final acoustic voice activity detection value by comparing a plurality of values generated from a plurality of signals detected by the microphone.

16. The method of claim 15 , wherein speech is detected if two or more of the plurality of values are equal to or exceed a threshold configured to distinguish the signal from the noise.

17. The method of claim 13 , wherein speech is detected in the subband if the value is equal to or greater than a threshold configured to identify the signal.

18. The method of claim 13 , wherein the subband is configured to correspond to a format frequency used to distinguish the signal from noise.

19. The method of claim 13 , wherein the microphone comprises a dual omnidirectional microphone array.

20. The method of claim 13 , wherein the microphone comprises an omnidirectional microphone array.

Assignments (17)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2021
From: JI AUDIO HOLDINGS LLC
To: JAWBONE INNOVATIONS, LLC
Reel/Frame 056323/0728 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2021
From: JAWB ACQUISITION LLC
To: JI AUDIO HOLDINGS LLC
Reel/Frame 056320/0195 →
RELEASE OF SECURITY INTEREST Recorded Feb 2, 2021
From: BLACKROCK ADVISORS, LLC
To: ALIPHCOM (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
Reel/Frame 055207/0593 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT APPL. NO. 13/982,956 PREVIOUSLY RECORDED AT REEL: 035531 FRAME: 0554. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Nov 2, 2017
From: SILVER LAKE WATERMAN FUND, L.P., AS ADMINISTRATIVE AGENT
To: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
Reel/Frame 045167/0597 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 1, 2017
From: ALIPHCOM (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
To: JAWB ACQUISITION LLC
Reel/Frame 043746/0693 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2017
From: ALIPHCOM
To: ALIPHCOM (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
Reel/Frame 043711/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2017
From: ALIPHCOM, LLC
To: JAWB ACQUISITION, LLC
Reel/Frame 043638/0025 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2017
From: ALIPHCOM DBA JAWBONE
To: ALIPHCOM, LLC
Reel/Frame 043637/0796 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NO. 13870843 PREVIOUSLY RECORDED ON REEL 036500 FRAME 0173. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Jan 26, 2017
From: ALIPHCOM; MACGYVER ACQUISITION, LLC; ALIPH, INC.; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
To: BLACKROCK ADVISORS, LLC
Reel/Frame 041793/0347 →
SECURITY INTEREST Recorded Aug 27, 2015
From: ALIPHCOM; MACGYVER ACQUISITION LLC; ALIPH, INC.; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
To: BLACKROCK ADVISORS, LLC
Reel/Frame 036500/0173 →
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2015
From: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
To: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
Reel/Frame 035531/0419 →
SECURITY INTEREST Recorded Apr 28, 2015
From: ALIPHCOM; MACGYVER ACQUISITION LLC; ALIPH, INC.; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
To: BLACKROCK ADVISORS, LLC
Reel/Frame 035531/0312 →
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2015
From: SILVER LAKE WATERMAN FUND, L.P., AS ADMINISTRATIVE AGENT
To: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION, LLC
Reel/Frame 035531/0554 →
NOTICE OF SUBSTITUTION OF ADMINISTRATIVE AGENT IN PATENTS Recorded Dec 3, 2014
From: DBD CREDIT FUNDING LLC, AS RESIGNING AGENT
To: SILVER LAKE WATERMAN FUND, L.P., AS SUCCESSOR AGENT
Reel/Frame 034523/0705 →
PATENT SECURITY AGREEMENT Recorded Dec 4, 2013
From: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 031764/0100 →
SECURITY AGREEMENT Recorded Aug 8, 2013
From: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.
To: DBD CREDIT FUNDING LLC, AS ADMINISTRATIVE AGENT
Reel/Frame 030968/0051 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2012
From: JING, ZHINIAN
To: ALIPHCOM
Reel/Frame 028224/0906 →