IP Library Granted Patent US 11,308,960
Granted Patent B2
US 11,308,960 · App. 16/824,308 · Granted Apr 19, 2022

Adapting an utterance cut-off period based on parse prefix detection

Inventors: Patricia Pozon Aguayo (Sunnyvale, CA); Jennifer Hee Young Zhang (Campbell, CA); Jonah Probell (Alviso, CA)
Assignee: SoundHound, Inc.
G10L15/22G10L15/05G10L15/1822G10L25/78G10L15/19G10L15/30G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,308,960
App. No.
16/824,308
Granted
Apr 19, 2022
Kind
B2
Abstract

A processing system detects a period of non-voice activity and compares its duration to a cutoff period. The system adapts the cutoff period based on parsing previously-recognized speech to determine, according to a model, such as a machine-learned model, the probability that the speech recognized so far is a prefix to a longer complete utterance. The cutoff period is longer when a parse of previously recognized speech has a high probability of being a prefix of a longer utterance.

Claims (28)

1. A method of adjusting a cut-off period for detecting an end of a sentence, the method comprising:

receiving a plurality of spoken words;

detecting periods of voice activity and periods of no voice activity within the plurality of spoken words;

parsing the plurality of spoken words according to a first grammar and a second grammar to determine whether the plurality of spoken words are a complete parse according to the first grammar and a prefix to another complete parse according to the second grammar;

accessing an NVAD cut-off period calculated from prior speech; and

scaling the NVAD cut-off period in accordance with a prefix hypothesis numerical score.

2. The method of claim 1 , further comprising producing the prefix hypothesis numerical score indicating a likelihood that the received plurality of spoken words is both: (a) the complete parse and (b) the prefix to the other complete parse.

3. The method of claim 2 , wherein producing the prefix hypothesis numerical score comprises analyzing natural grammar rules determining that the received plurality of spoken words is a complete parse prefix.

4. The method of claim 3 , wherein analyzing natural grammar rules comprises aggregating multiple grammar rules.

5. The method of claim 1 , wherein scaling the NVAD cut-off period in accordance with the prefix hypothesis numerical score comprises scaling the NVAD cut-off period based on the plurality of spoken words being the prefix to the other complete parse.

6. The method of claim 1 , wherein detecting periods of voice activity and periods of no voice activity within the plurality of spoken words comprises detecting inter-word pause lengths.

7. The method of claim 1 , further comprising computing an average phoneme rate from the periods of voice activity and the periods of no voice activity within the plurality of spoken words; and

wherein scaling the NVAD cut-off period comprises scaling the NVAD cut-off period based on the average phoneme rate and in accordance with the prefix hypothesis numerical score.

8. A system comprising:

a processor; and

system memory coupled to the processor and storing instructions configured to cause the processor to:

receive a plurality of spoken words;

detect periods of voice activity and periods of no voice activity within the plurality of spoken words;

parse the plurality of spoken words according to a first grammar and a second grammar to determine whether the plurality of spoken words are a complete parse according to the first grammar and a prefix to another complete parse according to the second grammar;

access an NVAD cut-off period calculated from prior speech; and

scale the NVAD cut-off period in accordance with a prefix hypothesis numerical score.

9. The system of claim 8 , further comprising instructions configured to produce the prefix hypothesis numerical score indicating a likelihood that the received plurality of spoken words is both: (a) the complete parse and (b) the prefix of the other complete parse.

10. The system of claim 9 , wherein instructions configured to produce the prefix hypothesis numerical score comprise instructions configured to analyze natural grammar rules to determine that the received plurality of spoken words is a complete parse prefix.

11. The system of claim 10 , wherein instructions configured to analyze natural grammar rules comprise instructions configured to aggregate multiple grammar rules.

12. The system of claim 8 , wherein instructions configured to scale the NVAD cut-off period in accordance with the prefix hypothesis numerical score comprise instructions configured to scale the NVAD cut-off period based on the plurality of spoken words being the prefix to the other complete parse.

13. The system of claim 8 , wherein instructions configured to detect periods of voice activity and periods of no voice activity within the plurality of spoken words comprise instructions configured to detect inter-word pause lengths.

14. The system of claim 8 , further comprising instructions configured to compute an average phoneme rate from the periods of voice activity and the periods of no voice activity within the plurality of spoken words; and

wherein instructions configured to scale the NVAD cut-off period comprise instructions configured to scale the NVAD cut-off period based on the average phoneme rate and in accordance with the prefix hypothesis numerical score.

Assignments (12)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Dec 3, 2024
From: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 069480/0312 →
SECURITY INTEREST Recorded Aug 9, 2024
From: SOUNDHOUND, INC.
To: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
Reel/Frame 068526/0413 →
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2024
From: ACP POST OAK CREDIT II LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
Reel/Frame 067698/0845 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: SOUNDHOUND AI IP HOLDING, LLC
To: SOUNDHOUND AI IP, LLC
Reel/Frame 064205/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2023
From: SOUNDHOUND, INC.
To: SOUNDHOUND AI IP HOLDING, LLC
Reel/Frame 064083/0484 →
RELEASE OF SECURITY INTEREST Recorded Apr 21, 2023
From: FIRST-CITIZENS BANK & TRUST COMPANY, AS AGENT
To: SOUNDHOUND, INC.
Reel/Frame 063411/0396 →
RELEASE OF SECURITY INTEREST Recorded Apr 19, 2023
From: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 063380/0625 →
SECURITY INTEREST Recorded Apr 17, 2023
From: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
To: ACP POST OAK CREDIT II LLC
Reel/Frame 063349/0355 →
CORRECTIVE ASSIGNMENT TO CORRECT THE COVER SHEET PREVIOUSLY RECORDED AT REEL: 056627 FRAME: 0772. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Apr 12, 2023
From: SOUNDHOUND, INC.
To: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
Reel/Frame 063336/0146 →
SECURITY INTEREST Recorded Jun 18, 2021
From: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 056627/0772 →
SECURITY INTEREST Recorded Apr 1, 2021
From: SOUNDHOUND, INC.
To: SILICON VALLEY BANK
Reel/Frame 055807/0539 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2020
From: ZHANG, JENNIFER HEE YOUNG; AGUAYO, PATRICIA POZON; PROBELL, JONAH
To: SOUNDHOUND, INC.
Reel/Frame 052171/0433 →
Continuity (2)
Continuation 15855908 · Dec 27, 2017
Related Publication 20200219513A1 · Jul 9, 2020
Cited By (4)
US 12,322,381 US 12,380,889 US 12,561,289 US 12,586,576