IP Library Granted Patent US 11,862,162
Granted Patent B2
US 11,862,162 · App. 17/698,623 · Granted Jan 2, 2024

Adapting an utterance cut-off period based on parse prefix detection

Inventors: Patricia Pozon Aguayo (Sunnyvale, CA); Jennifer Hee Young Zhang (Campbell, CA); Jonah Probell (Alviso, CA)
Assignee: SoundHound, Inc.
G10L15/22G10L15/05G10L15/1822G10L25/78G10L15/19G10L15/30G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,862,162
App. No.
17/698,623
Granted
Jan 2, 2024
Kind
B2
Abstract

A processing system detects a period of non-voice activity and compares its duration to a cutoff period. The system adapts the cutoff period based on parsing previously-recognized speech to determine, according to a model, such as a machine-learned model, the probability that the speech recognized so far is a prefix to a longer complete utterance. The cutoff period is longer when a parse of previously recognized speech has a high probability of being a prefix of a longer utterance.

Claims (33)

1. A method comprising:

detecting periods of voice activity and periods of no voice activity within a plurality of spoken words;

parsing the plurality of spoken words according to a first grammar and a second grammar determining whether the plurality of spoken words is a complete parse according to the first grammar and a prefix to another complete parse according to the second grammar;

accessing a no voice activity detection (NVAD) cut-off period calculated from prior speech; and

scaling the NVAD cut-off period, which prevents pre-mature cutting off slow voice activity and improves responsiveness to fast voice activity, based at least in part on determining whether the plurality of spoken words is a complete parse according to the first grammar and a prefix to another complete parse according to the second grammar.

2. The method of claim 1 , wherein parsing the plurality of spoken words according to a first grammar and a second grammar comprises producing a prefix hypothesis numerical score indicating a likelihood that the plurality of spoken words is both: (a) the complete parse and (b) the prefix to another complete parse and wherein scaling the NVAD cut-off period comprises scaling the NVAD cut-off period in accordance with the prefix hypothesis numerical score.

3. The method of claim 2 , wherein producing the prefix hypothesis numerical score comprises analyzing natural grammar rules determining that the plurality of spoken words is a complete parse prefix.

4. The method of claim 3 , wherein analyzing natural grammar rules comprises aggregating grammar rules from the first grammar and the second grammar.

5. The method of claim 2 , wherein scaling the NVAD cut-off period is based on the plurality of spoken words being a complete parse prefix.

6. The method of claim 1 , wherein detecting periods of voice activity and periods of no voice activity within the plurality of spoken words comprises detecting inter-word pause lengths.

7. The method of claim 1 , further comprising:

computing an average phoneme rate from the periods of voice activity and the periods of no voice activity within the plurality of spoken words; and

scaling the NVAD cut-off period based on the average phoneme rate.

8. A system comprising:

a processor; and

system memory coupled to the processor and storing instructions configured to cause the processor to:

detect periods of voice activity and periods of no voice activity within a plurality of spoken words;

parse the plurality of spoken words according to a first grammar and a second grammar determining whether the plurality of spoken words is a complete parse according to the first grammar and a prefix to another complete parse according to the second grammar;

access a no voice activity detection (NVAD) cut-off period calculated from prior speech; and

scale the NVAD cut-off period, which prevents pre-mature cutting off slow voice activity and improves responsiveness to fast voice activity, based at least in part on determining whether the plurality of spoken words is a complete parse according to the first grammar and a prefix to another complete parse according to the second grammar.

9. The system of claim 8 , wherein instructions configured to parse the plurality of spoken words according to a first grammar and a second grammar comprise instructions configured to produce a prefix hypothesis numerical score indicating a likelihood that the plurality of spoken words is both: (a) the complete parse and (b) the prefix to another complete parse, and wherein instructions configured to scale the NVAD cut-off period is in accordance with the prefix hypothesis numerical score.

10. The system of claim 9 , wherein instructions configured to produce the prefix hypothesis numerical score comprise instructions configured to analyze natural grammar rules determining that the plurality of spoken words is a complete parse prefix.

11. The system of claim 10 , wherein instructions configured to analyze natural grammar rules comprise instructions configured to aggregate grammar rules from the first grammar and the second grammar.

12. The system of claim 9 , wherein instructions configured to scale the NVAD cut-off period comprise instructions configured to scale the NVAD cut-off period based on the plurality of spoken words being a complete parse prefix.

13. The system of claim 8 , wherein instructions configured to detect periods of voice activity and periods of no voice activity within the plurality of spoken words comprise instructions configured to detect inter-word pause lengths.

14. The system of claim 8 , further comprising instructions configured to:

compute an average phoneme rate from the periods of voice activity and the periods of no voice activity within the plurality of spoken words; and

scale the NVAD cut-off period based on the average phoneme rate.

15. A method for adjusting a no voice activity detection (NVAD) cut-off period of an interface device that detects a plurality of spoken words and voice activities, the method comprising:

detecting periods of voice activity and periods of no voice activity within the plurality of spoken words;

parsing the plurality of spoken words according to a first grammar and a second grammar to determine if the plurality of spoken words is a complete parse according to the first grammar and a prefix to another complete parse according to the second grammar;

accessing the NVAD cut-off period calculated from a prior voice activity; and

generating a new NVAD cut-off period, which prevents cut-off of slow voice activity and improves response time to fast voice activity, by scaling the NVAD cut-off period based at least in part on determining if the plurality of spoken words is a complete parse according to the first grammar and a prefix to another complete parse according to the second grammar.

Assignments (7)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Dec 3, 2024
From: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 069480/0312 →
SECURITY INTEREST Recorded Aug 9, 2024
From: SOUNDHOUND, INC.
To: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
Reel/Frame 068526/0413 →
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2024
From: ACP POST OAK CREDIT II LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
Reel/Frame 067698/0845 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: SOUNDHOUND AI IP HOLDING, LLC
To: SOUNDHOUND AI IP, LLC
Reel/Frame 064205/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2023
From: SOUNDHOUND, INC.
To: SOUNDHOUND AI IP HOLDING, LLC
Reel/Frame 064083/0484 →
SECURITY INTEREST Recorded Apr 17, 2023
From: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
To: ACP POST OAK CREDIT II LLC
Reel/Frame 063349/0355 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2022
From: HEE YOUNG ZHANG, JENNIFER; POZON AGUAYO, PATRICIA; PROBELL, JONAH
To: SOUNDHOUND, INC.
Reel/Frame 059311/0747 →
Cited By (1)
US 12,586,576