IP Library Granted Patent US 10,984,783
Granted Patent B2
US 10,984,783 · App. 16/366,757 · Granted Apr 20, 2021

Spoken keyword detection based utterance-level wake on intent system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,984,783
App. No.
16/366,757
Granted
Apr 20, 2021
Kind
B2
Abstract

An embodiment of a wake-on-intent speech recognition device includes technology to detect one or more keywords in a digital representation of a spoken natural language utterance, determine an intent of the spoken natural language utterance based on the detected keywords, and provide the spoken natural language utterance to a speech recognition and interpretation system if the determined intent is to further process the spoken natural language utterance. Other embodiments are disclosed and claimed.

Claims (42)

1. An electronic system, comprising:

memory to store a digital representation of a spoken natural language utterance;

a processor coupled to the memory; and

logic coupled to the processor and the memory, the logic to:

detect one or more keywords in the stored representation of the spoken natural language utterance,

determine an intent of the spoken natural language utterance based on a sequence of detected non-keyphrase keywords in the spoken natural language utterance,

provide the spoken natural language utterance to a speech recognition and interpretation system if the determined intent is to further process the spoken natural language utterance, and

trigger the speech recognition and interpretation system prior to identification of an end of the spoken natural language utterance based on the sequence of detected non-keyphrase keywords.

2. The system of claim 1 , wherein the logic is further to:

classify the intent into one of three or more intent classifications based on detected keywords which are relevant to the intent.

3. The system of claim 2 , further comprising:

a neural network trained with an intent classification model communicatively coupled to the logic to classify the intent based on keyword speech information, keyword text information, and end of utterance information.

4. The system of claim 3 , wherein the keyword speech information includes one or more of phoneme information and acoustic spectrogram information.

5. The system of claim 1 , wherein the logic is further to:

segment a detected keyword sequence from the spoken natural language utterance; and

convert speech words from the segmented keywords to a corresponding Mel-Scale Frequency Cepstral Coefficients feature vector sequence, a phoneme level sequence, and word level vectors that represent the detected keyword sequence.

6. A method of waking on intent, comprising:

detecting one or more keywords in a digital representation of a spoken natural language utterance;

determining an intent of the spoken natural language utterance based on a sequence of detected non-keyphrase keywords in the spoken natural language utterance;

providing the spoken natural language utterance to a speech recognition and interpretation system if the determined intent is to further process the spoken natural language utterance; and

triggering the speech recognition and interpretation system prior to identification of an end of the spoken natural language utterance based on the sequence of detected non-keyphrase keywords.

7. The method of claim 6 , further comprising:

classifying the intent into one of three or more intent classifications based on detected keywords which are relevant to the intent.

8. The method of claim 7 , further comprising:

providing keyword speech information, keyword text information, and end of utterance information to a neural network trained with an intent classification model to classify the intent.

9. The method of claim 8 , wherein the keyword speech information includes one or more of phoneme information and acoustic spectrogram information.

10. The method of claim 6 , further comprising:

segmenting a detected keyword sequence from the spoken natural language utterance; and

converting speech words from the segmented keywords to a corresponding Mel-Scale Frequency Cepstral Coefficients feature vector sequence, a phoneme level sequence, and word level vectors that represent the detected keyword sequence.

11. At least one non-transitory machine readable medium comprising a plurality of instructions that, in response to being executed on a computing device, cause the computing device to:

detect one or more keywords in a digital representation of a spoken natural language utterance;

determine an intent of the spoken natural language utterance based on a sequence of detected non-keyphrase keywords in the spoken natural language utterance;

provide the spoken natural language utterance to a speech recognition and interpretation system if the determined intent is to further process the spoken natural language utterance; and

trigger the speech recognition and interpretation system prior to identification of an end of the spoken natural language utterance based on the sequence of detected non-keyphrase keywords.

12. The at least one non-transitory machine readable medium of claim 11 , comprising a plurality of further instructions that, in response to being executed on the computing device, cause the computing device to:

classify the intent into one of three or more intent classifications based on detected keywords which are relevant to the intent.

13. The at least one non-transitory machine readable medium of claim 12 , comprising a plurality of further instructions that, in response to being executed on the computing device, cause the computing device to:

provide keyword speech information, keyword text information, and end of utterance information to a neural network trained with an intent classification model to classify the intent.

14. The at least one non-transitory machine readable medium of claim 13 , wherein the keyword speech information includes one or more of phoneme information and acoustic spectrogram information.

15. The at least one non-transitory machine readable medium of claim 11 , comprising a plurality of further instructions that, in response to being executed on the computing device, cause the computing device to:

segment a detected keyword sequence from the spoken natural language utterance; and

convert speech words from the segmented keywords to a corresponding Mel-Scale Frequency Cepstral Coefficients feature vector sequence, a phoneme level sequence, and word level vectors that represent the detected keyword sequence.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2022
From: INTEL CORPORATION
To: TAHOE RESEARCH, LTD.
Reel/Frame 061175/0176 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2019
From: CHEN, WENDA; HUANG, JONATHAN; BOCKLET, TOBIAS; GEORGES, MUNIR
To: INTEL CORPORATION
Reel/Frame 048882/0869 →