IP Library Granted Patent US 9,418,661
Granted Patent B2
US 9,418,661 · App. 14/116,965 · Granted Aug 16, 2016

Vehicle voice recognition systems and methods

Inventors: William Fay (Rockford, MI); Brian L. Douthitt (Holland, MI); David J. Hughes (Jenison, MI); Brian Hannum (Greenville, MI)
Assignee: Johnson Controls Technology Company
G10L15/28G10L15/01G10L15/22H04R1/08G10L15/222G10L2015/227H04R2499/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,418,661
App. No.
14/116,965
Granted
Aug 16, 2016
Kind
B2
Abstract

A voice recognition system includes a microphone for receiving speech from a user and processing electronics. The processing electronics are in communication with the microphone and are configured to use a plurality of rules to evaluate user interactions with the voice recognition system. The processing electronics automatically determine and set an expertise level in response to and based on the evaluation. The processing electronics are configured to automatically adjust at least one setting of the voice recognition system in response to the set expertise level.

Claims (47)

1. A voice recognition system, comprising:

a microphone configured to receive speech from a user and convert the speech to an audio speech signal; and

a voice recognition engine configured to:

cause a user expertise evaluator module to detect an indication of an expertise level of the audio speech signal received from the microphone;

set an expertise level for the user in a voice recognition setting database based on the indication of the expertise level;

retrieve an expertise-to-adjustment association from an expertise database;

automatically adjust a voice tree in a voice tree database based on applying the expertise-to-adjustment association to the expertise level for the user;

process the adjusted voice tree to generate a prompt in response to the received speech; and

output the prompt to the user.

2. The voice recognition system of claim 1 , wherein the voice recognition setting database and the voice tree database are located in non-volatile memory such that the setting of the expertise level and the adjustment to the voice tree span power cycles of the voice recognition system.

3. The voice recognition system of claim 2 , wherein the adjustment to the voice tree occurs without presenting the user a graphical user interface for making the adjustment and without receiving feedback from the user regarding the particular adjustment.

4. The voice recognition system of claim 3 , wherein the the user expertise evaluator module is further configured to detect the indication of an expertise level of the audio speech signal based on at least one of:

(a) user response time, (b) command recognition accuracy, (c) command concentration, (d) number of cancel operations requested by the user, (e) number of quit operations, (f) number of exit operations, (g) number of back operations, (h) timeouts, (i) number of affirmative confirmations, (j) number of negative confirmations, (k) false starts, (l) speed of speech of user, (m) volume of speech, (n) tone of speech, (o) use of barge-in, (p) low average recognition confidence, (q) percentage of rejected recognitions, (r) percentage of completed operations, (s) percentage of aborted operations, and (t) relative usage of a voice tree branch.

5. The voice recognition system of claim 4 , wherein the user expertise evaluator module is further configured to automatically detect the indication of an expertise level in response to the microphone receiving the audio speech signal.

6. The voice recognition system of claim 5 , wherein the expertise level is selected from a set of greater than two expertise levels.

7. The voice recognition system of claim 6 , wherein the voice recognition system is configured to determine a set of voice tree adjustments associated with each expertise level.

8. The voice recognition system of claim 7 , wherein the set of setting adjustments comprises at least one of:

an end of utterance timing adjustment,

a start of utterance timing adjustment,

a graphical user interface assistance adjustment,

an audio assistance adjustment, and

a rejection threshold level adjustment.

9. The voice recognition system of claim 1 , wherein the voice recognition system is configured to continuously receive an audio speech signal via the microphone and continuously operate the voice recognition engine in response to receiving the audio speech signal, and wherein the user expertise evaluator module is further configured to detect the indication of the expertise level using a plurality of rules that are a part of an expert system and/or a knowledge-based system.

10. A computerized method for personalizing a voice recognition system, comprising:

receiving, at a microphone of the voice recognition system, speech from a user;

converting, by the microphone, the speech to an audio speech signal;

causing, by a voice recognition engine of the voice recognition system, a user expertise evaluator module to detect an indication of an expertise level of the audio speech signal received from the microphone;

setting, by the voice recognition engine, an expertise level for the user in a voice recognition database based on the indication of the expertise level;

retrieving, by the voice recognition engine, an expertise-to-adjustment association from an expertise database;

automatically adjusting, by the voice recognition engine, a voice tree in a voice tree database based on applying the expertise-to-adjustment association to the expertise level for the user;

processing, by the voice recognition engine, the adjusted voice tree to generate a prompt in response to the received speech; and

outputting, by the voice recognition engine, the prompt to the user.

11. The method of claim 10 , wherein the voice recognition setting database and the voice tree database are located in non-volatile memory such that the adjustment setting of the expertise level and the adjustment to the voice tree span power cycles of the voice recognition system.

12. The method of claim 10 , wherein the adjustment to the voice tree occurs without presenting the user a graphical user interface for making the adjustment and without receiving feedback from the user regarding the particular adjustment.

13. The method of claim 12 , wherein the user expertise evaluator module is further configured to detect the indication of an expertise level of the audio speech signal based on at least one of:

(a) user response time, (b) command recognition accuracy, (c) command concentration, (d) number of cancel operations requested by the user, (e) number of quit operations, (f) number of exit operations, (g) number of back operations, (h) timeouts, (i) number of affirmative confirmations, (j) number of negative confirmations, (k) false starts, (l) speed of speech of user, (m) volume of speech, (n) tone of speech, (o) use of barge-in, (p) low average recognition confidence, (q) percentage of rejected recognitions, (r) percentage of completed operations, (s) percentage of aborted operations, and (t) relative usage of a voice tree branch.

14. The method of claim 13 , wherein the user expertise evaluator module is further configured to automatically detect the indication of an expertise level in response to the microphone receiving the audio speech signal.

15. The method of claim 14 , further comprising:

determining a set of voice tree adjustments in response setting the expertise level.

16. The method of claim 15 , wherein the expertise level is selected from a set of greater than two expertise levels.

17. The method of claim 16 , wherein the set of setting adjustments comprises at least one of:

an end of utterance timing adjustment,

a start of utterance timing adjustment,

a graphical user interface assistance adjustment,

an audio assistance adjustment, and

a rejection threshold level adjustment;

wherein the method further comprises continuously conducting the evaluation of the user interactions and wherein the plurality of rules are a part of an expert system or a knowledge-based system.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded Feb 4, 2022
From: JOHNSON CONTROLS TECHNOLOGY COMPANY
To: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
Reel/Frame 058959/0764 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2014
From: FAY, WILLIAM; DOUTHITT, BRIAN L.; HUGHES, DAVID J.; HANNUM, BRIAN
To: JOHNSON CONTROLS TECHNOLOGY CORPORATION
Reel/Frame 031899/0746 →
Continuity (2)
Provisional Application 61485346 · May 12, 2011
Related Publication 20150310865A1 · Oct 29, 2015