Confirmation of speech commands for control of headset computers
Presented are improvements for speech recognition systems used to control devices. Features include two-stage confirmation, two-stage limited speech recognition mode, and two-stage wake-up for speech driven applications and systems. A headset computer device includes such staged confirmation operation.
1. A method of speech control in a computer application, comprising:
given a headset computer having a microphone and a display, receiving a sound input via the microphone;
processing the sound input using a speech recognition engine coupled to the headset computer;
interpreting the sound input to be a command;
assessing a level of criticality of an action associated with the command;
determining that the assessed level of criticality meets or exceeds a threshold level of criticality; and
in response to the determination that the assessed level of criticality meets or exceeds the threshold level of criticality:
(i) displaying a first dialog box on the display,
(ii) receiving via the microphone a first confirmatory utterance corresponding to a prompt in the first dialog box,
(iii) displaying a second dialog box on the display in response to the receipt of the first confirmatory utterance, and
(iv) conditioning headset computer performance of the action on a user making a second confirmatory utterance corresponding to a prompt in the second dialog box, wherein the displaying of the second dialog box is configured to automatically time out and the command is cancelled if a second confirmatory utterance is not received within a defined time period.
2. The method of claim 1 , wherein the displaying of the first dialog box is able to automatically time-out.
3. The method of claim 1 , wherein the command is a command for the headset computer to disengage from a low power sleep mode.
4. The method of claim 1 , wherein the command is a command for the headset computer to disengage from a limited speech recognition mode.
5. The method of claim 1 , wherein the first confirmatory utterance and the second confirmatory utterance are different from each other.
6. A speech control apparatus comprising:
given a headset computer having a display and a microphone configured to receive a sound input;
a speech recognition engine configured to interpret the sound input and as part of that interpretation determine whether the sound input is a command, assess a level of criticality of an action associated with the command, and determine that the assessed level of criticality meets or exceeds a threshold level of criticality; and
a processor communicatively coupled to the speech recognition engine, and in response to the determination by the speech recognition engine that the assessed level of criticality meets or exceeds the threshold level of criticality, configured to:
(i) display a first dialog box on the display,
(ii) receive via the microphone a first confirmatory utterance corresponding to a prompt in the first dialog box;
(iii) display a second dialog box on the display in response to the receipt of the first confirmatory utterance, and
(iv) condition headset computer performance of the action on a user making a second confirmatory utterance corresponding to a prompt in the second dialog box, wherein the displaying of the second dialog box is configured to automatically time out and the command is cancelled if a second confirmatory utterance is not received within a defined time period.
7. The apparatus of claim 6 , wherein the first dialog box is able to automatically time-out.
8. The apparatus of claim 6 , wherein the command is a command for the headset computer to disengage from a low power sleep mode.
9. The apparatus of claim 6 , wherein the command is a command for the headset computer to disengage from a limited speech recognition mode.
10. The apparatus of claim 6 , wherein the first confirmatory utterance and the second confirmatory utterance are different from each other.
11. A headset computer comprising:
a display;
a microphone receiving sound input;
a speech recognition engine configured to interpret the sound input and as part of that interpretation determine whether the sound input is a command, assess a level of criticality of an action associated with the command, and determine that the assessed level of criticality meets or exceeds a threshold level of criticality; and
a processor communicatively coupled to the speech recognition engine, and in response to the determination by the speech recognition engine that the assessed level of criticality meets or exceeds the threshold level of criticality, configured to:
(i) display a first dialog box on the display,
(ii) receive via the microphone a first confirmatory utterance corresponding to a prompt in the first dialog box;
(iii) display a second dialog box on the display in response to the receipt of the first confirmatory utterance, and
(iv) condition headset computer performance of the action on a user making a second confirmatory utterance corresponding to a prompt in the second dialog box, wherein the displaying of the second dialog box is configured to automatically time out and the command is cancelled if a second confirmatory utterance is not received within a defined time period.