Automatic speech recognition system and method for aircraft
A system and method which implement automatic speech recognition (ASR) and text-to-speech (TTS) programs to permit pilots, co-pilots, and other persons to more quickly and easily perform control and monitoring tasks on aircraft. The system may be used to automatically change the frequency of an aircraft radio when a pilot or co-pilot is instructed to do so by ATC.
1. A method of controlling functions of an aircraft, the method comprising the steps of:
initializing a speech recognition program;
receiving a keyword from a person on the aircraft;
providing a keyword confirmation if the keyword is recognized;
receiving a command from the person which relates to a request for a function;
using the speech recognition program to analyze at least a portion of the command to recognize a word or phrase corresponding to the function;
providing a command confirmation if the command is recognized; and
automatically performing the function.
2. The method as set forth in claim 1 , wherein the person is a pilot of the aircraft and the function is selected from the group consisting of: changing a frequency of a radio on the aircraft; setting a heading of the aircraft; setting an altitude of the aircraft; setting a holding pattern of the aircraft; alerting an Expect Further Clearance instruction; configuring an auto pilot of the aircraft; performing a checklist; setting an altimeter setting of the aircraft; setting an approach of the aircraft; setting an air speed of the aircraft; setting or changing a flight plan for the aircraft; drawing a VFR approach of the aircraft; setting a barometric pressure correction setting of the aircraft; and changing a navigation setting of the aircraft.
3. The method as set forth in claim 1 , further including the step of prompting the person to confirm that the word or phrase recognized by the speech recognition program does in fact correspond to the desired function.
4. The method as set forth in claim 3 , wherein the prompting step includes the steps of converting the recognized word or phrase to speech with a text-to-speech program and delivering the speech to the person.
5. The method as set forth in claim 1 , wherein the keyword and command are received with a microphone positioned in a cockpit of the aircraft.
6. The method as set forth in claim 5 , wherein the providing steps are performed with a speaker associated specifically with the microphone.
7. The method as set forth in claim 6 , wherein the microphone and speaker are part of a headset worn by a pilot of the aircraft.
8. The method as set forth in claim 1 , wherein the initializing step is triggered by an audio panel of the aircraft breaking squelch.
9. The method as set forth in claim 8 , wherein the audio panel delays the keyword while the audio panel is in the act of breaking squelch.
10. The method as set forth in claim 8 , wherein the audio panel monitors a background noise before breaking squelch and subtracts the background noise after breaking squelch.
11. The method as set forth in claim 1 , wherein before receiving the keyword, the speech recognition program operates with a limited grammar.
12. The method as set forth in claim 11 , wherein after receiving the keyword and before receiving the command, the speech recognition program switches from the limited grammar to a fuller grammar.
13. The method as set forth in claim 1 , wherein before receiving the keyword, the speech recognition program operates with a short trailing silence.
14. The method as set forth in claim 13 , wherein after receiving the keyword and before receiving the command, the speech recognition program switches from the short trailing silence to a long trailing silence.
15. A method of controlling functions of an aircraft, the method comprising the steps of:
initializing a speech recognition program with a first grammar and a first trailing silence;
receiving a keyword from a person on the aircraft;
providing a keyword confirmation and reconfiguring the speech recognition program to operate with a second grammar and a second trailing silence if the keyword is recognized;
receiving a command from the person which relates to a request for a function;
using the speech recognition program to analyze at least a portion of the command to recognize a word or phrase corresponding to the function;
providing a command confirmation if the command is recognized; and
automatically performing the function.
16. The method as set forth in claim 15 , wherein the person is a pilot of the aircraft and the function is selected from the group consisting of: changing a frequency of a radio on the aircraft; setting a heading of the aircraft; setting an altitude of the aircraft; setting a holding pattern of the aircraft; alerting an Expect Further Clearance instruction; configuring an auto pilot of the aircraft; performing a checklist; setting an altimeter setting of the aircraft; setting an approach of the aircraft; setting an air speed of the aircraft; setting or changing a flight plan for the aircraft; drawing a VFR approach of the aircraft; setting a barometric pressure correction setting of the aircraft; and changing a navigation setting of the aircraft.
17. The method as set forth in claim 15 , further including the step of prompting the person to confirm that the word or phrase recognized by the speech recognition program does in fact correspond to the desired function.
18. The method as set forth in claim 3 , wherein the prompting step includes the steps of converting the recognized word or phrase to speech with a text-to-speech program and delivering the speech to the person.
19. The method as set forth in claim 15 , wherein the initializing step is triggered by an audio panel of the aircraft breaking squelch.
20. The method as set forth in claim 19 , wherein the audio panel
before breaking squelch, monitors a background noise, and
after breaking squelch, subtracts the background noise and delays the keyword.