System and/or method for semantic parsing of air traffic control audio
The method S 200 can include: at an aircraft, receiving an audio utterance from air traffic control S 210 , converting the audio utterance to text, determining commands from the text using a question-and-answer model S 240 , and optionally controlling the aircraft based on the commands S 250 . The method functions to automatically interpret flight commands from the air traffic control (ATC) stream.
1. A system for an aircraft for semantic parsing of air traffic control (ATC) utterances, the system comprising:
a communication system onboard the aircraft;
a computing system communicatively coupled to the communication system and configured to receive an ATC audio signal from the communication system, the computing system comprising:
a speech-to-text module configured to determine an utterance transcript from the ATC audio signal; and
a question-and-answer (Q/A) module configured to determine aircraft commands by parsing the utterance transcript with a pre-trained neural network model according to a sequence of natural language queries; and
a second computing system connected to the computing system and configured to control the aircraft based on the aircraft commands, wherein each of the aircraft commands comprises a value for at least one of a predetermined set of command parameters.
2. The system of claim 1 , wherein the ATC utterances are syntactically non-standardized, wherein the computing system is configured to automatically provide the commands to the second computing system in a standardized format.
3. The system of claim 1 , wherein the pre-trained neural network model is tuned with ATC audio.
4. The system of claim 1 , wherein the sequence comprises a tree-based sequence with a plurality of dependencies linking one or more natural language queries to a determination that the aircraft is an intended recipient of an utterance corresponding to the utterance hypothesis.
5. The system of claim 1 , wherein the utterance transcript comprises a text hypothesis.
6. A system for an aircraft for semantic parsing of air traffic control (ATC) utterances, the system comprising:
a communication system onboard the aircraft;
a computing system communicatively coupled to the communication system and configured to receive an ATC audio signal from the communication system, the computing system comprising:
a speech-to-text module configured to determine an utterance hypothesis from the ATC audio signal comprising a first pre-trained neural network; and
a question-and-answer (Q/A) module configured to determine aircraft commands based on the utterance hypothesis using a plurality of natural language queries; and
a second computing system connected to the computing system and configured to control the aircraft based on the aircraft commands, wherein each of the aircraft commands comprises a value for at least one of a predetermined set of command parameters.
7. The system of claim 6 , wherein the utterance hypothesis comprises a boundary hypothesis, wherein the first pre-trained neural network is further configured to tag entities within the ATC audio signal and generate the boundary hypothesis based on the tagged entities.
8. A method for semantic parsing of air traffic control (ATC) utterances for an aircraft, the method comprising:
receiving an ATC audio signal;
determining an utterance hypothesis from the ATC audio signal;
querying a pre-trained neural network model to parse the utterance hypothesis according to a sequence of the natural language queries; and
based on the sequence of natural language queries, determining a set of aircraft commands associated with the utterance hypothesis, wherein each of the aircraft commands comprises a value for at least one of a predetermined set of command parameters.
9. The method of claim 8 , wherein the pre-trained neural network model is ATC-tuned.
10. The method of claim 8 , wherein the sequence comprises a tree-based sequence with a plurality of dependencies linking one or more natural language queries to an initial query.
11. The method of claim 8 , wherein the utterance hypothesis comprises a text transcript.
12. The method of claim 8 , wherein the utterance hypothesis is determined based on an ATC-tuned language model.
13. The method of claim 12 , wherein the utterance hypothesis is further determined using automatic speech recognition (ASR).
14. The method of claim 12 , wherein the utterance hypothesis is further determined using sentence boundary detection (SBD).
15. The method of claim 8 , wherein each aircraft command further comprises a command parameter, wherein the value corresponds to the command parameter, wherein the command parameter is selected from a predetermined set of command parameters, wherein the value and the command parameter are determined via distinct natural language queries of the sequence.
16. A method for semantic parsing of air traffic control (ATC) utterances for an aircraft, the method comprising:
receiving an ATC audio signal;
determining an utterance hypothesis from the ATC audio signal;
querying a pre-trained neural network model to parse the utterance hypothesis according to a sequence of the natural language queries; and
based on the sequence of natural language queries, determining a set of aircraft commands associated with the utterance hypothesis, wherein each aircraft command comprises a command parameter and a set of values corresponding to the command parameter, wherein the command parameter is selected from a predetermined set of command parameters, wherein the set of values and the command parameter are determined via distinct natural language queries of the sequence.