Transcription systems and related supplementation methods
Methods and systems are provided for assisting operation of a vehicle using speech recognition and transcription to provide a conversation log graphical user interface (GUI) display. One method involves analyzing a transcription of an audio communication depicted on the conversation log GUI display to identify an operational subject associated with the audio communication, obtaining supplemental information pertaining to the operational subject from a data source, generating, on the conversation log GUI display, a selectable GUI element associated with the supplemental information, and in response to user selection of the selectable GUI element, generating, on the display device, a graphical representation based at least in part on the supplemental information. In some implementations, a separate supplemental information GUI display is presented in lieu of the conversation log GUI display in response to selection of the selectable GUI element.
1 . A method comprising:
obtaining a transcription of an audio air traffic control (ATC) clearance communication with respect to an aircraft, the audio ATC clearance communication comprising an instruction or a request for the aircraft;
generating, on a display device onboard the aircraft, a graphical user interface (GUI) display comprising a graphical representation of the transcription of the audio ATC clearance communication;
analyzing the transcription to identify an operational subject associated with the audio ATC clearance communication related to a current operational context of the aircraft identified based on status information from one or more systems onboard the aircraft;
obtaining supplemental information pertaining to the operational subject from a data source onboard the aircraft different from the transcription of the audio ATC clearance communication, wherein the supplemental information is not included in the transcription of the audio ATC clearance communication;
generating, on the GUI display, a selectable GUI element associated with the graphical representation of the transcription of the audio ATC clearance communication, wherein the selectable GUI element is associated with the supplemental information; and
in response to user selection of the selectable GUI element, generating, within the GUI display on the display device, a graphical representation of the supplemental information associated with the audio ATC clearance communication and a second selectable GUI element to revert a state of the GUI display on the display device.
2 . The method of claim 1 , wherein generating the graphical representation of the supplemental information comprises generating a supplemental GUI display in lieu of a conversation log GUI display depicting the graphical representation of the transcription of the audio ATC clearance communication, wherein the supplemental GUI display includes the graphical representation of the supplemental information and the second selectable GUI element to revert the state of the GUI display on the display device to the conversation log GUI display.
3 . The method of claim 1 , wherein generating the graphical representation of the supplemental information comprises generating a supplemental GUI display including the graphical representation of the supplemental information within a conversation log GUI display.
4 . The method of claim 1 , wherein:
the data source comprises a navigation database;
obtaining the supplemental information comprises querying the navigation database to obtain navigational information associated with the operational subject; and
generating the graphical representation of the supplemental information comprises generating a navigational map pertaining to the operational subject using the navigational information.
5 . The method of claim 1 , wherein:
the data source comprises a flight management system (FMS) onboard the aircraft;
obtaining the supplemental information comprises querying the FMS to obtain flight plan information associated with the operational subject; and
generating the graphical representation of the supplemental information comprises generating a graphical representation based at least in part on the flight plan information.
6 . The method of claim 1 , wherein:
the data source comprises a traffic monitoring system onboard the aircraft;
obtaining the supplemental information comprises querying the traffic monitoring system to obtain traffic information associated with the operational subject; and
generating the graphical representation of the supplemental information comprises generating a graphical representation based at least in part on the traffic information.
7 . The method of claim 1 , wherein:
the operational subject comprises one of a runway, a taxiway, a waypoint, an avionics system, an avionics setting, an aircraft action and an aircraft parameter; and
the supplemental information is not included in the transcription of the audio ATC clearance communication.
8 . The method of claim 1 , wherein:
the supplemental information comprises real-time information associated with the operational subject; and
generating the graphical representation of the supplemental information comprises generating a graphical representation based at least in part on the real-time information.
9 . The method of claim 8 , wherein the data source comprises one of a pilot report (PIREP), a notice to airmen (NOTAM) and an automated terminal information service (ATIS).
10 . The method of claim 1 , further comprising generating, on the display device, a graphical indication of the data source associated with the supplemental information.
11 . The method of claim 1 , wherein:
analyzing the transcription comprises utilizing the current operational context to identify the operational subject consistent with the current operational context that is a subject of the audio ATC clearance communication;
obtaining the supplemental information comprises querying the data source using the operational subject of the audio ATC clearance communication as a search key to obtain the supplemental information;
the current operational context comprises at least one of a current flight phase, a current aircraft configuration, a current aircraft altitude, a current heading and a current speed of the aircraft; and
the operational subject comprises an airport, a runway, a taxiway, a waypoint, an avionics system, an avionics setting, an aircraft procedure or an aircraft action related to operation of the aircraft.
12 . The method of claim 1 , wherein:
the GUI display comprises a conversation log GUI display depicting the graphical representation of the transcription of the audio ATC clearance communication; and
generating the graphical representation of the supplemental information comprises:
generating a navigational map depicting at least one of the supplemental information and the operational subject on the display device in lieu of the conversation log GUI display in response to user selection of the selectable GUI element; and
reverting the state of the GUI display on the display device to the conversation log GUI display in response to second user selection of the second selectable GUI element.
13 . A computer-readable medium having computer-executable instructions stored thereon that, when executed by a processing system, cause the processing system to:
obtain a transcription of an audio air traffic control (ATC) clearance communication with respect to an aircraft, the audio ATC clearance communication comprising an instruction or a request for the aircraft;
generate, on a display device onboard the aircraft, a graphical user interface (GUI) display comprising a graphical representation of the transcription of the audio ATC clearance communication;
analyze the transcription to identify an operational subject associated with the audio ATC clearance communication related to a current operational context of the aircraft identified based on status information from one or more systems onboard the aircraft;
obtain supplemental information pertaining to the operational subject from a data source onboard the aircraft different from the transcription of the audio ATC clearance communication, wherein the supplemental information is not included in the transcription of the audio ATC clearance communication;
generate, on the GUI display, a selectable GUI element associated with the graphical representation of the transcription of the audio ATC clearance communication, wherein the selectable GUI element is associated with the supplemental information; and
in response to user selection of the selectable GUI element, generate, within the GUI display on the display device, a graphical representation of the supplemental information associated with the audio ATC clearance communication and a second selectable GUI element to revert a state of the GUI display on the display device.
14 . The computer-readable medium of claim 13 , wherein the computer-executable instructions cause the processing system to query the data source using identifying information associated with the operational subject to obtain the supplemental information from the data source.
15 . The computer-readable medium of claim 13 , wherein the computer-executable instructions cause the processing system to generate, on the display device, a supplemental GUI display in lieu of a conversation log GUI display depicting the graphical representation of the transcription of the audio ATC clearance communication, wherein the supplemental GUI display includes the graphical representation of the supplemental information and the second selectable GUI element to revert the state of the GUI display on the display device to the conversation log GUI display.
16 . The computer-readable medium of claim 15 , wherein the supplemental GUI display comprises a navigational map depicting at least one of the supplemental information and the operational subject.
17 . The computer-readable medium of claim 13 , wherein the computer-executable instructions cause the processing system to generate, on the display device, a supplemental GUI display within a conversation log GUI display, wherein the supplemental GUI display includes the graphical representation of the supplemental information.
18 . The computer-readable medium of claim 17 , wherein the computer-executable instructions cause the processing system to substitute the supplemental GUI display for the selectable GUI element in response to selection of the selectable GUI element.
19 . A system comprising:
a display device onboard an aircraft;
a data storage element to maintain a transcription of an audio air traffic control (ATC) clearance communication with respect to the aircraft, the audio ATC clearance communication comprising an instruction or a request for the aircraft; and
a processing system coupled to the display device and the data storage element to:
generate, on the display device, a graphical user interface (GUI) display comprising a graphical representation of the transcription of the audio ATC clearance communication;
analyze the transcription to identify an operational subject associated with the audio ATC clearance communication related to a current operational context of the aircraft identified based on status information from one or more systems onboard the aircraft;
obtain supplemental information pertaining to the operational subject from a data source coupled to the processing system, the data source being different from the data storage element, wherein the supplemental information is not included in the transcription of the audio ATC clearance communication;
generate, on the GUI display, a selectable GUI element associated with the graphical representation of the transcription of the audio ATC clearance communication, wherein the selectable GUI element is associated with the supplemental information; and
in response to user selection of the selectable GUI element, generate, within the GUI display on the display device, a graphical representation of the supplemental information associated with the audio ATC clearance communication and a second selectable GUI element to revert a state of the GUI display on the display device.
20 . The system of claim 19 , wherein the data source comprises at least one of a navigation database, a flight management system (FMS), a communications system, an avionics system, a pilot report (PIREP), a notice to airmen (NOTAM) and an automated terminal information service (ATIS).