IP Library › Granted Patent US 10,297,159
Granted Patent B2
US 10,297,159 · App. 15/461,877 · Granted May 21, 2019

Systems and methods for graphical visualization of communication transmissions received onboard an aircraft

Inventors: Amit Srivastav (Karnataka, IN); Jinming Huang (Beijing, CN); Krishna Idupunur (Andhra Pradesh, IN); Murali Kusuma (Andhra Pradesh, IN)
Assignee: HONEYWELL INTERNATIONAL INC.
G08G5/0021G06T17/05G06T19/006G08G5/0013G08G5/0065G08G5/025G08G5/065G10L15/265H04B7/18506B64D2045/0075
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,297,159
App. No.
15/461,877
Filed
Mar 17, 2017
Granted
May 21, 2019
Kind
B2
Art Unit
3661
USPC
701/3
Abstract

A method for providing air traffic control (ATC) message data onboard an aircraft is provided. The method identifies ATC commands associated with text-based messages, by at least one processor onboard the aircraft, wherein the ATC commands comprise instructions to follow one or more particular procedures associated with the ATC audio messages and the ATC direct text messages; identifies, by the at least one processor, graphical content associated with the ATC commands; and presents an ATC graphical rendering environment comprising at least the graphical content, via at least one aircraft onboard display communicatively coupled to the at least one processor.

Claims (69)

1. A method for providing air traffic control (ATC) message data onboard an aircraft, the method comprising:

identifying ATC commands associated with text-based messages, by at least one processor onboard the aircraft, wherein the ATC commands comprise instructions to follow one or more particular procedures associated with ATC audio messages and ATC direct text messages;

identifying graphical content associated with the ATC commands, by the at least one processor, by:

identifying one or more locations of a map associated with the ATC commands, using an airport mapping database, aircraft parameters, and navigation data;

selecting three-dimensional models relevant to the ATC commands, wherein the three-dimensional models are associated with the one or more locations; and

positioning the three-dimensional models in an ATC graphical rendering environment, for presentation via the at least one aircraft onboard display, by:

applying efficient rendering techniques to the ATC graphical rendering environment, the efficient rendering techniques comprising at least bill-boarding;

associating temporality information with the three-dimensional models in the ATC graphical rendering environment based on the ATC commands and surface movement of the aircraft inside an airport;

generating six degrees of freedom data for trajectory information of the three-dimensional models; and

presenting the ATC graphical rendering environment using the efficient rendering techniques, the temporality information, and the six degrees of freedom data;

wherein the graphical content comprises at least the three-dimensional models positioned in the ATC graphical rendering environment and

presenting the ATC graphical rendering environment comprising at least the graphical content, via at least one aircraft onboard display communicatively coupled to the at least one processor.

2. The method of claim 1 , further comprising:

receiving the ATC audio messages and the ATC direct text messages, by the at least one processor via a wireless communication device; and

converting, by the at least one processor, the ATC audio messages into a plurality of text messages;

wherein the text-based messages comprise the ATC direct text messages and the plurality of text messages.

3. The method of claim 1 , wherein identifying the ATC commands associated with the text-based messages, further comprises:

comparing the text-based messages to a predefined set of ATC phraseology, to generate a comparison result; and

identifying ATC relevant text, based on the comparison result, wherein the ATC commands comprise the ATC relevant text.

4. The method of claim 1 , further comprising:

obtaining a video feed for presentation inside the aircraft to provide additional outside visibility, via a camera mounted on an external surface of the aircraft; and

presenting the video feed via the at least one aircraft onboard display, wherein the ATC graphical rendering environment includes the video feed.

5. The method of claim 1 , wherein the at least one aircraft onboard display comprises at least one of an electronic flight bag (EFB) display and a cockpit integrated display unit.

6. The method of claim 1 , wherein the ATC graphical rendering environment comprises at least one of an augmented reality display, a virtual reality display, and an aircraft map display; and

wherein presentation of the ATC graphical rendering environment includes presenting at least a top view and a three-dimensional view.

7. A system for providing air traffic control (ATC) message data onboard an aircraft, the system comprising:

system memory;

at least one communication device, configured to receive ATC audio messages and ATC direct text messages;

at least one aircraft onboard display configured to present graphical content associated with the ATC audio messages and the ATC direct text messages; and

at least one processor communicatively coupled to the system memory, the at least one communication device, and the at least one aircraft onboard display, the at least one processor configured to:

identify ATC commands associated with text-based messages, wherein the ATC commands comprise instructions to follow one or more particular procedures associated with the ATC audio messages and the ATC direct text messages;

identify graphical content associated with the ATC commands, by:

identifying one or more locations of an airport map or a geographical map associated with the ATC commands, using an airport mapping database, aircraft parameters, and navigation data;

selecting three-dimensional models relevant to the ATC commands, wherein the three-dimensional models are associated with the one or more locations; and

positioning the three-dimensional models in an ATC graphical rendering environment, for presentation via the at least one aircraft onboard display, by;

applying efficient rendering techniques to the ATC graphical rendering environment, the efficient rendering techniques comprising at least bill-boarding;

associating temporality information with the three-dimensional models in the ATC graphical rendering environment based on the ATC commands and surface movement of the aircraft inside an airport;

generating six degrees of freedom data for trajectory information of the three-dimensional models; and

presenting the ATC graphical rendering environment using the efficient rendering techniques, the temporality information, and the six degrees of freedom data; and

initiate presentation of the ATC graphical rendering environment comprising at least the graphical content, via the at least one aircraft onboard display.

8. The system of claim 7 , wherein the at least one processor is further configured to:

receive the ATC audio messages and ATC direct text messages, via the at least one communication device; and

convert the ATC audio messages into a plurality of text messages;

wherein the text-based messages comprise the ATC direct text messages and the plurality of text messages.

9. The system of claim 7 , wherein the at least one processor is configured to identify the ATC commands associated with received text messages, by:

comparing the text-based messages to a predefined set of ATC phraseology, to generate a comparison result; and

identifying ATC relevant text, based on the comparison result, wherein the ATC commands comprise the ATC relevant text.

10. The system of claim 7 , further comprising a camera mounted on an external surface of the aircraft, communicatively coupled to the at least one processor;

wherein the at least one processor is further configured to:

obtain a video a video feed for presentation inside the aircraft to provide additional outside visibility; and

initiate presentation of the video feed and the ATC graphical rendering environment, via the at least one aircraft onboard display.

11. The system of claim 7 , wherein the at least one aircraft onboard display comprises at least one of an electronic flight bag (EFB) display and a cockpit integrated display unit.

12. The system of claim 7 , wherein the ATC graphical rendering environment comprises at least one of an augmented reality environment and a virtual reality environment; and

wherein presentation of the ATC graphical rendering environment includes presenting at least a top view and a three-dimensional view.

13. A non-transitory, computer-readable medium containing instructions thereon, which, when executed by a processor, perform a method comprising:

identifying graphical content associated with a set of text messages associated with air traffic control (ATC) commands received onboard an aircraft, by the processor, by:

identifying one or more locations of an airport map or a geographical map associated with the ATC commands, using an airport mapping database, aircraft parameters, and navigation data;

selecting three-dimensional models relevant to the ATC commands, wherein the three-dimensional models are associated with the one or more locations; and

positioning the three-dimensional models in the ATC graphical rendering environment, for presentation via the at least one aircraft onboard display, by:

applying efficient rendering techniques to the ATC graphical rendering environment, the efficient rendering techniques comprising at least bill-boarding;

associating temporality information with the three-dimensional models in the ATC graphical rendering environment based on the ATC commands and surface movement of the aircraft inside an airport;

generating six degrees of freedom data for trajectory information of the three-dimensional models; and

presenting the ATC graphical rendering environment using the efficient rendering techniques, the temporality information, and the six degrees of freedom data;

wherein the ATC commands comprise instructions to follow one or more particular procedures associated with ATC audio messages and ATC direct text messages; and

presenting an ATC graphical rendering environment including the graphical content, via a display device communicatively coupled to the processor, wherein the ATC graphical rendering environment comprises at least one of an augmented reality display, a virtual reality display, an aircraft map display, an en route terrain display, and an obstacle display.

14. The non-transitory, computer-readable medium of claim 13 , further comprising:

receiving the ATC audio messages and the ATC direct text messages, by the processor via at least one communication device; and

converting, by the processor, the ATC audio messages into a plurality of text messages;

wherein the set of text messages comprises the ATC direct text messages and the plurality of text messages.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2017
From: SRIVASTAV, AMIT; HUANG, JINMING; IDUPUNUR, KRISHNA; KUSUMA, MURALI
To: HONEYWELL INTERNATIONAL INC.
Reel/Frame 041613/0826 →
Continuity (1)
Related Publication 20180268718A1 · Sep 20, 2018
Cited By (4)
US 12,254,282 US 12,304,648 US 12,306,007 US 12,682,763