IP Library Granted Patent US 10,963,133
Granted Patent B2
US 10,963,133 · App. 14/149,575 · Granted Mar 30, 2021

Enhanced awareness of obstacle proximity

Inventors: Pamela Mannon (Snohomish, WA); Ratan Khatwa (Sammamish, WA)
Assignee: Honeywell International Inc.
G06F3/0484G01C23/00G01S7/22G01S7/24G01S13/931G08G5/0021G08G5/0078G08G5/045G08G5/065G01S13/934G06F2203/04806G08G5/0008G08G5/0013G08G5/0082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,963,133
App. No.
14/149,575
Granted
Mar 30, 2021
Kind
B2
Abstract

In some examples, a ground obstacle detection system of an aircraft is configured to generate and display a graphical user interface (GUI) that includes a graphical representation of a detected obstacle with which the aircraft may collide during a ground operation and an indication of an area of unknown associated with the detected obstacle. Instead of, in addition to, a GUI that includes an indication of an area of unknown associated with an obstacle, in some examples, a ground obstacle detection system to generate a GUI that includes at least two windows that present different views of an aircraft. At least one of the windows may include a graphical representation of an obstacle that may not be visible in the view of another window.

Claims (84)

1. A method comprising:

determining, by a processor, a location of an obstacle proximate an aircraft during a ground operation of the aircraft;

after determining the location of the obstacle, generating, by the processor, a graphical user interface based on the determined location of the obstacle, the graphical user interface comprising:

a first window including a first graphical representation of the aircraft representing a first top plan view of at least part of the aircraft, and

a second window including a second graphical representation of the aircraft representing a second top plan view of at least part of the aircraft, the second graphical representation of the aircraft representing a different view of the aircraft than the first graphical representation, wherein the second window is inset in the first window, and wherein at least one of the first or second windows includes a graphical representation of the obstacle;

determining a distance of the obstacle relative to the aircraft; and

presenting, by the processor during the ground operation of the aircraft, the graphical user interface to a flight crew of the aircraft via a display,

wherein the at least one of the first or second windows comprises the graphical representation of the obstacle positioned relative to the respective graphical representation of the aircraft to indicate the distance and an angular position of the obstacle relative to the aircraft, and

wherein generating the graphical user interface comprises selecting a first shape or a second shape for the graphical representation of the obstacle based on the distance, wherein the first shape is associated with a first distance and the second shape is associated with a second distance.

2. The method of claim 1 , wherein the second graphical representation of the aircraft represents at least one of a larger scale view of the aircraft than the first graphical representation or at least a different portion of the aircraft than the first graphical representation of the aircraft.

3. The method of claim 1 , wherein the graphical user interface comprises a first graphical user interface, the method further comprising:

generating, by the processor, a second graphical user interface including a third graphical representation of the aircraft, wherein the third graphical representation of the aircraft represents a smaller scale view of the aircraft than the first graphical representation of the aircraft;

presenting, by the processor, the second graphical user interface via the display;

after presenting the second graphical user interface, receiving, by the processor, user input; and

in response to receiving the user input, presenting, by the processor, the first graphical user interface via the display.

4. The method of claim 1 , wherein the graphical user interface comprises a first graphical user interface, the method further comprising:

generating, by the processor, a second graphical user interface including a third graphical representation of the aircraft, wherein the third graphical representation of the aircraft represents a smaller scale view of the aircraft than the first graphical representation of the aircraft;

presenting, by the processor, the second graphical user interface via the display;

after presenting the second graphical user interface, receiving, by the processor, user input indicating a zoom request;

determining, by the processor, whether the user input is indicative of a first level of zoom or a second level of zoom;

in response to determining the user input is indicative of a first level of zoom, presenting, by the processor, a third graphical user interface via the display, the third graphical user interface comprising a fourth graphical representation of the aircraft, wherein the fourth graphical representation of the aircraft represents a larger scale view of the aircraft associated with the first level of zoom; and

in response to determining the user input is indicative of a second level of zoom, presenting, by the processor, the first graphical user interface via the display, wherein the first graphical representation of the aircraft represents a larger scale of the aircraft associated with the second level of zoom.

5. The method of claim 1 , wherein the graphical user interface comprises a first graphical user interface, the method further comprising:

generating, by the processor, a second graphical user interface including the first window and not the second window;

presenting, by the processor, the second graphical user interface via the display;

after presenting the second graphical user interface, detecting, by the processor, the obstacle proximate the aircraft; and

in response to detecting the obstacle, presenting by the processor, the first graphical user interface including the first window and the second window via the display.

6. The method of claim 1 , wherein generating the graphical user interface comprises:

determining, by the processor, a threat level of the obstacle based on the location of the obstacle; and

generating, by the processor, the graphical representation of the obstacle to include a characteristic that represents the determined threat level of the at least one of the obstacle or an area of unknown.

7. The method of claim 1 ,

wherein the first window shows a view of the aircraft in which the obstacle is not visible,

wherein the second window comprises the graphical representation of the obstacle, and

wherein generating the graphical user interface comprises generating the graphical user interface comprising the second window that includes a visual indication of at least one of a location of the obstacle relative to the aircraft or the distance of the obstacle relative to the aircraft.

8. The method of claim 1 ,

wherein generating the graphical user interface further comprises selecting a first characteristic or a second characteristic for the graphical representation of the obstacle based on the distance, wherein the first and second characteristic each comprise at least one of a color, a shading, or a line pattern of the graphical representation of the obstacle, and

wherein the first characteristic is associated with a first distance and the second characteristic is associated with a second distance.

9. A system comprising:

a display; and

a processor configured to:

determine a location of an obstacle proximate an aircraft during a ground operation of the aircraft,

after determining the location of the obstacle, generate a graphical user interface based on the determined location of the obstacle,

determine a distance of the obstacle relative to the aircraft, and

present, during the ground operation of the aircraft, the graphical user interface to a flight crew of the aircraft via the display, the graphical user interface comprising:

a first window including a first graphical representation of the aircraft representing a first top plan view of at least part of the aircraft, and

a second window including a second graphical representation of the aircraft representing a second top plan view of at least part of the aircraft, the second graphical representation of the aircraft representing a different view of the aircraft than the first graphical representation, wherein the second window is inset in the first window, and wherein at least one of the first or second windows includes a graphical representation of the obstacle,

wherein the at least one of the first or second windows comprises the graphical representation of the obstacle positioned relative to the respective graphical representation of the aircraft to indicate the distance and an angular position of the obstacle relative to the aircraft, and

wherein the processor is configured to generate the graphical user interface by at least selecting a first shape or a second shape for the graphical representation of the obstacle based on the distance, wherein the first shape is associated with a first distance and the second shape is associated with a second distance.

10. The system of claim 9 , wherein the second graphical representation of the aircraft represents at least one of a larger scale view of the aircraft than the first graphical representation or at least a different portion of the aircraft than the first graphical representation of the aircraft.

11. The system of claim 9 , further comprising a user interface, wherein the graphical user interface comprises a first graphical user interface, and wherein the processor is further configured to:

generate a second graphical user interface including a third graphical representation of the aircraft, wherein the third graphical representation of the aircraft represents a smaller scale view of the aircraft than the first graphical representation of the aircraft,

present the second graphical user interface via the display,

after presenting the second graphical user interface, receive user input via the user interface, and

in response to receiving the user input, present the first graphical user interface via the display.

12. The system of claim 9 , further comprising a user interface, wherein the graphical user interface comprises a first graphical user interface, and wherein the processor is further configured to:

generate a second graphical user interface including a third graphical representation of the aircraft, wherein the third graphical representation of the aircraft represents a smaller scale view of the aircraft than the first graphical representation of the aircraft,

present the second graphical user interface via the display,

after presenting the second graphical user interface, receive user input via the user interface, the user input indicating a zoom request,

determine whether the user input is indicative of a first level of zoom or a second level of zoom,

in response to determining the user input is indicative of a first level of zoom, present a third graphical user interface via the display, the third graphical user interface comprising a fourth graphical representation of the aircraft, wherein the fourth graphical representation of the aircraft represents a larger scale view of the aircraft associated with the first level of zoom; and

in response to determining the user input is indicative of a second level of zoom, present the first graphical user interface via the display, wherein the first graphical representation of the aircraft represents a larger scale of the aircraft associated with the second level of zoom.

13. The system of claim 9 , wherein the graphical user interface comprises a first graphical user interface, and wherein the processor is further configured to:

generate a second graphical user interface including the first window and not the second window,

present the second graphical user interface via the display,

after presenting the second graphical user interface, detect the obstacle proximate the aircraft, and

in response to detecting the obstacle, present the first graphical user interface including the first window and the second window via the display.

14. The system of claim 9 ,

wherein the first window shows a view of the aircraft in which the obstacle is not visible,

wherein the second window comprises the graphical representation of the obstacle, and

wherein the processor is configured to generate the graphical user interface including a visual indication of at least one of a location of the obstacle relative to the aircraft or the distance of the obstacle relative to the aircraft in the second window.

15. The system of claim 9 ,

wherein the processor is further configured to generate the graphical user interface by at least selecting a first characteristic or a second characteristic for the graphical representation of the obstacle based on the distance, wherein the first and second characteristic each comprise at least one of a color, a shading, or a line pattern of the graphical representation of the obstacle, and

wherein the first characteristic is associated with a first distance and the second characteristic is associated with a second distance.

16. A non-transitory computer-readable medium comprising instructions that, when executed by a processor, cause the processor to:

determine a location of an obstacle proximate an aircraft during a ground operation of the aircraft;

after determining the location of the obstacle, generate a graphical user interface based on the determined location of the obstacle, the graphical user interface comprising:

a first window including a first graphical representation of the aircraft representing a first top plan view of at least part of the aircraft, and

a second window including a second graphical representation of the aircraft representing a second top plan view of at least part of the aircraft, the second graphical representation of the aircraft representing a different view of the aircraft than the first graphical representation, wherein the second window is inset in the first window, and wherein at least one of the first or second windows includes a graphical representation of the obstacle;

determine a distance of the obstacle relative to the aircraft; and

present, during the ground operation of the aircraft, the graphical user interface to a flight crew of the aircraft via a display,

wherein the at least one of the first or second windows comprises the graphical representation of the obstacle positioned relative to the respective graphical representation of the aircraft to indicate the distance and an angular position of the obstacle relative to the aircraft, and

wherein the instructions, when executed by the processor, cause the processor to generate the graphical user interface by at least selecting a first shape or a second shape for the graphical representation of the obstacle based on the distance, wherein the first shape is associated with a first distance and the second shape is associated with a second distance.

17. The method of claim 1 , further comprising, prior to determining the location of the obstacle, detecting, by the processor, the obstacle.

18. The system of claim 9 , wherein the processor is configured to detect the obstacle prior to determining the location of the obstacle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2014
From: MANNON, PAMELA; KHATWA, RATAN
To: HONEYWELL INTERNATIONAL INC., PATENT SERVICES M/S AB/2B
Reel/Frame 031909/0095 →
Continuity (1)
Related Publication 20150193101A1 · Jul 9, 2015
Cited By (1)
US 12,583,619