IP Library › Granted Patent US 12692015

Granted Patent B1

US 12692015 · App. 19/036,815 · Granted Jul 28, 2026

Visual perception augmentation system

Inventors: Alejandro Torres Gámiz (Madrid, ES); Barend-Jan Van Bruchem (Madrid, ES); Maxim Constantijn Vos (Móstoles, ES)

Assignee: The Boeing Company

B64D45/00 G06F3/013 G06F3/1423 G06T7/70 G09G3/001 G06T2207/30261 G09G2340/0407 G09G2340/0464 G09G2354/00 G09G2380/12

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 12692015
App. No.: 19/036,815
Granted: Jul 28, 2026
Kind: B1

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

In some implementations, a system within a flight deck of an aircraft determines, based on line-of-sight data associated with an aircraft operator stationed within the flight deck of the aircraft, a field of view (FOV) of the aircraft operator. The system determines display configuration information based on a set of one or more visual references derived from the FOV of the aircraft operator. The system updates a projection display component that is positioned within the flight deck and within the FOV of the aircraft operator to display at least visual representation information associated with the set of one or more visual references based on the display configuration information.

Claims (89)

1 . A visual perception augmentation system, within a flight deck of an aircraft, comprising:

a first projection display component configured to be within a field of view (FOV) of a first aircraft operator;

a second projection display component configured to be within a FOV of a second aircraft operator;

a camera system configured to observe a line of sight of the first aircraft operator and a line of sight of the second aircraft operator; and

one or more processors configured to:

determine, based on relative position information derived from aircraft data, a first alignment vector associated with a first point of view (POV) of the first aircraft operator and a visual reference;

determine, based on the first alignment vector, first display configuration information based on a first set of one or more visual references derived from the FOV of the first aircraft operator;

determine, based on the relative position information, a second alignment vector associated with a second point of view (POV) of the second aircraft operator and the visual reference;

determine, based on the second alignment vector, second display configuration information based on a second set of one or more visual references derived from the FOV of the second aircraft operator;

update the first projection display component to display at least first visual representation information associated with the first set of one or more visual references based on the first display configuration information; and

update the second projection display component to display at least second visual representation information associated with the second set of one or more visual references based on the second display configuration information.

2 . The visual perception augmentation system of claim 1 , wherein the one or more processors are further configured to:

derive the FOV of the first aircraft operator based on a point of view (POV) of the first aircraft operator.

3 . The visual perception augmentation system of claim 1 , wherein the aircraft data comprises:

navigation data;

guidance data; or

control data.

4 . The visual perception augmentation system of claim 1 , wherein the relative position information indicates an estimated relative position of each visual reference, of the first set of one or more visual references and the second set of one or more visual references, with respect to the aircraft.

5 . The visual perception augmentation system of claim 1 , wherein the one or more processors are further configured to:

determine an estimated position of the aircraft and a position of a visual reference of the first set of one or more visual references and the second set of one or more visual references; and

determine, based on the estimated position of the aircraft and the position of the visual reference, the relative position information to indicate an estimated relative position of the visual reference with respect to the aircraft.

6 . The visual perception augmentation system of claim 1 , wherein the one or more processors are further configured to:

determine, based on the FOV of the first aircraft operator and the relative position information, a group of visual references;

determine, based on the aircraft data, flight operational parameters; and

select the first set of one or more visual references from the group of visual references that are associated with the flight operational parameters.

7 . The visual perception augmentation system of claim 1 , wherein the one or more processors are further configured to:

determine, based on the FOV of the first aircraft operator and the relative position information, a group of visual references;

identify selection parameters associated with the first projection display component; and

select the first set of one or more visual references from the group of visual references that are associated with selection parameters.

8 . The visual perception augmentation system of claim 7 , wherein the selection parameters comprise:

a selection parameter associated with flight operational parameters;

a selection parameter associated with a display preference of the first aircraft operator;

a selection parameter associated with weather events related to a flight path of the aircraft;

a selection parameter associated with positions of obstacles related to the flight path of the aircraft;

a selection parameter associated with a performance of the aircraft;

a selection parameter associated with a status of the aircraft;

a selection parameter associated with a predicted performance of the aircraft;

a selection parameter associated with control information associated with the aircraft;

a selection parameter associated with navigation of the aircraft; or

a selection parameter associated with positions of other aircraft.

9 . The visual perception augmentation system of claim 1 , wherein the one or more processors are further configured to:

determine respective characteristics of visual references in the first set of one or more visual references; and

generate the first visual representation information, based on the respective characteristics of the visual references in the first set of one or more visual references, that comprises one or more visual representation elements for each visual reference of the first set of one or more visual references.

10 . The visual perception augmentation system of claim 1 , wherein the one or more processors, to determine the first display configuration information, are configured to:

determine, based on the relative position information, a display scale for a visual reference of the first set of one or more visual references;

determine, based on the relative position information, an alignment vector associated with a point of view (POV) of the first aircraft operator and the visual reference; and

determine, based on the alignment vector, a display position for the visual reference.

11 . The visual perception augmentation system of claim 1 ,

wherein the first visual representation information indicates, for each visual reference of the first set of one or more visual references, one or more visual representation elements,

wherein the first display configuration information indicates, for each visual reference of the first set of one or more visual references, a display scale, and a display position, and

wherein the one or more processors, to update the first projection display component to display at least the first visual representation information based on the first display configuration information, are configured to:

transmit the first visual representation information and the first display configuration information to the first projection display component to update the first projection display component to display, for each visual reference of the first set of one or more visual references, the one or more visual representation elements at the display scale and in the display position.

12 . A non-transitory computer-readable medium storing a set of instructions, the set of instructions comprising:

one or more instructions that, when executed by one or more processors of a system within a flight deck of an aircraft, cause the system to:

determine, based on line-of-sight data associated with an aircraft operator, a field of view (FOV) of the aircraft operator;

determine, based on relative position information, an alignment vector associated with a point of view (POV) of the aircraft operator and a visual reference;

determine, based on the alignment vector, display configuration information based on a set of one or more visual references derived from the FOV of the aircraft operator; and

update a projection display component that is positioned within the flight deck and within the FOV of the aircraft operator to display at least visual representation information associated with the set of one or more visual references based on the display configuration information.

13 . The non-transitory computer-readable medium of claim 12 , wherein the one or more instructions further cause the system to:

select the set of one or more visual references, from a plurality of visual references, that are associated with selection parameters.

14 . The non-transitory computer-readable medium of claim 13 , wherein the selection parameters comprise:

a selection parameter associated with flight operational parameters;

a selection parameter associated with a display preference of the aircraft operator;