IP Library › Granted Patent US 12,682,507
Granted Patent B2
US 12,682,507 · App. 18/408,795 · Granted Jul 14, 2026

System and method for generating real-time synthetic imagery during aircraft flight

Inventor: Michael McElligott (Cork, IE)
Assignee: GOODRICH LIGHTING SYSTEMS, INC.
G06T11/00G01C21/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,682,507
App. No.
18/408,795
Filed
Jan 10, 2024
Granted
Jul 14, 2026
Kind
B2
Art Unit
2616
USPC
345/633
Abstract

An extended reality system for generating real-time synthetic imagery during a flight of an aircraft. The system is connectable to a local terrain database via a data network while the aircraft is on the ground and includes: a terrain subset database configured to store a subset of terrain data from the local terrain database; a position database configured to receive a real-time position and orientation of the aircraft during flight; an image generator configured to generate one or more real-time synthetic images of one or more view points from and/or of the aircraft based on the subset of terrain data and the real-time position and orientation of the aircraft; and an encoder 10 configured to convert the one or more real-time synthetic images into one or more media streams. The media streams are configured to be transmitted to one or more display devices via a wireless network.

Claims (18)

1 . An extended reality system for generating real-time synthetic imagery during a flight of an aircraft; wherein the system is connectable to a local terrain database via a data network while the aircraft is on the ground, the system comprising:

a terrain subset database configured to store a subset of terrain data from the local terrain database;

a position database configured to receive a real-time position and orientation of the aircraft during flight;

an image generator configured to generate a plurality of real-time synthetic images of one or more view points from or of the aircraft based on the subset of terrain data and the real-time position and orientation of the aircraft;

an encoder configured to convert the plurality of real-time synthetic images into a plurality of media streams, wherein the plurality of media streams are configured to be transmitted to one or more display devices via a wireless network; and

a flight path predictor configured to receive the real-time position and orientation of the aircraft at each time step and predict positions and orientation of the aircraft for one or more future time steps;

wherein the predicted position and orientation of the aircraft for one or more future time steps is based on the position and orientation of the aircraft for current and previous time steps and a predetermined flight path of the aircraft;

wherein the image generator is configured to generate one or more sets of future synthetic images of one or more view points from or of the aircraft based on the subset of terrain data and the predicted position and orientation of the aircraft for the one or more future time steps.

2 . The extended reality system of claim 1 , wherein the local terrain database comprises global or regional terrain data, and wherein the system is configured to receive an updated subset of terrain data from the local terrain database when the aircraft is on the ground.

3 . The extended reality system of claim 2 , wherein the terrain subset database comprises terrain data sufficient for an upcoming flight path or region in which the aircraft operates.

4 . The extended reality system of claim 3 , wherein the system is configured to receive supplementary data for the upcoming flight, wherein the supplementary data includes one or more of: predicted weather conditions; position of nearby aircraft; classification of nearby aircraft; and points of interest along flight path from a supplementary data feed via the data network while the aircraft is on the ground.

5 . The extended reality system of claim 4 , wherein the image generator is configured to generate the plurality of real-time synthetic images based on the supplementary data for the upcoming flight.

6 . The extended reality system of claim 1 , further comprising:

a cache configured to store the synthetic images generated by the image generator.

7 . The extended reality system of claim 6 , wherein the encoder is configured to receive the synthetic images from the cache and/or the image generator directly.

8 . The extended reality system of claim 1 , wherein the one or more viewpoints comprise: a pilot view, a seat view, and an escort view, wherein each view comprises a plurality of different weather conditions or times of day.

9 . The extended reality system of claim 1 , wherein the wireless network comprises a plurality of separate channels each configured to transmit the plurality of media streams to the one or more display devices.

10 . The extended reality system of claim 9 , wherein the one or more display devices are connectable to a single channel of the one or more separate channels.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2024
From: MCELLIGOTT, MICHAEL
To: COLLINS AEROSPACE IRELAND, LIMITED
Reel/Frame 066131/0267 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2024
From: COLLINS AEROSPACE IRELAND, LIMITED
To: GOODRICH LIGHTING SYSTEMS, INC.
Reel/Frame 066131/0287 →
Priority Claims (1)
EP 23151026 · Jan 10, 2023 · regional
Continuity (1)
Related Publication 20240233203A1 · Jul 11, 2024
References Cited (24)
US 5488563A · Chazelle · 1996 [cited by examiner]
US 7483696B1 · Mitchell · 2009 [cited by examiner]
US 8649915B2 · Vlad et al. · 2014 [cited by applicant]
US 9787948B2 · De Carvalho et al. · 2017 [cited by applicant]
US 9864559B2 · Sizelove · 2018 [cited by applicant]
US 10822108B2 · Chavez et al. · 2020 [cited by applicant]
US 11094128B2 · Skelly · 2021 [cited by applicant]
US 11368660B2 · Ahlborn et al. · 2022 [cited by applicant]
US 20020069019A1 · Lin · 2002 [cited by applicant]
US 20070171094A1 · Alter · 2007 [cited by examiner]
US 20080195309A1 · Prinzel, III et al. · 2008 [cited by applicant]
US 20110295445A1 · Vlad · 2011 [cited by examiner]
US 20170094166A1 · Riedel · 2017 [cited by applicant]
US 20170286037A1 · Sizelove · 2017 [cited by applicant]
US 20180352196A1 · Marin-Martinod · 2018 [cited by applicant]
US 20200355518A1 · Bilek · 2020 [cited by examiner]
US 20210104099A1 · Skelly · 2021 [cited by examiner]
US 20210287436A1 · Hausmann · 2021 [cited by applicant]
US 20230202674A1 · Nagalla · 2023 [cited by examiner]
US 20240010340A1 · Santos · 2024 [cited by examiner]
EP 3073225A1 · 2016 [cited by examiner]
EP 3053801B1 · 2020 [cited by applicant]
EP 3879500A1 · 2021 [cited by applicant]
European Search Report for Application No. 23151026.4, mailed Jul. 6, 2023, 9 pages. [cited by applicant]