IP Library Granted Patent US 12,499,513
Granted Patent B2
US 12,499,513 · App. 18/232,946 · Granted Dec 16, 2025

EFVS integrated interface for image display control

Inventors: Ramon Correa, Jr. (Newberg, OR); Irina R. Sandu (Lake Oswego, OR); Geoffrey Cheren (Baker City, OR)
Assignee: Rockwell Collins, Inc.
G06T5/50B64D43/00G06T5/10H04N23/80G06T2207/10032G06T2207/10048G06T2207/20212H04N25/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,499,513
App. No.
18/232,946
Filed
Aug 11, 2023
Granted
Dec 16, 2025
Kind
B2
Examiner
LE, PETER D
Art Unit
2488
USPC
348/144
Abstract

An enhanced vision system (EVS) is integrated with a heads-up display (HUD). The EVS generates image of an external scene. The EVS generates the images without repeatedly generating the images when a mode of the HUD changes. The EVS includes an expanded interface, where inputs from the HUD are used in the internal processing of the EVS. The HUD then displays information in a graphical and alphanumeric format. The information can include an enhanced vision image from the EVS and/or a synthetic vision image from a synthetic vision system (SVS). The enhanced vision image can be merged with a synthetic vision image to provide a combined vision image.

Claims (46)

1 . An enhanced vision system comprising:

an image sensor; wherein the image sensor is configured to generate an enhanced image;

a communication interface;

a memory; wherein the memory maintains program instructions; and

one or more processors; wherein the one or more processors are configured to execute the program instructions; wherein the program instructions cause the one or more processors to:

receive, from a heads-up display via the communication interface, at least a gamma and a brightness signal;

generate a lookup table based on the at least the gamma and the brightness signal;

generate a transformed-enhanced image by applying the lookup table to the enhanced image, wherein the transformed-enhanced image is a monochrome image with a plurality of pixels each including gray levels; and

transmit, to the heads-up display via the communication interface:

the enhanced image and the lookup table;

the transformed-enhanced image, wherein the enhanced image and the transformed-enhanced image are transmitted as uncompressed digital video; and

statistical data regarding the gray levels, wherein the lookup table and the statistical data are transmitted with the enhanced image.

2 . The enhanced vision system of claim 1 , wherein the image sensor is an infrared image sensor.

3 . The enhanced vision system of claim 1 , wherein the program instructions cause the one or more processors to:

receive, via the communication interface, the gamma, the brightness signal, and at least one of a contrast signal or an ambient light value; and

generate the lookup table based on the gamma, the brightness signal, and at least one of the contrast signal or the ambient light value.

4 . The enhanced vision system of claim 3 , wherein the program instructions cause the one or more processors to:

receive, via the communication interface, at least the gamma, the brightness signal, the contrast signal, and the ambient light value; and

generate the lookup table based on the at least the gamma, the brightness signal, the contrast signal, and the ambient light value.

5 . The enhanced vision system of claim 1 , wherein the one or more processors generate the lookup table for at least one of an S-curve transform or a piecewise approximation transform.

6 . The enhanced vision system of claim 1 , wherein applying the lookup table to the enhanced image changes bit values of a plurality of pixels of the enhanced image thereby generating the transformed-enhanced image.

7 . The enhanced vision system of claim 1 , wherein the gray levels are between 0 and 255.

8 . The enhanced vision system of claim 1 , wherein the program instructions cause the one or more processors to transmit, via the communication interface, the enhanced image, the transformed-enhanced image, the lookup table, and the statistical data using an ARINC A818 protocol, wherein the lookup table and the statistical data are transmitted as part of an ancillary data in the ARINC A818 protocol.

9 . The enhanced vision system of claim 1 , wherein the statistical data regarding the gray levels is at least one of a mean gray level or a standard deviation of the gray levels.

10 . An aircraft comprising:

a heads-up display; and

an enhanced vision system; wherein the heads-up display and the enhanced vision system are communicatively coupled; wherein the enhanced vision system comprises:

an image sensor; wherein the image sensor is configured to generate an enhanced image;

a communication interface;

a memory; wherein the memory maintains program instructions; and

one or more processors; wherein the one or more processors are configured to execute the program instructions; wherein the program instructions cause the one or more processors to:

receive, from the heads-up display via the communication interface, at least a gamma and a brightness signal;

generate a lookup table based on the at least the gamma and the brightness signal;

generate a transformed-enhanced image by applying the lookup table to the enhanced image, wherein the transformed-enhanced image is a monochrome image with a plurality of pixels each including gray levels; and

transmit, to the heads-up display via the communication interface:

the enhanced image and the lookup table;

the transformed-enhanced image, wherein the enhanced image and the transformed-enhanced image are transmitted as uncompressed digital video; and

statistical data regarding the gray levels, wherein the lookup table and the statistical data are transmitted with the enhanced image.

11 . The aircraft of claim 10 , wherein the heads-up display is configured to display the transformed-enhanced image in response to receiving the transformed-enhanced image.

12 . The aircraft of claim 10 , comprising a synthetic vision system; wherein the synthetic vision system is configured to generate a synthetic image; wherein the heads-up display is configured to receive the synthetic image from the synthetic vision system; wherein the heads-up display is configured to combine the transformed-enhanced image and the synthetic image to generate a combined image.

13 . The aircraft of claim 12 , wherein the heads-up display is configured to:

receive the enhanced image and the lookup table;

apply a linear scaling factor to the lookup table, wherein the scaling factor is based on the statistical data received from the enhanced vision system and statistical data received from the synthetic vision system;

generate the transformed-enhanced image by applying the lookup table to the enhanced image in response to applying the linear scaling factor; and

combine the transformed-enhanced image and the synthetic image to generate the combined image.

14 . The aircraft of claim 13 , wherein the linear scaling factor is a ratio of the statistical data received from the enhanced vision system over the statistical data received from the synthetic vision system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2023
From: CORREA, RAMON, JR; SANDU, IRINA R.; CHEREN, GEOFFREY
To: ROCKWELL COLLINS, INC.
Reel/Frame 064561/0940 →
Continuity (1)
Related Publication 20250054103A1 · Feb 13, 2025
References Cited (49)
US 7961117B1 · Zimmerman et al. · 2011 [cited by applicant]
US 8384730B1 · VanDerKamp et al. · 2013 [cited by applicant]
US 8416151B2 · Poussin et al. · 2013 [cited by applicant]
US 8537214B2 · Poussin et al. · 2013 [cited by applicant]
US 8681073B1 · Robbins et al. · 2014 [cited by applicant]
US 9058510B1 · Bold et al. · 2015 [cited by applicant]
US 9726486B1 · Lahr et al. · 2017 [cited by applicant]
US 9870603B1 · Bold et al. · 2018 [cited by applicant]
US 10109054B1 · Wilson et al. · 2018 [cited by applicant]
US 10289218B1 · Young · 2019 [cited by applicant]
US 10308371B1 · Tiana et al. · 2019 [cited by applicant]
US 10540007B2 · Tiana et al. · 2020 [cited by applicant]
US 10657867B1 · Tiana et al. · 2020 [cited by applicant]
US 10878747B1 · Gao · 2020 [cited by examiner]
US 10928510B1 · Wood et al. · 2021 [cited by applicant]
US 10931938B2 · Hulsey et al. · 2021 [cited by applicant]
US 11046452B1 · Viswanatha et al. · 2021 [cited by applicant]
US 11109073B2 · Bender · 2021 [cited by applicant]
US 11120727B2 · Li · 2021 [cited by examiner]
US 11127371B2 · Keith et al. · 2021 [cited by applicant]
US 11348470B1 · Sandu et al. · 2022 [cited by applicant]
US 11359931B2 · Barber et al. · 2022 [cited by applicant]
US 11366327B1 · Thompson et al. · 2022 [cited by applicant]
US 11435580B1 · Sneitzer · 2022 [cited by applicant]
US 11500457B2 · Wood et al. · 2022 [cited by applicant]
US 11562716B2 · Thompson et al. · 2023 [cited by applicant]
US 11783752B2 · Kim · 2023 [cited by examiner]
US 20020011978A1 · Yamazaki · 2002 [cited by examiner]
US 20050052476A1 · Tyrell · 2005 [cited by examiner]
US 20050057484A1 · Diefenbaugh · 2005 [cited by examiner]
US 20060088275A1 · O'Dea · 2006 [cited by examiner]
US 20070052735A1 · Chou · 2007 [cited by examiner]
US 20070216636A1 · Lo · 2007 [cited by examiner]
US 20080181532A1 · Kim et al. · 2008 [cited by applicant]
US 20080204599A1 · Muraki · 2008 [cited by examiner]
US 20090237423A1 · Shih · 2009 [cited by examiner]
US 20100026722A1 · Kondo · 2010 [cited by examiner]
US 20100073339A1 · Lee · 2010 [cited by examiner]
US 20120056759A1 · He et al. · 2012 [cited by applicant]
US 20130155093A1 · He · 2013 [cited by examiner]
US 20170011692A1 · Lee · 2017 [cited by examiner]
US 20170251501A1 · Batsakes · 2017 [cited by examiner]
US 20180352164A1 · Higuchi · 2018 [cited by examiner]
US 20200355518A1 · Bilek et al. · 2020 [cited by applicant]
US 20220180758A1 · Thompson et al. · 2022 [cited by applicant]
EP 4027298A1 · 2022 [cited by applicant]
Tim Keller, ARINC 818 Avionics Digital Video Bus, The new protocol standard for high performance video systems, Great River Technology, http://www.arinc-818.eu/wp-content/uploads/2017/04/what-is-arinc-818.pdf. [cited by applicant]
European Search Report received in EP Application No. 24188645.6, Jan. 2, 2025, 13 pages. [cited by applicant]
Oleg Vygolov et al: “Enhanced, Synthetic and Combined Vision Technologies for Civil Aviation”, Oct. 31, 2014 (Oct. 31, 2014), Computer Vision in Control Systems-2,, pp. 201-230, XP009191658. [cited by applicant]