IP Library › Granted Patent US 12,244,912
Granted Patent B1
US 12,244,912 · App. 18/130,244 · Granted Mar 4, 2025

System and method for determining performance of an imaging device in real-time

Inventor: Guillaume Spolaore (Marion, IA)
Assignee: Rockwell Collins, Inc.
H04N23/13G01W1/18H04N23/64H04N23/90H04N23/951G01W2203/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,244,912
App. No.
18/130,244
Granted
Mar 4, 2025
Kind
B1
Abstract

A method for determining performance of an imaging device in real-time is disclosed. The method may include, but is not limited to, receiving a first set of images of a first calibration target positioned at a first position from one or more imaging devices, determining a first environmental condition external to the aircraft at the first position based on the received first set of images using a machine learning algorithm; receiving additional set of images of an additional calibration target positioned at an additional position from the one or more imaging devices; determining an additional environmental condition external to the aircraft at the additional position based on the received additional set of images; and determining one or more real-time calibration parameters for the one or more imaging devices based on at least one of the determined first environmental condition and the determined additional environment condition.

Claims (42)

1. A system, the system comprising:

one or more imaging devices, the one or more imaging devices coupled to one or more external surfaces of an aircraft, the one or more imaging devices configured to generate a first set of images of a first calibration target positioned at a first position and an additional set of images of an additional calibration target positioned at an additional position, wherein the first position is different from the additional position, the first calibration target including a first calibration pattern, the additional calibration target including a second calibration pattern; and

one or more controllers communicatively coupled to the one or more imaging devices, the one or more controllers including one or more processors configured to executed a set program instructions stored in a memory, the one or more controllers including a machine learning algorithm stored in memory, the set of program instructions configured to cause the one or more processors to:

receive the first set of images of the first calibration target positioned at the first position from the one or more imaging devices;

receive the additional set of images of the additional calibration target positioned at the additional position from the one or more imaging devices;

determine one or more environmental conditions external to the aircraft at the additional position; and

determine one or more real-time calibration parameters for the one or more imaging devices based on the one or more environmental conditions.

2. The system of claim 1 , wherein the one or more controllers are further configured to:

store the received first set of images of the first calibration target positioned at the first position from the one or more imaging devices;

generate an average image by averaging the received first set of images of the first calibration target and the additional set of images of the additional calibration target and

determine the one or more environmental conditions external to the aircraft at the additional position based on the generated average image.

3. The system of claim 1 , wherein the one or more controllers are further configured to:

determine a first environmental condition external to the aircraft at the first position based on the received first set of images using the machine learning algorithm; and

determine an additional environmental condition external to the aircraft at the additional position based on the additional set of images of the additional calibration target.

4. The system of claim 1 , wherein the one or more controllers are further configured to:

adjust one or more factory calibration parameters based on the determined one or more real-time calibration parameters.

5. The system of claim 1 , wherein the one or more controllers are further configured to:

receive one or more training images, the one or more training images including one or more weather condition images; and

train the machine learning algorithm based on the received one or more training images.

6. The system of claim 1 , wherein one of the first calibration pattern or the additional calibration target comprises a fixed calibration pattern.

7. The system of claim 1 , wherein one of the first calibration pattern or the additional calibration target comprises a dynamic calibration pattern.

8. The system of claim 6 , wherein one of the first calibration target or the additional calibration target comprises a digital display device.

9. The system of claim 1 , wherein one of the first position of the first calibration target or the additional position of the additional calibration target comprises:

a taxiway position, a runway position, or a position outside an airport.

10. A method comprising:

receiving a first set of images of a first calibration target positioned at a first position from one or more imaging devices, the one or more imaging devices coupled to one or more external surfaces of an aircraft, the first calibration target including a first calibration pattern;

receiving additional set of images of an additional calibration target positioned at an additional position from the one or more imaging devices, the additional position different from the first position, the additional calibration target including an additional calibration pattern;

determining one or more environmental conditions external to the aircraft at the additional position; and

determining one or more real-time calibration parameters for the one or more imaging devices based on the determined one or more environmental conditions.

11. The method of claim 10 , further comprising:

storing the received first set of images of the first calibration target positioned at the first position from the one or more imaging devices;

generating an average image by averaging the received first set of images of the first calibration target and the additional set of images of the additional calibration target and

determining the one or more environmental conditions external to the aircraft at the additional position based on the generated average image.

12. The method of claim 10 , further comprising:

adjusting one or more factory calibration parameters based on the determined one or more real-time calibration parameters.

13. The method of claim 10 , further comprising:

receiving one or more training images, the one or more training images including one or more weather condition images; and

training the machine learning algorithm based on the received one or more training images.

14. The method of claim 10 , wherein one of the first calibration pattern or the additional calibration target comprises at least one of:

a fixed calibration pattern or a dynamic calibration pattern.

15. The method of claim 10 , wherein one of the first position of the first calibration target or the additional position of the additional calibration target comprises:

a taxiway position, a runway position, or a position outside an airport.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2023
From: SPOLAORE, GUILLAUME
To: ROCKWELL COLLINS, INC.
Reel/Frame 063208/0128 →
References Cited (24)
US 9986233B1 · Curlander et al. · 2018 [cited by applicant]
US 10051178B2 · Tebay · 2018 [cited by examiner]
US 10404949B2 · Lee · 2019 [cited by examiner]
US 10447995B1 · Curlander et al. · 2019 [cited by applicant]
US 10475209B2 · Shen et al. · 2019 [cited by applicant]
US 10560690B2 · Malaescu et al. · 2020 [cited by applicant]
US 11024187B2 · Staudinger et al. · 2021 [cited by applicant]
US 11310423B2 · Kuo et al. · 2022 [cited by applicant]
US 11538349B2 · Poojary et al. · 2022 [cited by applicant]
US 20140327765A1 · Hsien et al. · 2014 [cited by applicant]
US 20170054920A1 · de Boer · 2017 [cited by examiner]
US 20180108150A1 · Curtis · 2018 [cited by examiner]
US 20190108743A1 · Kimura · 2019 [cited by examiner]
US 20200134872A1 · Feng et al. · 2020 [cited by applicant]
US 20200327696A1 · Habib · 2020 [cited by applicant]
US 20210201534A1 · Liang et al. · 2021 [cited by applicant]
US 20220058966A1 · Baranek et al. · 2022 [cited by applicant]
US 20220100206A1 · Muller et al. · 2022 [cited by applicant]
US 20220327741A1 · Rahmouni et al. · 2022 [cited by applicant]
US 20230023069A1 · Gariel et al. · 2023 [cited by applicant]
US 20230117253A1 · Molad · 2023 [cited by examiner]
US 20230401745A1 · Kothari · 2023 [cited by examiner]
US 20240094726A1 · Katz · 2024 [cited by examiner]
EP 2416558A4 · 2017 [cited by applicant]