IP Library Granted Patent US 11,729,371
Granted Patent B2
US 11,729,371 · App. 17/070,038 · Granted Aug 15, 2023

Systems and methods for improved camera color calibration

Inventors: Christopher N. St. John (Northville, MI); Koji L. Gardiner (San Francisco, CA); Ravi Babu Basavaraj (Sunnyvale, CA); Bowei Zhang (Fremont, CA)
Assignee: Ford Global Technologies, LLC
H04N17/002G06T7/80G06T7/90G06V10/56G06V20/584H04N1/6027H04N9/646H04N9/67H04N17/02G06T2207/10016G06T2207/10024G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,729,371
App. No.
17/070,038
Granted
Aug 15, 2023
Kind
B2
Abstract

Systems, methods, and computer-readable media are disclosed for improved camera color calibration. An example method may involve capturing a first wavelength emitted by a first type of traffic light. The example method may also involve determining, based on the first wavelength, a first color value associated with the wavelength emitted by the first type of traffic light. The example method may also involve capturing, by a first camera, a first image, video, or real-time feed of a first portion of a test target, the first portion of the test target including a first light color that is based on the first color value. The example method may also involve determining, based on the first image, video, or real-time feed of the first portion of a test target, a second color value output by the camera. The example method may also involve determining, based on a comparison between the first color value and the second color value, that a difference exists between the first color value and the second color value. The example method may also involve adjusting, based on the detection that a difference exists between the first color value and the second color value, at least one of: a property of the camera or signal processing associated with the camera.

Claims (57)

1. A method comprising:

capturing a first wavelength emitted by a first type of traffic light and a second wavelength emitted by a second type of traffic light;

identifying, based on the first wavelength, a first color value associated with the wavelength emitted by the first type of traffic light;

identifying, based on the second wavelength, a third color value associated with the wavelength emitted by the second type of traffic light;

capturing, by a first camera, a first image, video, or real-time feed of a first portion of a test target, the first portion of the test target including a first light color that is based on the first color value and a third light color that is based on the third color value;

identifying, based on the first image, video, or real-time feed of the first portion of a test target, a second color value and a fourth color value output by the camera;

detecting, based on a comparison between the first color value and the second color value, that a difference exists between the first color value and the second color value; and

adjusting, based on the difference between the first color value and the second color value and a difference between the third color value and the fourth color value, at least one of: a property of the camera or signal processing associated with the camera.

2. The method of claim 1 , wherein the adjustment includes creating a second color correction matrix (CCM) based on a first CCM associated with the camera.

3. The method of claim 1 , wherein the first color value and the second color value are RGB values.

4. The method of claim 2 , further comprising:

capturing, by the first camera during real-time operation on a vehicle, a second image, video, or real-time feed of a traffic light that is of the first type of traffic light;

receiving a first output from the first camera based on the captured second image, video, or real-time feed that includes the second color value; and

applying the second CCM to the second color value to produce a second output including the first color value.

5. The method of claim 4 , further comprising determining that the traffic light is of the first type of traffic light, and wherein applying the second CCM to the second color value is based on the identification that the traffic light is of the first type of traffic light.

6. The method of claim 1 , further comprising:

capturing, by the first camera during real-time operation on a vehicle, a third image, video, or real-time feed of a traffic light that is of the second type of traffic light;

receiving a third output from the first camera based on the captured third image, video, or real-time feed that includes the third color value; and

applying a third CCM to the third color value to produce a fourth output including the third color value.

7. The method of claim 6 , further comprising determining that the traffic light is of the second type of traffic light, and wherein applying the third CCM to the fourth color value is based on the identification that the traffic light is of the second type of traffic light.

8. A system comprising:

a processor; and

a memory storing computer-executable instructions, that when executed by the processor, cause the processor to:

capture, by a spectrometer, a first wavelength emitted by a first type of traffic light and a second wavelength emitted by a second type of traffic light;

identify, based on the first wavelength, a first color value associated with the wavelength emitted by the first type of traffic light;

identify, based on the second wavelength, a third color value associated with the wavelength emitted by the second type of traffic light;

capture, by a first camera, a first image, video, or real-time feed of a first portion of a test target, the first portion of the test target including a first light color that is based on the first color value and a third light color that is based on the third color value;

identify, based on the first image, video, or real-time feed of the first portion of a test target, a second color value and a fourth color value output by the camera;

detect, based on a comparison between the first color value and the second color value, that a difference exists between the first color value and the second color value; and

adjust, based on the difference between the first color value and the second color value and a difference between the third color value and the fourth color value, at least one of: a property of the camera or signal processing associated with the camera.

9. The system of claim 8 , wherein the adjustment includes creating a second color correction matrix (CCM) based on a first CCM associated with the camera, and wherein the first color value and the second color value are RGB values.

10. The system of claim 9 , wherein the computer-executable instructions further cause the processor to:

capture, by the first camera during real-time operation on a vehicle, a second image, video, or real-time feed of a traffic light that is of the first type of traffic light;

receive a first output from the first camera based on the captured second image, video, or real-time feed that includes the second color value;

apply the second CCM to the second color value to produce a second output including the first color value; and

determine that the traffic light is of the first type of traffic light, wherein applying the second CCM to the second color value is based on the identification that the traffic light is of the first type of traffic light.

11. The system of claim 8 , wherein the computer-executable instructions further cause the processor to:

capture, by the first camera during real-time operation on a vehicle, a third image, video, or real-time feed of a traffic light that is of the second type of traffic light;

receive a third output from the first camera based on the captured third image, video, or real-time feed that includes the third color value;

apply a third CCM to the third color value to produce a fourth output including the third color value; and

determine that the traffic light is of the second type of traffic light, wherein applying the third CCM to the fourth color value is based on the identification that the traffic light is of the second type of traffic light.

12. A non-transitory computer readable medium including computer-executable instructions stored thereon, which when executed by one or more processors of a wireless access point, cause the one or more processors to perform operations of:

capturing, by a spectrometer, a first wavelength emitted by a first type of object and a second wavelength emitted by a second type of object;

identifying, based on the first wavelength, a first color value associated with the wavelength emitted by the first type of object;

identifying, based on the second wavelength, a third color value associated with the wavelength emitted by the second type of traffic light;

capturing, by a first camera, a first image, video, or real-time feed of a first portion of a test target, the first portion of the test target including a first light color that is based on the first color value and a third light color that is based on the third color value;

identifying, based on the first image, video, or real-time feed of the first portion of a test target, a second color value and a fourth color value output by the camera;

detecting, based on a comparison between the first color value and the second color value, that a difference exists between the first color value and the second color value; and

adjusting, based on the difference between the first color value and the second color value and a difference between the third color value and the fourth color value, at least one of: a property of the camera or signal processing associated with the camera.

13. The non-transitory computer readable medium of claim 12 , wherein the adjustment includes creating a second color correction matrix (CCM) based on a first CCM associated with the camera.

14. The non-transitory computer readable medium of claim 12 , wherein the first color value and the second color value are RGB values.

15. The non-transitory computer readable medium of claim 13 , wherein the computer-executable instructions further cause the one or more processors to perform operations of:

capturing, by the first camera during real-time operation on a vehicle, a second image, video, or real-time feed of an object that is of the first type of object;

receiving a first output from the first camera based on the captured second image, video, or real-time feed that includes the second color value; and

applying the second CCM to the second color value to produce a second output including the first color value.

16. The non-transitory computer readable medium of claim 12 , wherein the object is a road lane marker.

17. The method of claim 1 , wherein the test target comprises at least one of a Macbeth chart, a displayed image on a screen, and a projected image on a surface.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2023
From: ARGO AI, LLC
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 062936/0548 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2023
From: ARGO AI, LLC
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 063025/0346 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2020
From: ST. JOHN, CHRISTOPHER N.; GARDINER, KOJI L.; BASAVARAJ, RAVI BABU; ZHANG, BOWEI
To: ARGO AI, LLC
Reel/Frame 054167/0959 →
Continuity (1)
Related Publication 20220116584A1 · Apr 14, 2022
Cited By (1)
US 12,197,208