IP Library Granted Patent US 11,508,052
Granted Patent B2
US 11,508,052 · App. 17/017,654 · Granted Nov 22, 2022

Systems and methods for quantifying light flares in images

Inventor: Koji L. Gardiner (San Francisco, CA)
Assignee: ARGO AI, LLC
G06T7/0002G06T3/60G06T7/70G06T11/60G06T2207/20076G06T2207/20224
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,508,052
App. No.
17/017,654
Granted
Nov 22, 2022
Kind
B2
Abstract

Systems, methods, and computer-readable media are disclosed for identifying light flares in images. An example method may involve receiving an image from an imaging device, the image including data indicative of a flare artifact originating from a region of the image. The example method may also involve determining, based on the image data, a first array of pixels extending radially outwards from the region and a second array of pixels extending radially outwards from the region. The example method may also involve creating, based on the image data, a flare array, the flare array including the first array of pixels and the second array of pixels. The example method may also involve determining, based on the flare array, a peak flare artifact value indicative of a size of the flare artifact. The example method may also involve determining, based on the peak flare artifact value, a flare artifact score for the imaging device.

Claims (66)

1. A system, comprising:

a processor; and

a memory storing computer-executable instructions, that when executed by the processor, cause the processor to:

receive an image from an imaging device, the image including data indicative of a flare artifact originating from a region of the image;

determine, based on the image data, a first array of pixels extending radially outwards from the region and a second array of pixels extending radially outwards from the region;

create, based on the image data, a flare array, the flare array including the first array of pixels and the second array of pixels;

determine, based on the flare array and a mean value of the first array of pixels and a mean value of the second array of pixels, a peak flare artifact value indicative of a size of the flare artifact; and

determine, based on the peak flare artifact value, a flare artifact score for the imaging device.

2. The system of claim 1 , wherein the computer-executable instructions further cause the processor to:

determine a center of a source of the flare artifact; and

modify the image so that the center of the source of the flare artifact is at a center of the image, wherein modifying the image further comprises adding one or more additional pixels to the image, wherein a location of the one or more additional pixels is based on the determined center of the source of the flare artifact.

3. The system of claim 2 , wherein determining the center of a source of the flare artifact in the image further comprises creating a binary map of the image, wherein pixel values above a threshold are given a first value and pixels values below the threshold are given a second value.

4. The system of claim 1 , wherein the flare array further comprises a first column of pixels, and wherein the computer-executable instructions further cause the processor to:

determine a first median pixel value for the first column of pixels; and

subtract the first median pixel value from the first column of pixels, wherein subtracting the median pixel value separates higher frequency flare artifacts from lower frequency background glare in the image.

5. The system of claim 1 , wherein creating the flare array further comprises:

copy the first array of pixels from the image to the flare array;

rotate the image in either a clockwise direction or a counterclockwise direction by a degree of rotation; and

copy the second array of pixels from the image to the flare array.

6. The system of claim 1 , wherein the computer-executable instructions further cause the processor to:

receive, from the imaging device, a second image including the flare artifact originating from the region of the image, the second image being at a different orientation than the image;

determine a second flare artifact score for the imaging device based on the second image; and

determine, based on the flare artifact score based on the image and the second flare artifact score based on the second image, an overall flare artifact score for the imaging device.

7. A method, comprising:

receiving an image from an imaging device, the image including data indicative of a flare artifact originating from a region of the image;

determining, based on the image data, a first array of pixels extending radially outwards from the region and a second array of pixels extending radially outwards from the region;

creating, based on the image data, a flare array, the flare array including the first array of pixels and the second array of pixels;

determining, based on the flare array and a mean value of the first array of pixels and a mean value of the second array of pixels, a peak flare artifact value indicative of a size of the flare artifact; and

determining, based on the peak flare artifact value, a flare artifact score for the imaging device.

8. The method of claim 7 , further comprising:

determining a center of a source of the flare artifact; and

modifying the image so that the center of the source of the flare artifact is at a center of the image, wherein modifying the image further comprises adding one or more additional pixels to the image, wherein a location of the one or more additional pixels is based on the determined center of the source of the flare artifact.

9. The method of claim 8 , wherein determining the center of a source of the flare artifact in the image further comprises creating a binary map of the image wherein pixel values above a threshold are given a first value and pixels values below the threshold are given a second value.

10. The method of claim 7 , wherein the flare array further comprises a first column of pixels, and wherein the method further comprises:

determining a first median pixel value for the first column of pixels; and

subtracting the median pixel value from the first column of pixels, wherein subtracting the median pixel value separates higher frequency flare artifacts from lower frequency background glare in the image.

11. The method of claim 7 , wherein creating the flare array further comprises:

copying the first array of pixels from the image to the flare array;

rotating the image in either a clockwise direction or a counterclockwise direction by a degree of rotation; and

copying the second array of pixels from the image to the flare array.

12. The method of claim 7 , further comprising:

receiving, from the imaging device, a second image including the flare artifact originating from the region of the image, the second image being at a different orientation than the image;

determining a second flare artifact score for the imaging device based on the second image; and

determining, based on the flare artifact score based on the image and the second flare artifact score based on the second image, an overall flare artifact score for the imaging device.

13. A non-transitory computer readable medium including computer-executable instructions stored thereon, which when executed by one or more processors, cause the one or more processors to perform operations of:

receiving an image from an imaging device, the image including data indicative of a flare artifact originating from a region of the image;

determining, based on the image data, a first array of pixels extending radially outwards from the region and a second array of pixels extending radially outwards from the region;

creating, based on the image data, a flare array, the flare array including the first array of pixels and the second array of pixels;

determining, based on the flare array and a mean value of the first array of pixels and a mean value of the second array of pixels, a peak flare artifact value indicative of a size of the flare artifact; and

determining, based on the peak flare artifact value, a flare artifact score for the imaging device.

14. The non-transitory computer readable medium of claim 13 , wherein the computer-executable instructions are further configured to cause the one or more processors to perform operations of:

determining a center of a source of the flare artifact; and

modifying the image so that the center of the source of the flare artifact is at a center of the image, wherein modifying the image further comprises adding one or more additional pixels to the image, wherein a location of the one or more additional pixels is based on the determined center of the source of the flare artifact.

15. The non-transitory computer readable medium of claim 14 , wherein determining the center of a source of the flare artifact in the image further comprises creating a binary map of the image wherein pixel values above a threshold are given a first value and pixels values below the threshold are given a second value.

16. The non-transitory computer readable medium of claim 13 , wherein the flare array further comprises a first column of pixels, and wherein the computer-executable instructions are further configured to cause the one or more processors to perform operations of:

determining a first median pixel value for the first column of pixels; and

subtracting the median pixel value from the first column of pixels, wherein subtracting the median pixel value separates higher frequency flare artifacts from lower frequency background glare in the image.

17. The non-transitory computer readable medium of claim 13 , wherein creating the flare array further comprises:

copying the first array of pixels from the image to the flare array;

rotating the image in either a clockwise direction or a counterclockwise direction by a degree of rotation; and

copying the second array of pixels from the image to the flare array.

18. The system of claim 1 , further comprising the imaging device, wherein the imaging device comprises at least one camera.

19. The method of claim 7 , further comprising:

prompting a user to clean the imaging device based on the flare artifact score.

20. The non-transitory computer readable medium of claim 13 , wherein the imaging device is disposed on a vehicle, and wherein the computer-executable instructions are further configured to cause the one or more processors to perform operations of:

triggering a cleaning mechanism to clean the imaging device based on the flare artifact score.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2024
From: ARGO AI, LLC
To: VOLKSWAGEN GROUP OF AMERICA INVESTMENTS, LLC
Reel/Frame 069177/0099 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2020
From: GARDINER, KOJI L.
To: ARGO AI, LLC
Reel/Frame 054163/0519 →
Continuity (1)
Related Publication 20220076401A1 · Mar 10, 2022
Cited By (2)
US 12,380,545 US 12,596,077