IP Library Granted Patent US 11,282,391
Granted Patent B2
US 11,282,391 · App. 16/799,863 · Granted Mar 22, 2022

Object detection at different illumination conditions

Inventors: Igal Raichelgauz (Tel Aviv, IL); Karina Odinaev (Tel Aviv, IL)
Assignee: CARTICA AI LTD.
G08G1/167G06K9/00335G06K9/00805G06K9/66G06K9/72G06N5/04G06N20/00G08G1/04G08G1/16B60W30/0956B60W40/04B60W60/0017B60W60/0027
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,282,391
App. No.
16/799,863
Granted
Mar 22, 2022
Kind
B2
Abstract

A method for image processing at different illumination conditions, the method may include acquiring an image of an environment of a vehicle; selecting a set of pixels located within a region of interest that is located at an upper part of the image; calculating an illumination condition indicator based on values of the set of pixels; selecting a selected machine learning process, out of a machine learning processes, based on the illumination condition indicator; wherein different machine learning processes are trained to different illumination conditions; and processing the image by the selected machine learning process to provide processing results.

Claims (39)

1. A method for image processing at different illumination conditions, the method comprises:

acquiring an image of an environment of a vehicle;

selecting a set of pixels located within a region of interest that is located at an upper part of the image;

calculating an illumination condition indicator based on values of the set of pixels;

selecting a selected machine learning process, out of a plurality of machine learning processes, based on the illumination condition indicator;

wherein different machine learning processes are trained to different illumination conditions;

processing the image by the selected machine learning process to provide processing results; and

dynamically updating a location of pixels and a number of pixels of the set of pixels based on the processing results.

2. The method according to claim 1 comprising dynamically updating a distribution of pixels of the set of pixels within the region of interest based on the processing results.

3. The method according to claim 1 comprising dynamically updating a number of pixels of the set of pixels based on the processing results.

4. The method according to claim 1 comprising evaluating a quality of the processing; and determining, based on the quality of the processing, whether to amend at least one of a location of pixels of the set of pixels and a number of pixels of the set of pixels.

5. The method according to claim 1 comprising receiving or generating a rough estimate of a location of a sky and determining the region of interest to fall within the rough estimate of the location of the sky.

6. The method according to claim 1 comprising deactivating non-selected machine learning processes of the plurality of the machine learning processes.

7. The method according to claim 1 wherein the selecting of the set of pixels, the calculating of the illumination condition indicator and the selecting of the selected machine learning process are executed in real time.

8. The method according to claim 1 wherein the machine learning processes are a night machine learning process and a day machine learning process.

9. The method according to claim 1 wherein the set of pixels are a grid of spaced apart pixels.

10. The method according to claim 1 comprising:

estimating a location of a sky in a certain image; and

estimating a location of the sky in a future image based on (a) the estimated location of the sky in the certain image and (b) an estimated change in a field of view of a camera that acquired the certain image between a time of acquisition of the certain image and an estimated change in a field of view at the future image.

11. The method according to claim 1 comprising determining a feature of pixels of the set of pixels based on available resources for performing a calculating of the different illumination conditions.

12. The method according to claim 1 wherein the processing comprises lane detection.

13. The method according to claim 1 comprising defining a region of interest of one frame based on a location of object bounding boxes in a previous frame.

14. The method according to claim 1 comprising calculating illumination condition indicator values for different shapes within boundaries defined by estimations of vanishing point and objects locations; and selecting a region of interest which has a lowest condition illumination indicator as the region of interest that is located at the upper part of the image.

15. The method according to claim 1 wherein the processing comprises performing at least partial autonomous driving.

16. A non-transitory computer readable medium that stores instructions for:

acquiring an image of an environment of a vehicle;

selecting a set of pixels located within a region of interest that is located at an upper part of the image;

calculating an illumination condition indicator based on values of the set of pixels;

selecting a selected machine learning process, out of a plurality of machine learning processes, based on the illumination condition indicator;

wherein different machine learning processes are trained to different illumination conditions;

processing the image by the selected machine learning process to provide processing results; and

dynamically updating a location of pixels and a number of pixels of the set of pixels based on the processing results.

17. A device comprising at least one unit that is configured to acquire an image of an environment of a vehicle;

select a set of pixels located within a region of interest that is located at an upper part of the image;

calculate an illumination condition indicator based on values of the set of pixels;

select a selected machine learning process, out of a plurality of machine learning processes, based on the illumination condition indicator;

wherein different machine learning processes are trained to different illumination conditions;

process the image by the selected machine learning process to provide processing results; and

dynamically updating a location of pixels and a number of pixels of the set of pixels based on the processing results.

Assignments (2)
CHANGE OF NAME Recorded Jan 3, 2023
From: CARTICA AI LTD
To: AUTOBRAINS TECHNOLOGIES LTD
Reel/Frame 062266/0553 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2020
From: RAICHELGAUZ, IGAL; ODINAEV, KARINA
To: CARTICA AI LTD
Reel/Frame 052539/0608 →
Continuity (4)
Continuation PCTIB2019058207 · Sep 27, 2019
Provisional Application 62827112 · Mar 31, 2019
Provisional Application 62747147 · Oct 18, 2018
Related Publication 20200356791A1 · Nov 12, 2020