IP Library Granted Patent US 9,466,005
Granted Patent B2
US 9,466,005 · App. 14/921,776 · Granted Oct 11, 2016

Method and system for classifying painted road markings in an automotive driver-vehicle-assistance device

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,466,005
App. No.
14/921,776
Granted
Oct 11, 2016
Kind
B2
Abstract

An automated, computerized method is provided for processing an image. The method includes the steps of arranging a digital camera on a vehicle body, operating the digital camera to provide an image file depicting an image of a scene related to vehicle operation on a road, in a computer memory, receiving from the memory the image file depicting pixels of an image of the scene related to vehicle operation on a road, and using an analysis of the pixels to generate an illumination invariant image of the scene. A further process step includes using the illumination invariant image to analyze the road scene for painted road markings.

Claims (40)

1. For use in a vehicle, an automated, computerized method for processing an image, comprising the steps of:

receiving from a digital camera mounted on the vehicle, an image file depicting pixels of an image of a scene related to vehicle operation on a road, each one of the pixels having N band color values;

transforming the N bands to log color space values in a log color space;

generating a log chromaticity plane in the log color space;

identifying pixels meeting criteria indicating suitability for use in determining an accurate orientation for the log chromaticity plane, according to a BIDR model and based upon an analysis of the pixels of an image of a scene related to vehicle operation on a road, wherein the pixel analysis is based upon an estimate of lit road color;

calculating an orientation for the log chromaticity plane, according to a BIDR model, as a function of the identified pixels;

projecting the log color space values to the chromaticity plane to provide chromaticity representation values corresponding to the pixels of the image; and

using the chromaticity representation values corresponding to the pixels to generate an illumination invariant image of the scene.

2. The method of claim 1 including the further step of using the illumination-invariant representation of the image to analyze the scene for painted road markings.

3. For use in a vehicle, an automated, computerized method for processing an image, comprising the steps of:

receiving from a digital camera mounted on the vehicle, an image file depicting pixels of an image of a scene related to vehicle operation on a road, each one of the pixels having N band color values;

transforming the N bands to log color space values in a log color space;

generating a log chromaticity plane in the log color space;

identifying pixels meeting criteria indicating suitability for use in determining an accurate orientation for the log chromaticity plane, according to a BIDR model and based upon an analysis of the pixels of an image of a scene related to vehicle operation on a road, wherein the pixel analysis is based upon an estimate of lit road color;

calculating an orientation for the log chromaticity plane, according to a BIDR model, as a function of the identified pixels;

projecting the log color space values to the chromaticity plane to provide chromaticity representation values corresponding to the pixels of the image;

using the chromaticity representation values corresponding to the pixels to generate an illumination invariant image of the scene;

receiving from the digital camera a series of image files, to depict a road video; and

performing a multi-thread operation, in a first thread, performing the step to calculate the orientation, and in a second thread, performing the steps to generate the illumination invariant image of the scene.

4. The method of claim 3 wherein the first thread operates on a subset of the series of image files, and the second thread operates on all of the series of image files.

5. The method of claim 3 including the further step of using the illumination-invariant representation of the image to analyze the scene for painted road markings.

6. A device comprising:

a computer system adapted to be coupled to a digital camera adapted for mounting on a vehicle to record an image of a scene related to vehicle operation on a road; and

the computer system including a memory storing an image file comprising pixels of an image of the scene;

the computer system being arranged and configured to execute a routine to:

receive from the memory, an image file depicting pixels of an image of a scene related to vehicle operation on a road, each one of the pixels having N band color values;

transform the N bands to log color space values in a log color space;

generate a log chromaticity plane in the log color space;

identify pixels meeting criteria indicating suitability for use in determining an accurate orientation for the log chromaticity plane, according to a BIDR model and based upon an analysis of the pixels of an image of a scene related to vehicle operation on a road, wherein the pixel analysis is based upon an estimate of lit road color;

calculate an orientation for the log chromaticity plane, according to a BIDR model, as a function of the identified pixels;

projecting the log color space values to the chromaticity plane to provide chromaticity representation values corresponding to the pixels of the image; and

using the chromaticity representation values corresponding to the pixels to generate an illumination invariant image of the scene.

7. A computer program product, disposed on a non-transitory computer readable media, the product including computer executable process steps operable to control a computer to:

receive an image file depicting pixels of an image of a scene related to vehicle operation on a road, in a computer memory, each one of the pixels having N band color values;

transform the N bands to log color space values in a log color space;

generate a log chromaticity plane in the log color space;

identify pixels meeting criteria indicating suitability for use in determining an accurate orientation for the log chromaticity plane, according to a BIDR model and based upon an analysis of the pixels of an image of a scene related to vehicle operation on a road, wherein the pixel analysis is based upon an estimate of lit road color;

calculate an orientation for the log chromaticity plane, according to a BIDR model, as a function of the identified pixels;

projecting the log color space values to the chromaticity plane to provide chromaticity representation values corresponding to the pixels of the image; and

using the chromaticity representation values corresponding to the pixels to generate an illumination invariant image of the scene.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2022
From: TANDENT COMPUTER VISION LLC
To: INNOVATION ASSET COLLECTIVE
Reel/Frame 061387/0149 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2019
From: TANDENT VISION SCIENCE, INC.
To: TANDENT COMPUTER VISION LLC
Reel/Frame 049080/0636 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2015
From: SMITH, CASEY ARTHUR
To: TANDENT VISION SCIENCE, INC.
Reel/Frame 036895/0637 →