IP Library Granted Patent US 8,194,927
Granted Patent B2
US 8,194,927 · App. 12/175,622 · Granted Jun 5, 2012

Road-lane marker detection using light-based sensing technology

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,194,927
App. No.
12/175,622
Granted
Jun 5, 2012
Kind
B2
Abstract

A method is provided for detecting road lane markers using a light-based sensing device. Reflectivity data is captured using the light-based sensing device. A light intensity signal is generated based on the captured reflectivity data. The light intensity signal is convolved with a differential filter for generating a filter response that identifies a candidate lane marker region and ground segment regions juxtaposed on each side of the candidate lane marker region. A weighted standard deviation of the data points within the identified candidate lane marker region and weighted standard deviation of the data points within the ground segment regions are calculated. An objective value is determined as a function of the respective weighted standard deviations. The objective value is compared to a respective threshold for determining whether the identified candidate lane marker region is a lane marker.

Claims (178)

1. A method of detecting road lane markers using a light-based sensing technology, the method comprising the steps of:

capturing reflectivity data using a light-based sensing device;

generating a light intensity signal based on the captured reflectivity data received by the light-based sensing device;

convolving the light intensity signal with a differential filter for generating a filter response that identifies a candidate lane marker region and ground segment regions juxtaposed on each side of the candidate lane marker region;

calculating a weighted standard deviation of light intensity-based data points within the identified candidate lane marker region;

calculating a standard deviation of light intensity-based data points within the ground segment regions juxtaposed to the candidate lane marker region;

determining an objective value for the identified candidate lane marker region as a function of the weighted standard deviation of light intensity-based data points within the candidate lane marker region, the weighted standard deviation of light intensity-based data points within the ground segment regions juxtaposed to the identified candidate lane marker region, and a number of data points contained within the identified candidate lane marker region; and

comparing the objective value to a respective threshold for determining whether the identified candidate lane marker region is a lane marker.

2. The method of claim 1 further comprising the step of applying a false alarm mitigation analysis for verifying whether the identified candidate lane marker region is a lane marker.

3. The method of claim 2 wherein the false alarm mitigation analysis further comprises the steps of:

determining a width of the identified candidate lane marker region;

comparing the width to a predetermined width; and

determining that the identified candidate lane marker region is the lane marker in response to the width being less than the predetermined width, otherwise determining that the identified candidate lane marker region is not the lane marker.

4. The method of claim 2 wherein the false alarm mitigation analysis further comprises the steps of:

calculating a weighted mean of the light intensity-based data points within the identified candidate lane marker region;

calculating a weighted mean of the light intensity-based data points within the ground segment regions;

comparing the weighting mean of the identified candidate lane marker region to the weighted mean of the ground segment regions; and

determining that the identified candidate lane marker region is the lane marker in response to the weighting mean of the identified candidate lane marker region being greater than the weighted mean of the ground segment regions.

5. The method of claim 1 wherein a first edge of the identified candidate lane marker region is identified by a negative peak in the filter response and a second response is identified by a positive peak in the filter response.

6. The method of claim 5 wherein the negative peak is identified at an abrupt shifting downward of data points in the filtered response in comparison to substantially horizontal adjacent data points of the ground segment regions.

7. The method of claim 4 wherein the positive peak is identified at an abrupt shifting upward of data points in the filtered response in comparison to substantially horizontal adjacent data points of the ground segment regions.

8. The method of claim 1 wherein a determined weight applied for determining the weighted standard deviation is represented by the equation:

w

(

i

)

=

{

2

*

arc

sin

(

i

*

π

/

(

N

L

-

1

)

,

2

*

arc

sin

(

i

*

π

/

(

N

L

-

1

)

)

1

}

,

{

1

,

otherwise

}

i

=

0

,

1

,

2

,

,

N

L

-

1

,

where N L is the number of data points within the identified candidate lane marker region.

9. The method of claim 1 wherein the step of determining a weighted standard deviation of the light intensity-based data points within the ground segment regions include calculating a weighted standard deviation of the light intensity ground segment regions.

10. The method of claim 1 wherein a determined weight applied for determining the weighted standard deviation is represented by the equation:

w

(

i

)

=

{

2

*

arc

sin

(

i

*

π

/

(

N

G

-

1

)

,

2

*

arc

sin

(

i

*

π

/

(

N

G

-

1

)

)

1

}

,

{

1

,

otherwise

}

i

=

0

,

1

,

2

,

,

N

G

-

1

,

where N G is the number of data points within the identified ground segment region juxtaposed on both sides of the identified candidate lane marker region.

11. The method of claim 1 wherein determining the objective value (f) is derived from the following formula:

f=α*σ L +β*σ G +γ/( N*N )

where σ L is the weighted standard deviation of the light intensity-based data points within the identified candidate lane marker region, α is a balancing parameter applied to the weighted standard deviation of the identified candidate lane marker region, σ G is the weighted standard deviation of the light intensity-based data points within the ground segment regions, β is a balancing parameter applied to the weighted standard deviation of the ground segment regions, N L is the number of data points within the identified candidate lane marker region, and γ is a balancing parameter applied to the number of data points within the identified candidate lane marker region.

12. The method of claim 11 wherein the respective balancing parameters are determined by a classifier.

13. The method of claim 11 wherein the respective balancing parameters are determined by a support vector machine classifier.

14. The method of claim 11 wherein the respective balancing parameters are determined by a neural network-base training program.

15. The method of claim 11 wherein the respective balancing parameters are selected to provide a balance between each of weighted standard deviation of the identified candidate lane marker region, the standard deviation of the ground segment regions, and the number of data points contained in the identified candidate lane marker region.

16. A lane marker detection system comprising:

a light-based sensing device for capturing reflectivity data;

a processor for receiving the captured reflectivity data received by the light-based sensing system, the processor generating a light intensity signal based on the captured reflectivity data, the processor convolving the light intensity signal with a filter for generating a filter response for identifying a candidate lane marker region and adjacent ground segment regions, the processor determining a weighted standard deviation of light intensity-based data points within the candidate lane marker region and a weighted standard deviation of light intensity-based data points within the adjacent ground segments, the processor calculating an objective value for the identified candidate lane marker region as a function of the respective weighted standard deviations and a number of data points within the identified candidate lane marker region, the processor comparing the objective value to a threshold for determining whether the candidate lane marker region is a lane marker; and

an output device identifying a location of each of the lane markers.

17. The lane marker detection system of claim 16 further comprising a false alarm mitigation module for verifying whether the identified candidate lane marker region is the lane marker.

18. The lane marker detection system of claim 16 further comprising a classifier for generating the weighting parameters.

19. The lane marker detection system of claim 16 wherein the classifier is a support vector machine classifier.

Assignments (12)
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2014
From: WILMINGTON TRUST COMPANY
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 034189/0065 →
CHANGE OF NAME Recorded Feb 10, 2011
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 025781/0211 →
SECURITY AGREEMENT Recorded Nov 8, 2010
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: WILMINGTON TRUST COMPANY
Reel/Frame 025324/0475 →
RELEASE OF SECURITY INTEREST Recorded Nov 5, 2010
From: UAW RETIREE MEDICAL BENEFITS TRUST
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 025315/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 4, 2010
From: UNITED STATES DEPARTMENT OF THE TREASURY
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 025245/0909 →
SECURITY AGREEMENT Recorded Aug 28, 2009
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: UAW RETIREE MEDICAL BENEFITS TRUST
Reel/Frame 023162/0237 →
SECURITY AGREEMENT Recorded Aug 27, 2009
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: UNITED STATES DEPARTMENT OF THE TREASURY
Reel/Frame 023156/0313 →
RELEASE OF SECURITY INTEREST Recorded Aug 21, 2009
From: UNITED STATES DEPARTMENT OF THE TREASURY
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 023126/0914 →
RELEASE OF SECURITY INTEREST Recorded Aug 21, 2009
From: CITICORP USA, INC. AS AGENT FOR BANK PRIORITY SECURED PARTIES; CITICORP USA, INC. AS AGENT FOR HEDGE PRIORITY SECURED PARTIES
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 023155/0769 →
SECURITY AGREEMENT Recorded Apr 16, 2009
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: CITICORP USA, INC. AS AGENT FOR BANK PRIORITY SECURED PARTIES; CITICORP USA, INC. AS AGENT FOR HEDGE PRIORITY SECURED PARTIES
Reel/Frame 022554/0538 →
SECURITY AGREEMENT Recorded Feb 4, 2009
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: UNITED STATES DEPARTMENT OF THE TREASURY
Reel/Frame 022201/0448 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 26, 2008
From: ZHANG, WENDE; SADEKAR, VARSHA; URMSON, CHRISTOPHER PAUL
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.; CARNEGIE MELLON UNIVERSITY
Reel/Frame 021589/0233 →