IP Library Granted Patent US 11,010,619
Granted Patent B2
US 11,010,619 · App. 16/383,858 · Granted May 18, 2021

Device and a method for searching for a lane on which a vehicle can drive

Inventors: Kun Zhao (Duisburg, DE); Yu Su (Wuppertal, DE)
Assignee: Aptiv Technologies Limited
G06K9/00798G06T7/70G06T2207/30256
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,010,619
App. No.
16/383,858
Granted
May 18, 2021
Kind
B2
Abstract

A device for searching for a lane on which a vehicle can drive, wherein the device is configured to receive an image captured by a camera, the image showing an area in front of the vehicle, detect lane markings in the image, determine for each of the lane markings if the respective lane marking is of a first type indicating a road condition of a first type or a second type indicating a road condition of a second type, create lane candidates from the lane markings, divide the lane candidates into classes of lane candidates depending on the type of the lane markings of the lane candidates, and search the classes of lane candidates for a lane on which the vehicle can drive.

Claims (53)

1. A device for searching for a lane on which a vehicle can drive, wherein the device is configured to:

receive an image captured by a camera, the image showing an area in front of the vehicle;

detect lane markings in the image;

determine for each of the lane markings if the respective lane marking is a left lane marking or a right lane marking;

determine for each of the lane markings if the respective lane marking is of a first type indicating a road condition of a first type or a second type indicating a road condition of a second type;

create lane candidates from the lane markings;

divide the lane candidates into classes of lane candidates depending on the type of the lane markings of the lane candidates, wherein the classes of lane candidates comprise one or more classes comprising lane candidates having a lane marking on only one side of the lane; and

search the classes of lane candidates for a lane on which the vehicle can drive.

2. The device as claimed in claim 1 , wherein the classes of lane candidates comprise classes a) to e), wherein:

class a) comprises lane candidates having a left lane marking of the second type and a right lane marking of the second type;

class b) comprises lane candidates having a left lane marking and a right lane marking with one of the lane markings being of the first type and the other one being of the second type;

class c) comprises lane candidates having a lane marking on only one side, the lane marking being of the second type;

class d) comprises lane candidates having a left lane marking of the first type and a right lane marking of the first type; and

class e) comprises lane candidates having a lane marking on only one side, the lane marking being of the first type.

3. The device as claimed in claim 1 , wherein the device is further configured to search the classes of lane candidates sequentially for a lane on which the vehicle can drive.

4. The device as claimed in claim 1 , wherein the device is further configured to terminate searching the classes of lane candidates when a lane on which the vehicle can drive has been selected.

5. The device as claimed in claim 1 , wherein the device is further configured to assign a lane candidate to one of the classes only if the lane candidate fulfils one or more criteria.

6. The device as claimed in claim 5 , wherein one of the criteria is that a width of the lane candidate is equal to or greater than a predetermined width.

7. The device as claimed in claim 5 , wherein one of the criteria is that the lane marking of the lane candidate is within a predetermined first distance from the vehicle in case the lane candidate has a lane marking on only one side.

8. The device as claimed in claim 5 , wherein one of the criteria is that the lane candidate is within a predetermined second distance from a lane that has been selected for driving the vehicle previously.

9. The device as claimed in claim 1 , wherein the road condition of the first type is a non-construction site and the road condition of the second type is a construction site.

10. The device as claimed in claim 1 , wherein a lane marking of the first type is non-yellow, and a lane marking of the second type is yellow.

11. A system comprising:

a camera configured to capture an image; and

a device for searching for a lane on which a vehicle can drive, wherein the device is configured to:

receive an image captured by the camera, the image showing an area in front of the vehicle;

detect lane markings in the image;

determine for each of the lane markings if the respective lane marking is a left lane marking or a right lane marking;

determine for each of the lane markings if the respective lane marking is of a first type indicating a road condition of a first type or a second type indicating a road condition of a second type;

create lane candidates from the lane markings;

divide the lane candidates into classes of lane candidates depending on the type of the lane markings of the lane candidates, wherein the classes of lane candidates comprise one or more classes comprising lane candidates having a lane marking on only one side of the lane; and

search the classes of lane candidates for a lane on which the vehicle can drive.

12. A method for searching for a lane on which a vehicle can drive, the method comprising:

receiving an image captured by a camera, the image showing an area in front of the vehicle;

detecting lane markings in the image;

determining for each of the lane markings if the respective lane marking is a left lane marking or a right lane marking;

determining for each of the lane markings if the respective lane marking is of a first type indicating a road condition of a first type or a second type indicating a road condition of a second type;

creating lane candidates from the lane markings;

dividing the lane candidates into classes of lane candidates depending on the type of the lane markings of the lane candidates, wherein the classes of lane candidates comprise one or more classes comprising lane candidates having a lane marking on only one side of the lane; and

searching the classes of lane candidates for a lane on which the vehicle can drive.

13. The method as claimed in claim 12 , wherein the classes of lane candidates comprise classes a) to e), wherein:

class a) comprises lane candidates having a left lane marking of the second type and a right lane marking of the second type;

class b) comprises lane candidates having a left lane marking and a right lane marking with one of the lane markings being of the first type and the other one being of the second type;

class c) comprises lane candidates having a lane marking on only one side, the lane marking being of the second type;

class d) comprises lane candidates having a left lane marking of the first type and a right lane marking of the first type; and

class e) comprises lane candidates having a lane marking on only one side, the lane marking being of the first type.

14. The method as claimed in claim 12 , including searching the classes of lane candidates sequentially for a lane on which the vehicle can drive.

15. The method as claimed in claim 12 , including terminating searching the classes of lane candidates when a lane on which the vehicle can drive has been selected.

16. The method as claimed in claim 12 , including assigning a lane candidate to one of the classes only if the lane candidate fulfils one or more criteria.

17. The method as claimed in claim 16 , wherein one of the criteria is that a width of the lane candidate is equal to or greater than a predetermined width.

18. The method as claimed in claim 16 , wherein one of the criteria is that the lane marking of the lane candidate is within a predetermined first distance from the vehicle in case the lane candidate has a lane marking on only one side.

19. The method as claimed in claim 16 , wherein one of the criteria is that the lane candidate is within a predetermined second distance from a lane that has been selected for driving the vehicle previously.

20. The method as claimed in claim 12 , wherein the road condition of the first type is a non-construction site and the road condition of the second type is a construction site.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2024
From: APTIV MANUFACTURING MANAGEMENT SERVICES S.À R.L.
To: APTIV TECHNOLOGIES AG
Reel/Frame 066551/0219 →
MERGER Recorded Feb 11, 2024
From: APTIV TECHNOLOGIES (2) S.À R.L.
To: APTIV MANUFACTURING MANAGEMENT SERVICES S.À R.L.
Reel/Frame 066566/0173 →
ENTITY CONVERSION Recorded Feb 11, 2024
From: APTIV TECHNOLOGIES LIMITED
To: APTIV TECHNOLOGIES (2) S.À R.L.
Reel/Frame 066746/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2019
From: ZHAO, KUN; SU, YU
To: APTIV TECHNOLOGIES LIMITED
Reel/Frame 048881/0834 →
Priority Claims (1)
EP 18172365 · May 15, 2018 · regional
Continuity (1)
Related Publication 20190354779A1 · Nov 21, 2019