IP Library › Granted Patent US 10,970,565
Granted Patent B2
US 10,970,565 · App. 16/259,066 · Granted Apr 6, 2021

Method and apparatus with road line detection

Inventors: Minsu Ahn (Yongin-si, KR); Jiyeon Kim (Hwaseong-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06K9/00798G06T7/11G06T7/187G06T2207/30256
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,970,565
App. No.
16/259,066
Granted
Apr 6, 2021
Kind
B2
Abstract

Disclosed is a method and apparatus for detecting a road line includes segmenting a driving image data into a plurality of segmentation areas, determining a candidate vanishing-point area corresponding to a segmentation area of the segmentation areas, extracting at least one straight road line from the segmentation area, detecting a partial line corresponding to the segmentation area based on whether the at least one straight road line meets the candidate vanishing-point area, detecting the road line of the driving image data by connecting partial lines corresponding to the segmentation areas, and indicating the detected road line.

Claims (61)

1. A processor-implemented method of detecting a road line, comprising:

segmenting a captured driving image data into a plurality of segmentation areas;

determining a candidate vanishing-point area corresponding to a segmentation area of the segmentation areas;

extracting at least one straight road line from the segmentation area;

detecting a partial line corresponding to the segmentation area based on whether the at least one straight road line meets the candidate vanishing-point area; and

detecting the road line of the driving image data by connecting partial lines corresponding to the segmentation areas,

wherein the determining of the candidate vanishing-point area comprises:

verifying whether the segmentation area is a lowermost segmentation area of the driving image data; and

extracting, when the segmentation area is not the lowermost segmentation area, a candidate vanishing-point area corresponding to the segmentation area based on a partial vanishing point determined in a preceding segmentation area adjacent to the segmentation area.

2. The method of claim 1 , further comprising indicating the detected road line.

3. The method of claim 1 , further comprising:

extracting, when the segmentation area is the lowermost segmentation area, a candidate vanishing-point area corresponding to the segmentation area irrespective of a preceding segmentation area adjacent to the segmentation area.

4. The method of claim 1 , wherein the extracting of the candidate vanishing-point area comprises:

defining a bounding box having a predetermined distance from the partial vanishing point determined in the preceding segmentation area; and

extracting the candidate vanishing-point area using the bounding box.

5. The method of claim 1 , wherein the extracting of the candidate vanishing-point area comprises:

extracting a candidate vanishing-point area corresponding to the segmentation area based on the partial vanishing point determined in the preceding segmentation area and a driving parameter corresponding to the driving image data.

6. The method of claim 1 , wherein the segmenting comprises:

segmenting the driving image data into the segmentation areas horizontally while moving from a lowermost position toward a top of the driving image data.

7. The method of claim 1 , wherein the extracting of the at least one straight road line comprises:

extracting a line detection area from the segmentation area; and

extracting the at least one straight road line from the line detection area.

8. The method of claim 7 , wherein the extracting of the line detection area comprises:

extracting the line detection area based on a partial vanishing point corresponding to a preceding segmentation area of the segmentation area and a partial line corresponding to the preceding segmentation area.

9. The method of claim 1 , wherein the detecting of the partial line comprises:

determining a partial vanishing point corresponding to the segmentation area based on whether the at least one straight road line meets the candidate vanishing-point area; and

detecting a partial line corresponding to the segmentation area based on the partial vanishing point.

10. The method of claim 9 , wherein the detecting of the partial line comprises:

detecting a straight road line passing through the partial vanishing point among the at least one straight road line as the partial line.

11. The method of claim 9 , wherein the detecting of the partial line comprises:

detecting the partial line corresponding to the segmentation area based on whether the partial line is a continuation of a partial line corresponding to a preceding segmentation area of the segmentation area.

12. A processor-implemented method of detecting a road line, comprising:

segmenting a captured driving image data into a plurality of segmentation areas;

determining a candidate vanishing-point area corresponding to a segmentation area of the segmentation areas based on a partial vanishing point corresponding to a segmentation area adjacent to the segmentation area;

determining a line detection area corresponding to the segmentation area based on a partial line corresponding to the adjacent segmentation area and the partial vanishing point corresponding to the segmentation area adjacent to the segmentation area;

extracting at least one straight road line from the line detection area;

determining a partial vanishing point corresponding to the segmentation area based on whether the at least one straight road line meets the candidate vanishing-point area;

detecting a partial line corresponding to the segmentation area based on the determined partial vanishing point corresponding to the segmentation area; and

detecting a road line of the driving image data by connecting partial lines corresponding to the segmentation areas.

13. The method of claim 12 , wherein the determining of the candidate vanishing-point area comprises:

extracting a candidate vanishing-point area corresponding to the segmentation area based on the partial vanishing point corresponding to the adjacent segmentation area and a driving parameter corresponding to the driving image data.

14. The method of claim 12 , wherein the extracting of the at least one straight road line comprises:

extracting the line detection area from the segmentation area; and

extracting the at least one straight road line from the line detection area.

15. The method of claim 14 , wherein the extracting of the line detection area comprises:

extracting the line detection area based on the partial vanishing point corresponding to the adjacent segmentation area and a partial line corresponding to the adjacent segmentation area.

16. The method of claim 12 , wherein the detecting of the partial line comprises:

detecting a straight road line passing through the partial vanishing point corresponding to the segmentation area among the at least one straight road line as the partial line.

17. The method of claim 12 , wherein the detecting of the partial line comprises:

detecting the partial line corresponding to the segmentation area based on whether the partial line corresponding to the segmentation area is a continuation of a partial line corresponding to a preceding segmentation area.

18. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform the method of claim 1 .

19. A detection apparatus for detecting a road line, comprising:

a processor configured to:

segment a captured driving image data into a plurality of segmentation areas;

determine a candidate vanishing-point area corresponding to a segmentation area of the segmentation areas by:

a verification of whether the segmentation area is a lowermost segmentation area of the driving image data;

an extraction, when the segmentation area is the lowermost segmentation area, of a candidate vanishing-point area corresponding to the segmentation area irrespective of a preceding segmentation area adjacent to the segmentation area; and

an extracting, when the segmentation area is not the lowermost segmentation area, of a candidate vanishing-point area corresponding to the segmentation area based on a partial vanishing point determined in a preceding segmentation area adjacent to the segmentation area;

extract at least one straight road line from the segmentation area;

detect a partial line corresponding to the segmentation area based on whether the at least one straight road line meets the candidate vanishing-point area; and

detect the road line of the driving image data by connecting partial lines corresponding to the segmentation areas.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 28, 2019
From: AHN, MINSU; KIM, JIYEON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 048154/0655 →
Priority Claims (1)
KR 10-2018-0107070 · Sep 7, 2018 · national
Continuity (1)
Related Publication 20200082178A1 · Mar 12, 2020