IP Library › Granted Patent US 11,645,839
Granted Patent B2
US 11,645,839 · App. 17/317,378 · Granted May 9, 2023

Lane feature detection in aerial images based on road geometry

Inventor: Abhilshit Soni (Nadiad, IN)
Assignee: HERE Global B.V.
G06V20/182G01C21/30G01C21/3602G06K9/6228G06K9/6256G06K9/6261G06T7/60G06T3/60G06T2207/10032G06T2207/30181
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,645,839
App. No.
17/317,378
Granted
May 9, 2023
Kind
B2
Abstract

An apparatus and method for lane feature detection from an image is performed according to predetermined path geometry. An image including at least one path is received. The image may be an aerial image. Map data, corresponding to the at least one path and defining the predetermined path geometry is selected. The image is modified according to the selected map data including the predetermined path geometry. A lane feature prediction model is generated or configured based on the modified image. A subsequent image is provided to the lane feature prediction model for a prediction of at least one lane feature.

Claims (43)

1. A method for lane feature detection from an aerial image, the method comprising:

receiving an aerial image including at least one road;

generating a ground truth mask including at least one road geometry for the at least one road by accessing a width value for the at least one road from the map data, the at least one road geometry having a dimension corresponding to the width value;

modifying the aerial image according to the ground truth mask;

generating, using a processor, a lane feature prediction model based on the modified aerial image; and

providing a subsequent aerial image to the lane feature prediction model for a prediction of at least one lane feature.

2. The method of claim 1 , wherein the ground truth mask comprises mask values.

3. The method of claim 1 , wherein the mask values include a first value for at least one portion of the aerial image that correspond to the at least one road and a second value for at least one portion of the aerial image other than the at least one road.

4. The method of claim 1 , further comprising:

receiving probe data for the at least one path; and

analyzing the probe data to derive the width value.

5. The method of claim 1 , further comprising:

performing an aerial image processing algorithm on the aerial image including the at least one path, wherein the aerial image processing algorithm includes segmentation of a road surface or filtering of pixel values for a centerline for the at least one path,

wherein the width value is derived from an output of the aerial image processing algorithm.

6. The method of claim 5 , further comprising:

accessing the centerline for the at least one path from the map data.

7. The method of claim 4 , wherein the width is based on a number of lanes included in the at least one road or a functional classification of the at least one road.

8. The method of claim 1 , further comprising:

dividing the modified aerial image into a plurality of training aerial images according to a patch size, wherein each of the plurality of training aerial images includes at least a portion of the at least one path.

9. The method of claim 8 , further comprising:

rotating at least one of the plurality of training aerial images to a predetermined angle.

10. The method of claim 8 , wherein the plurality of training aerial images are spaced apart in a direction of the at least one road.

11. The method of claim 1 , further comprising:

identifying a scaling factor for a relationship between pixel size in the aerial image and geographic distance in the map data.

12. The method of claim 1 , further comprising:

receiving a navigation request; and

providing a navigation message including the prediction of at least one lane feature in response to the navigation request.

13. An apparatus for lane feature detection from an aerial image according to predetermined path geometry, the apparatus comprising:

a controller configured to identify map data corresponding to at least one road having a geometry, access a width value for the at least one road from the map data, the at least one road geometry having a dimension corresponding to the width value, and generate a ground truth mask including for the at least one road;

an aerial image editor configured to modify the aerial image according to the ground truth mask and the geometry of the at least one road; and

a lane feature model trained according to the modified aerial image and configured to identify at least one lane feature from a subsequent aerial image.

14. The apparatus of claim 13 , further comprising:

an aerial image trainer configured to identify a plurality of training patch aerial images from the modified aerial image.

15. The apparatus of claim 14 , wherein the aerial image trainer is configured rotate at least one of the plurality of training patch aerial image to a predetermined angle.

16. The apparatus of claim 13 , wherein the controller identifies a scaling factor to relate the map data and the aerial image, wherein the predetermined path geometry is sized according to the scaling factor.

17. The apparatus of claim 13 , wherein the aerial image editor modifies the aerial image according to a ground truth mask.

18. The apparatus of claim 17 , wherein the ground truth mask includes a first mask value for portions inside the predetermined path geometry and a second mask for portions outside the predetermined path geometry.

19. A non-transitory computer readable medium including instructions that when executed by a process are configured to perform:

receiving an aerial image including at least one road;

generating a ground truth mask including at least one road geometry for the at least one road and accessing a width value for the at least one road from the map data, the at least one road geometry having a dimension corresponding to the width value;

modifying the aerial image according to the ground truth mask;

generating, using a processor, a lane feature prediction model based on the modified aerial image; and

providing a subsequent aerial image to the lane feature prediction model for a prediction of at least one lane feature.

Assignments (1)
ASSIGNMENT FOR CONTINUATION OF PATENT APPLICATION NO. 16/222,111 Recorded May 12, 2021
From: SONI, ABHILSHIT
To: HERE GLOBAL B.V.
Reel/Frame 056223/0779 →
Continuity (2)
Continuation 16222111 · Dec 17, 2018
Related Publication 20210264151A1 · Aug 26, 2021
Cited By (3)
US 12,597,270 US 12,718,593 US 12,737,909