IP Library Granted Patent US 12,140,446
Granted Patent B2
US 12,140,446 · App. 18/456,068 · Granted Nov 12, 2024

Automatic annotation of environmental features in a map during navigation of a vehicle

Inventor: Paul Stephen Rempola Averilla (Singapore, SG)
Assignee: Motional AD LLC
G01C21/3673G01C21/16G01S17/89G01S19/42G06T17/05G06T19/00G06T2219/004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,140,446
App. No.
18/456,068
Granted
Nov 12, 2024
Kind
B2
Abstract

Among other things, we describe techniques for automatic annotation of environmental features in a map during navigation of a vehicle. The techniques include receiving, by the vehicle located within an environment, a map of the environment. Sensors of the vehicle receive sensor data and semantic data. The sensor data includes a plurality of features of the environment. A geometric model of a feature of the plurality of features is generated. The feature is associated with a drivable area within the environment. A drivable segment is extracted from the drivable area. The drivable segment is segregated into a plurality of geometric blocks, wherein each geometric block corresponds to a characteristic of the drivable area and the geometric model of the feature includes the plurality of geometric blocks. The geometric model is annotated using the semantic data. The annotated geometric model is embedded within the map.

Claims (42)

1. A method comprising:

generating, using one or more processors, a geometric model of a feature in an environment of a vehicle based on sensor data obtained by one or more sensors, the generating comprising:

associating, using the one or more processors, the feature with an area within the environment;

determining, using the one or more processors, at least one drivable segment from the area;

determining, using the one or more processors, based on intensity values or a color model of the sensor data, a plurality of geometric blocks corresponding to the at least one drivable segment; and

generating, using the one or more processors, a polygon comprising the plurality of geometric blocks; and

annotating, using the one or more processors, the geometric model based on the polygon.

2. The method of claim 1 , wherein the polygon represents a splitting of a lane of the area into a plurality of lanes.

3. The method of claim 1 , wherein the polygon represents a merging of a plurality of lanes of the area into a single lane.

4. The method of claim 1 , wherein the polygon represents an intersection of a plurality of lanes of the area.

5. The method of claim 1 , wherein the polygon represents a roundabout comprising a spatial location in the area for the vehicle to enter or exit the roundabout.

6. The method of claim 1 , wherein the polygon represents a curving of a lane of the area.

7. The method of claim 1 , wherein the vehicle is located at a spatiotemporal location within the environment, and wherein the feature is associated with the spatiotemporal location.

8. The method of claim 1 , wherein the feature represents a plurality of lanes of the area, wherein each lane of the plurality of lanes is orientated in a same direction, and wherein each geometric block of the plurality of geometric blocks represents a single lane of the plurality of lanes.

9. The method of claim 1 , wherein the feature represents at least one of an elevation of the area, a curb located adjacent to the area, or a median separating two lanes of the area.

10. The method of claim 1 , wherein the area comprises at least one of a road segment, a parking space located on the road segment, a parking lot connected to the road segment, or a vacant lot located within the environment.

11. The method of claim 1 , further comprising determining, using the sensor data, a spatial location of the vehicle relative to a boundary of the area, the one or more sensors comprising a global navigation satellite system (GNSS) sensor or an inertial measurement unit (IMU).

12. The method of claim 1 , wherein the annotating of the geometric model comprises generating a computer-readable semantic annotation that combines the geometric model and semantic data, and

wherein the method further comprises transmitting, to a remote server or another vehicle, a map of the environment having the computer-readable semantic annotation.

13. The method of claim 12 , wherein the annotating of the geometric model is performed in a first mode of operation, and

wherein the method further comprises navigating, using a control module of the vehicle, the vehicle in the area in a second mode of operation using the map.

14. The method of claim 12 , wherein the semantic data represents at least one of a marking located within the environment, a road sign located within the environment, or a traffic signal located within the environment.

15. The method of claim 12 , wherein the annotating of the geometric model comprises extracting, from the semantic data, a logical driving constraint associated with navigating the vehicle in the area.

16. The method of claim 1 , wherein the sensor data comprises Light Detection and Ranging (LiDAR) point cloud data.

17. The method of claim 1 , wherein the color model comprises red, green, and blue (RGB) values.

18. The method of claim 1 , wherein determining the plurality of geometric blocks comprises dividing the at least one drivable segment into the plurality of geometric blocks.

19. A vehicle comprising:

one or more computer processors; and

one or more non-transitory storage media storing instructions which, when executed by the one or more computer processors, cause the one or more computer processors to:

generate a geometric model of a feature in an environment of a vehicle based on sensor data obtained by one or more sensors, the generating comprising:

associating the feature with an area within the environment;

determining at least one drivable segment from the area;

determining, based on intensity values or a color model of the sensor data, a plurality of geometric blocks corresponding to the at least one drivable segment; and

generating a polygon comprising the plurality of geometric blocks; and

annotate the geometric model based on the polygon.

20. One or more non-transitory storage media storing instructions which, when executed by one or more computing devices, cause one or more computing devices to:

generate a geometric model of a feature in an environment of a vehicle based on sensor data obtained by one or more sensors, the generating comprising:

associating the feature with an area within the environment;

determining at least one drivable segment from the area;

determining, based on intensity values or a color model of the sensor data, a plurality of geometric blocks corresponding to the at least one drivable segment; and

generating a polygon comprising the plurality of geometric blocks; and

annotate the geometric model based on the polygon.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2023
From: AVERILLA, PAUL STEPHEN REMPOLA
To: APTIV TECHNOLOGIES LIMITED
Reel/Frame 065059/0132 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2023
From: APTIV TECHNOLOGIES LIMITED
To: MOTIONAL AD LLC
Reel/Frame 065059/0210 →
Continuity (5)
Continuation 17734755 · May 2, 2022
Continuation 16656919 · Oct 18, 2019
Provisional Application 62802677 · Feb 7, 2019
Provisional Application 62752299 · Oct 29, 2018
Related Publication 20230408286A1 · Dec 21, 2023