IP Library Granted Patent US 10,359,518
Granted Patent B2
US 10,359,518 · App. 15/857,383 · Granted Jul 23, 2019

Vector data encoding of high definition map data for autonomous vehicles

Inventor: Mark Damon Wheeler (Saratoga, CA)
Assignee: DeepMap Inc.
G01S17/89G01C21/30G01C21/32G01S17/023G01S17/895G01S17/936G06K9/00798G06K9/00818G06K9/00825G06T9/20H04N19/17B60R11/04G01C11/025G05D1/0274G05D2201/0213G06F16/1744
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,359,518
App. No.
15/857,383
Granted
Jul 23, 2019
Kind
B2
Abstract

Embodiments relate to methods for efficiently encoding sensor data captured by an autonomous vehicle and building a high definition map using the encoded sensor data. The sensor data can be LiDAR data which is expressed as multiple image representations. Image representations that include important LiDAR data undergo a lossless compression while image representations that include LiDAR data that is more error-tolerant undergo a lossy compression. Therefore, the compressed sensor data can be transmitted to an online system for building a high definition map. When building a high definition map, entities, such as road signs and road lines, are constructed such that when encoded and compressed, the high definition map consumes less storage space. The positions of entities are expressed in relation to a reference centerline in the high definition map. Therefore, each position of an entity can be expressed in fewer numerical digits in comparison to conventional methods.

Claims (67)

1. A method comprising:

generating a high definition map using data captured by sensors mounted on one or more autonomous vehicles;

for each of a plurality of geographical regions in the high definition map:

generating a reference centerline that defines an origin point within the geographical region;

for each of a plurality of entities in the geographical region:

determining coordinates of the entity in relation to the origin point of the reference centerline; and

encoding each of the determined coordinates of the entity as one or more bytes;

generating compressed codes for the geographical region, the compressed codes for the geographical region comprising, for each of the plurality of entities in the geographical region, the one or more bytes representing coordinates of the entity; and

storing the compressed codes for the geographical region;

receiving a request for a geographical region of the high definition map from a particular autonomous vehicle; and

responsive to receiving the request, transmitting the compressed codes for the requested geographical region of the high definition map to the particular autonomous vehicle, wherein the particular autonomous vehicle performs navigation using the compressed codes for the requested geographical region.

2. The method of claim 1 , wherein generating compressed codes for the geographical region comprises applying a compression algorithm to the one or more bytes representing coordinates of the entity of the geographical region.

3. The method of claim 1 , wherein the generated reference centerline traces along a centerline of a road of the geographical region.

4. The method of claim 1 , wherein the determined coordinates of the entity are represented by four or fewer bytes.

5. The method of claim 1 , wherein the determined coordinates of the entity comprise an x-coordinate, a y-coordinate, and a z-coordinate, wherein the x-coordinate represents a distance between the reference centerline and the entity as measured by a line orthogonal to the reference centerline.

6. The method of claim 5 , wherein the y-coordinate represents a distance traced along a length of the reference centerline.

7. The method of claim 1 , wherein an entity in the geographical region is one of a lane line, a lane element, a navigable surface boundary, a stop or yield line, a zone, a traffic light, and a road sign.

8. The method of claim 1 , further comprising for at least one entity in the geographical region:

determining orientation coordinates of the at least one entity; and

encoding the determined orientation coordinates of the at least one entity in one or more bytes,

wherein the compressed codes for each geographical region further comprise the one or more bytes representing the orientation coordinates of the at least one entity in the geographical region.

9. The method of claim 8 , wherein the orientation coordinates of the at least one entity comprise a three dimensional normal vector of the at least one entity and a three dimensional vector representing an up direction of the entity.

10. The method of claim 1 , further comprising for at least one entity in the geographical region:

determining semantic information of the at least one entity; and

encoding the determined semantic information of the at least one entity in one or more bytes,

wherein the compressed codes for each geographical region further comprise the one or more bytes representing the semantic information of the at least one entity in the geographical region.

11. The method of claim 10 , wherein the semantic information of the at least one entity comprises dimensions of the at least one entity and a descriptive type of the at least one entity.

12. The method of claim 10 , wherein the semantic information of the at least one entity comprises a lane relationship between the at least one entity and an additional entity of the geographic region.

13. The method of claim 10 , wherein the semantic information of the at least one entity comprises a driving restriction enforced by the at least one entity.

14. The method of claim 1 , wherein the compressed codes for the geographical region further comprise a plurality of bytes representing the reference centerline of the road of the geographical region.

15. A non-transitory computer readable storage medium comprising computer instructions that, when executed by a processor, cause the processor to:

generate a high definition map using data captured by sensors mounted on one or more autonomous vehicles;

for each of a plurality of geographical regions in the high definition map:

generate a reference centerline that defines an origin point within the geographical region;

for each of a plurality of entities in the geographical region:

determine coordinates of the entity in relation to the origin point of the reference centerline; and

encode each of the determined coordinates of the entity as one or more bytes;

generate compressed codes for the geographical region, the compressed codes for the geographical region comprising, for each of the plurality of entities in the geographical region, the one or more bytes representing coordinates of the entity; and

store the compressed codes for the geographical region; and

receive a request for a geographical region of the high definition map from a particular autonomous vehicle; and

responsive to receiving the request, transmit the compressed codes for the requested geographical region of the high definition map to the particular autonomous vehicle, wherein the particular autonomous vehicle performs navigation using the compressed codes for the requested geographical region.

16. The non-transitory computer readable storage medium of claim 15 , wherein the generated reference centerline traces along a centerline of a road of the geographical region.

17. The non-transitory computer readable storage medium of claim 15 , wherein the determined coordinates of the entity are represented by four or fewer bytes.

18. The non-transitory computer readable storage medium of claim 15 , wherein the determined coordinates of the entity comprises an x-coordinate, a y-coordinate, and a z-coordinate, wherein the x-coordinate represents a distance between the reference centerline and the entity as measured by a line orthogonal to the reference centerline and wherein the y-coordinate represents a distance traced along a length of the reference centerline from the origin point to the line orthogonal to the reference centerline.

19. The non-transitory computer readable storage medium of claim 15 , further comprising computer instructions that, when executed by the processor, cause the processor to:

for at least one entity in the geographical region:

determine orientation coordinates of the at least one entity; and

encode the determined orientation coordinates of the at least one entity in one or more bytes,

wherein the compressed codes for each geographical region further comprise the one or more bytes representing the orientation coordinates of the at least one entity in the geographical region.

20. The non-transitory computer readable storage medium of claim 15 , further comprising computer instructions that, when executed by the processor, cause the processor to:

for at least one entity in the geographical region:

determine semantic information of the at least one entity; and

encode the determined semantic information of the at least one entity in one or more bytes,

wherein the compressed codes for each geographical region further comprise the one or more bytes representing the semantic information of the at least one entity in the geographical region.

21. A computer system comprising:

one or more computer processors; and

a non-transitory computer readable storage medium comprising computer instructions that, when executed by a processor, cause the processor to:

generate a high definition map using data captured by sensors mounted on one or more autonomous vehicles;

for each of a plurality of geographical regions in the high definition map:

generate a reference centerline that defines an origin point within the geographical region;

for each of a plurality of entities in the geographical region:

determine coordinates of the entity in relation to the origin point of the reference centerline; and

encode each of the determined coordinates of the entity as one or more bytes;

generate compressed codes for the geographical region, the compressed codes for the geographical region comprising, for each of the plurality of entities in the geographical region, the one or more bytes representing coordinates of the entity; and

store the compressed codes for the geographical region; and

receive a request for a geographical region of the high definition map from a particular autonomous vehicle; and

responsive to receiving the request, transmit the compressed codes for the requested geographical region of the high definition map to the particular autonomous vehicle, wherein the particular autonomous vehicle performs navigation using the compressed codes for the requested geographical region.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2022
From: DEEPMAP INC.
To: NVIDIA CORPORATION
Reel/Frame 061038/0311 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 5, 2019
From: DEEPMAP CAYMAN LIMITED
To: DEEPMAP INC.
Reel/Frame 050281/0787 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2018
From: DEEPMAP INC.
To: DEEPMAP CAYMAN LIMITED
Reel/Frame 046208/0934 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2018
From: WHEELER, MARK DAMON
To: DEEPMAP INC.
Reel/Frame 044946/0473 →
Continuity (2)
Provisional Application 62441065 · Dec 30, 2016
Related Publication 20180188372A1 · Jul 5, 2018
Cited By (1)
US 12,530,807