IP Library › Granted Patent US 11,392,123
Granted Patent B2
US 11,392,123 · App. 16/672,277 · Granted Jul 19, 2022

Crowd sourcing data for autonomous vehicle navigation

Inventors: Amnon Shashua (Jerusalem, IL); Yoram Gdalyahu (Jerusalem, IL); Ofer Springer (Jerusalem, IL); Aran Reisman (Givatayim, IL); Daniel Braunstein (Jerusalem, IL)
Assignee: Mobileye Vision Technologies Ltd.
G05D1/0088B60W30/14B60W30/18B62D15/025G01C21/14G01C21/165G01C21/32G01C21/34G01C21/3407G01C21/3476G01C21/36G01C21/3602G01C21/3623G01C21/3644G01C21/3691G05D1/0212G05D1/0219G05D1/0221G05D1/0246G05D1/0251G05D1/0253G05D1/0278G05D1/0287G06F16/2379G06F16/29G06V20/56G06V20/582G06V20/584G06V20/588G06V20/63G08G1/0112G08G1/09623G08G1/096725G08G1/096805G08G1/167B60W2420/42B60W2555/60B60W2710/18B60W2710/20B60W2720/10G01S19/10G05D2201/0213G06T7/00G06T2207/20081G06T2207/30256G06T2207/30261H04L67/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,392,123
App. No.
16/672,277
Filed
Nov 1, 2019
Granted
Jul 19, 2022
Kind
B2
Art Unit
3663
USPC
701/423
Abstract

Systems and methods are provided for constructing, using, and updating the sparse map for autonomous vehicle navigation. A method may comprise processing, by a mapping server, collected navigation information from a plurality of vehicles obtained by sensors coupled to the plurality of vehicles, wherein the navigation information describes road lanes of a road segment; collecting data about landmarks identified proximate to the road segment, the landmarking including a traffic sign; generating, by the mapping server, an autonomous vehicle map for the road segment, wherein the autonomous vehicle map includes a spline corresponding to a lane in the road segment and the landmarks identified proximate to the road segment; and distributing, by the mapping server, the autonomous vehicle map to an autonomous vehicle for use in autonomous navigation over the road segment.

Claims (65)

1. A method of processing collected navigation information for use in autonomous vehicle navigation, the method comprising:

processing, by a mapping server, collected navigation information from a plurality of vehicles obtained by sensors coupled to the plurality of vehicles, wherein the navigation information describes road lanes of a road segment;

collecting data about a landmark position of a landmark identified, by the plurality of vehicles, proximate to the road segment, the landmark including a traffic sign;

generating, by the mapping server, an autonomous vehicle map for the road segment by clustering data from the collected navigation information and the landmark position from the plurality of vehicles, wherein the autonomous vehicle map includes a spline corresponding to a lane in the road segment and the landmark identified proximate to the road segment, and wherein clustering the data from the collected navigation information and the landmark position resolves variances in the data for the landmark position for the road lanes and the landmark position from the plurality of vehicles; and

distributing, by the mapping server, the autonomous vehicle map to an autonomous vehicle for use in autonomous navigation over the road segment.

2. The method of claim 1 , navigation information includes road geometry data.

3. The method of claim 1 , wherein the plurality of vehicles includes autonomous vehicles.

4. The method of claim 1 , wherein sensor data obtained by the sensors includes road geometry data.

5. At least one machine-readable medium including instructions for processing collected navigation information for use in autonomous vehicle navigation, the instruction, which when executed by a mapping server, cause the mapping server to perform operations comprising:

processing collected navigation information from a plurality of vehicles obtained by sensors coupled to the plurality of vehicles, wherein the navigation information describes road lanes of a road segment;

collecting data about a landmark position of a landmark identified, by the plurality of vehicles, proximate to the road segment, the landmark including a traffic sign;

generating an autonomous vehicle map for the road segment by clustering data from the collected navigation information and the landmark position from the plurality of vehicles, wherein the autonomous vehicle map includes a spline corresponding to a lane in the road segment and the landmark identified proximate to the road segment, and wherein clustering the data from the collected navigation information and the landmark position resolves variances in the data for the landmark position for the road lanes and the landmark position from the plurality of vehicles; and

distributing the autonomous vehicle map to an autonomous vehicle for use in autonomous navigation over the road segment.

6. The at least one machine-readable medium of claim 5 , navigation information includes road geometry data.

7. The at least one machine-readable medium of claim 5 , wherein the plurality of vehicles includes autonomous vehicles.

8. The at least one machine-readable medium of claim 5 , wherein sensor data obtained by the sensors includes road geometry data.

9. A mapping server for processing collected navigation information for use in autonomous vehicle navigation, comprising:

a processor; and

a memory device including instructions, which when executed by the processor, cause the processor to:

process collected navigation information from a plurality of vehicles obtained by sensors coupled to the plurality of vehicles, wherein the navigation information describes road lanes of a road segment;

collect data about a landmark position of a landmark identified, by the plurality of vehicles, proximate to the road segment, the landmark including a traffic sign;

generate an autonomous vehicle map for the road segment by clustering data from the collected navigation information and the landmark position from the plurality of vehicles, wherein the autonomous vehicle map includes a spline corresponding to a lane in the road segment and the landmark identified proximate to the road segment, and wherein clustering the data from the collected navigation information and the landmark position resolves variances in the data for the landmark position for the road lanes and the landmark position from the plurality of vehicles; and

distribute the autonomous vehicle map to an autonomous vehicle for use in autonomous navigation over the road segment.

10. The mapping server of claim 9 , navigation information includes road geometry data.

11. The mapping server of claim 9 , wherein the plurality of vehicles includes autonomous vehicles.

12. The mapping server of claim 9 , wherein sensor data obtained by the sensors includes road geometry data.

13. A vehicle system for assisting autonomous vehicle navigation using collected navigation information, comprising:

a processor; and

a memory device including instructions, which when executed by the processor, cause the processor to:

access navigation information at the vehicle system, the navigation information derived from sensor data obtained by a plurality of sensors coupled to the vehicle system;

provide the navigation information to a mapping server, the navigation information processed by the mapping server as crowdsourced navigation information from a plurality of vehicles obtained by sensors coupled to the plurality of vehicles, wherein the navigation information describes road lanes of a road segment and a landmark position of a landmark identified proximate to the road segment; and

receive an autonomous vehicle map, the autonomous vehicle map created by clustering the road lanes and the landmark position from the plurality of vehicles, the autonomous vehicle map including a spline corresponding to a lane in the road segment and the landmark identified proximate to the road segment for use in autonomous navigation over the road segment, wherein clustering the road lanes and the landmark position resolves variances in data for the landmark position for the road lanes and the landmark position from the plurality of vehicles.

14. The vehicle system of claim 13 , wherein navigation information includes road geometry data.

15. The vehicle system of claim 13 , wherein the plurality of vehicles includes autonomous vehicles.

16. The vehicle system of claim 13 , wherein sensor data obtained by the sensors includes road geometry data.

17. At least one machine-readable device including instructions for assisting autonomous vehicle navigation using collected navigation information, the instructions, which when executed by a vehicle system, cause the vehicle system to perform operations comprising:

accessing navigation information at the vehicle system, the navigation information derived from sensor data obtained by a plurality of sensors coupled to the vehicle system;

providing the navigation information to a mapping server, the navigation information processed by the mapping server as crowdsourced navigation information from a plurality of vehicles obtained by sensors coupled to the plurality of vehicles, wherein the navigation information describes road lanes of a road segment and a landmark position of a landmark identified proximate to the road segment; and

receiving an autonomous vehicle map, the autonomous vehicle map created by clustering the road lanes and the landmark position from the plurality of vehicles, the autonomous vehicle map including a spline corresponding to a lane in the road segment and the landmark identified proximate to the road segment for use in autonomous navigation over the road segment, wherein clustering the road lanes and the landmark position resolves variances in data for the landmark position for the road lanes and the landmark position from the plurality of vehicles.

18. The at least one machine-readable device of claim 17 , wherein navigation information includes road geometry data.

19. The at least one machine-readable device of claim 17 , wherein the plurality of vehicles includes autonomous vehicles.

20. The at least one machine-readable device of claim 17 , wherein sensor data obtained by the sensors includes road geometry data.

21. A vehicle system for assisting autonomous vehicle navigation, the vehicle system for installation in a vehicle and comprising:

a processor; and

a memory including instructions, which when executed by the processor, cause the processor to:

access a collected-data-generated sparse map, the collected-data-generated sparse map including a spline representation of a lane marking and metadata to describe the lane represented by the lane marking, and the collected-data-generated sparse map created by clustering data on road lanes and a landmark position with respect to a road segment obtained from a plurality of vehicles, wherein clustering the data on the road lanes and the landmark position resolves variances in the data for the landmark position for the road lanes and the landmark position from the plurality of vehicles;

obtain image data corresponding to an image from a camera, the image corresponding to an environment external to the vehicle; and

analyze the collected-data-generated sparse map and image data to determine an autonomous navigational response of the vehicle.

22. The system of claim 21 , wherein the plurality of vehicles includes autonomous vehicles.

23. At least one machine-readable medium including instructions for assisting autonomous vehicle navigation, which when executed by a machine, cause the machine to perform the operations comprising:

accessing a collected-data-generated sparse map, the collected-data-generated sparse map including a spline representation of a lane marking and metadata to describe the lane represented by the lane marking, and the collected-data-generated sparse map created by clustering data on road lanes and a landmark position with respect to a road segment obtained from a plurality of vehicles, wherein clustering the data on the road lanes and the landmark position resolves variances in the data for the landmark position for the road lanes and the landmark position from the plurality of vehicles;

obtaining image data corresponding to an image from a camera, the image corresponding to an environment external to the vehicle; and

analyzing the collected-data-generated sparse map and image data to determine an autonomous navigational response of the vehicle.

24. The at least one machine-readable medium of claim 23 , wherein the plurality of vehicles includes autonomous vehicles.

25. An autonomous vehicle including:

a body;

a camera mounted to the body; and

a processing unit to:

access a collected-data-generated sparse map, the collected-data-generated sparse map including a spline representation of a lane marking and metadata to describe the lane represented by the lane marking, and the collected-data-generated sparse map created by clustering data on road lanes and a landmark position with respect to a road segment obtained from a plurality of vehicles, wherein clustering the data on the road lanes and the landmark position resolves variances in the data for the landmark position for the road lanes and the landmark position from the plurality of vehicles;

obtain image data corresponding to an image from the camera, the image corresponding to an environment external to the autonomous vehicle; and

analyze the collected-data-generated sparse map and image data to determine an autonomous navigational response of the autonomous vehicle.

26. The autonomous vehicle of claim 25 , further comprising a throttling system.

27. The autonomous vehicle of claim 25 , further comprising a braking system.

28. The autonomous vehicle of claim 25 , further comprising a steering system.

29. The autonomous vehicle of claim 25 , wherein the plurality of vehicles includes autonomous vehicles.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2019
From: SHASHUA, AMNON; GDALYAHU, YORAM; SPRINGER, OFER; REISMAN, ARAN; BRAUNSTEIN, DANIEL
To: MOBILEYE VISION TECHNOLOGIES LTD.
Reel/Frame 050894/0797 →
Continuity (23)
Continuation 15673334 · Aug 9, 2017
Continuation PCTUS2016017411 · Feb 11, 2016
Provisional Application 62277068 · Jan 11, 2016
Provisional Application 62274883 · Jan 5, 2016
Provisional Application 62274968 · Jan 5, 2016
Provisional Application 62275007 · Jan 5, 2016
Provisional Application 62275046 · Jan 5, 2016
Provisional Application 62271103 · Dec 22, 2015
Provisional Application 62270408 · Dec 21, 2015
Provisional Application 62270431 · Dec 21, 2015
Provisional Application 62270418 · Dec 21, 2015
Provisional Application 62269818 · Dec 18, 2015
Provisional Application 62267643 · Dec 15, 2015
Provisional Application 62261598 · Dec 1, 2015
Provisional Application 62261578 · Dec 1, 2015
Provisional Application 62219733 · Sep 17, 2015
Provisional Application 62215764 · Sep 9, 2015
Provisional Application 62192576 · Jul 15, 2015
Provisional Application 62181784 · Jun 19, 2015
Provisional Application 62170728 · Jun 4, 2015
Provisional Application 62164055 · May 20, 2015
Provisional Application 62114091 · Feb 10, 2015
Related Publication 20200064843A1 · Feb 27, 2020