IP Library Granted Patent US 11,599,113
Granted Patent B2
US 11,599,113 · App. 16/554,437 · Granted Mar 7, 2023

Crowd sourcing data for autonomous vehicle navigation

Inventors: Amnon Shashua (Mevaseret Zion, IL); Yoram Gdalyahu (Jerusalem, IL); Ofer Springer (Jerusalem, IL); Aran Reisman (Givatayim, IL); Daniel Braunstein (Jerusalem, IL)
Assignee: MOBILEYE VISION TECHNOLOGIES LTD.
G05D1/0088B60W30/14B60W30/18B62D15/025G01C21/14G01C21/1652G01C21/1656G01C21/34G01C21/3407G01C21/3476G01C21/36G01C21/3602G01C21/3623G01C21/3644G01C21/3691G05D1/0212G05D1/0219G05D1/0221G05D1/0246G05D1/0251G05D1/0253G05D1/0278G05D1/0287G06F16/2379G06F16/29G06V20/56G06V20/582G06V20/584G06V20/588G06V20/63G08G1/0112G08G1/09623G08G1/096725G08G1/096805G08G1/167B60W2420/42B60W2555/60B60W2710/18B60W2710/20B60W2720/10G01C21/3811G01C21/3819G01C21/3822G01S19/10G05D2201/0213G06T7/00G06T2207/20081G06T2207/30256G06T2207/30261H04L67/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,599,113
App. No.
16/554,437
Granted
Mar 7, 2023
Kind
B2
Abstract

Systems and methods of processing crowdsourced navigation information for use in autonomous vehicle navigation are disclosed. A method may include processing, by a mapping server, crowdsourced navigation information from a plurality of vehicles obtained by sensors coupled to the plurality of vehicles, wherein the navigation information describes road lanes of a road segment; collecting data about landmarks identified proximate to the road segment, the landmarking including a traffic sign; generating, by the mapping server, an autonomous vehicle map for the road segment, wherein the autonomous vehicle map includes a spline corresponding to a lane in the road segment and the landmarks identified proximate to the road segment; and distributing, by the mapping server, the autonomous vehicle map to an autonomous vehicle for use in autonomous navigation over the road segment.

Claims (71)

1. A method of processing crowdsourced navigation information for use in autonomous vehicle navigation, the method comprising:

processing, by a mapping server, crowdsourced navigation information from a plurality of vehicles obtained by sensors coupled to the plurality of vehicles, wherein the crowdsourced navigation information describes road lanes of a road segment;

collecting data about a first landmark identified proximate to the road segment, the first landmark comprising a traffic sign;

generating, by the mapping server, an autonomous vehicle map for the road segment, wherein:

the autonomous vehicle map includes a spline corresponding to a lane in the road segment;

the autonomous vehicle map includes position information of the first landmark identified proximate to the road segment, the position information including at least one of a physical size of the first landmark, a distance between the first landmark and the road segment, a height of the first landmark, or a distance between the first landmark and a second landmark;

the position information of the first landmark is based on the crowdsourced navigation information from the plurality of vehicles; and

the autonomous vehicle map is configured for an autonomous vehicle to use the position information of the first landmark for vehicle localization relative to the spline; and

distributing, by the mapping server, the autonomous vehicle map to the autonomous vehicle for use in autonomous navigation over the road segment.

2. The method of claim 1 , crowdsourced navigation information includes road geometry data.

3. The method of claim 1 , wherein the plurality of vehicles includes autonomous vehicles.

4. The method of claim 1 , wherein sensor data obtained by the sensors includes road geometry data.

5. At least one non-transitory machine-readable medium including instructions for processing crowdsourced navigation information for use in autonomous vehicle navigation, wherein the instructions, when executed by a mapping server, cause the mapping server to perform operations comprising:

processing crowdsourced navigation information from a plurality of vehicles obtained by sensors coupled to the plurality of vehicles, wherein the crowdsourced navigation information describes road lanes of a road segment;

collecting data about a first landmark identified proximate to the road segment, the first landmark comprising a traffic sign;

generating an autonomous vehicle map for the road segment, wherein:

the autonomous vehicle map includes a spline corresponding to a lane in the road segment;

the autonomous vehicle map includes position information of the first landmark identified proximate to the road segment, the position information including at least one of a physical size of the first landmark, a distance between the first landmark and the road segment, a height of the first landmark, or a distance between the first landmark and a second landmark;

the position information of the first landmark is based on the crowdsourced navigation information from the plurality of vehicles; and

the autonomous vehicle map is configured for an autonomous vehicle to use the position information of the first landmark for vehicle localization relative to the spline; and

distributing the autonomous vehicle map to the autonomous vehicle for use in autonomous navigation over the road segment.

6. The at least one non-transitory machine-readable medium of claim 5 , wherein the crowdsourced navigation information includes road geometry data.

7. The at least one non-transitory machine-readable medium of claim 5 , wherein the plurality of vehicles includes autonomous vehicles.

8. The at least one non-transitory machine-readable medium of claim 5 , wherein sensor data obtained by the sensors includes road geometry data.

9. A mapping server for processing crowdsourced navigation information for use in autonomous vehicle navigation, the mapping server comprising:

at least one processor; and

a memory device including instructions, which when executed by the at least one processor, cause the at least one processor to:

process crowdsourced navigation information from a plurality of vehicles obtained by sensors coupled to the plurality of vehicles, wherein the crowdsourced navigation information describes road lanes of a road segment;

collect data about a first landmark identified proximate to the road segment, the first landmark comprising a traffic sign;

generate an autonomous vehicle map for the road segment, wherein:

the autonomous vehicle map includes a spline corresponding to a lane in the road segment;

the autonomous vehicle map includes position information of the first landmark identified proximate to the road segment, the position information including at least one of a physical size of the first landmark, a distance between the first landmark and the road segment, a height of the first landmark, or a distance between the first landmark and a second landmark;

the position information of the first landmark is based on the crowdsourced navigation information from the plurality of vehicles; and

the autonomous vehicle map is configured for an autonomous vehicle to use the position information of the first landmark for vehicle localization relative to the spline; and

distribute the autonomous vehicle map to the autonomous vehicle for use in autonomous navigation over the road segment.

10. The mapping server of claim 9 , wherein the crowdsourced navigation information includes road geometry data.

11. The mapping server of claim 9 , wherein the plurality of vehicles includes autonomous vehicles.

12. The mapping server of claim 9 , wherein sensor data obtained by the sensors includes road geometry data.

13. A vehicle system for assisting autonomous vehicle navigation using crowdsourced navigation information, the vehicle system comprising:

at least one processor; and

a memory device including instructions, which when executed by the at least one processor, cause the at least one processor to:

access navigation information at the vehicle system, the navigation information derived from sensor data obtained by a plurality of sensors coupled to the vehicle system;

provide the navigation information to a mapping server, the navigation information processed by the mapping server including crowdsourced navigation information from a plurality of vehicles obtained by sensors coupled to the plurality of vehicles, wherein the crowdsourced navigation information describes road lanes of a road segment; and

receive an autonomous vehicle map, wherein:

the autonomous vehicle map includes a spline corresponding to a lane in the road segment;

the autonomous vehicle map includes position information of a first landmark identified proximate to the road segment, the position information including at least one of a physical size of the first landmark, a distance between the first landmark and the road segment, a height of the first landmark, or a distance between the first landmark and a second landmark;

the position information of the first landmark is based on the crowdsourced navigation information from the plurality of vehicles; and

the autonomous vehicle map is configured for an autonomous vehicle to use the position information of the first landmark for vehicle localization relative to the spline.

14. The vehicle system of claim 13 , wherein the crowdsourced navigation information includes road geometry data.

15. The vehicle system of claim 13 , wherein the plurality of vehicles includes autonomous vehicles.

16. The vehicle system of claim 13 , wherein sensor data obtained by the sensors includes road geometry data.

17. At least one non-transitory machine-readable device including instructions for assisting autonomous vehicle navigation using crowdsourced navigation information, wherein the instructions, when executed by a vehicle system, cause the vehicle system to perform operations comprising:

accessing navigation information at the vehicle system, the navigation information derived from sensor data obtained by a plurality of sensors coupled to the vehicle system;

providing the navigation information to a mapping server, the navigation information processed by the mapping server including crowdsourced navigation information from a plurality of vehicles obtained by sensors coupled to the plurality of vehicles, wherein the crowdsourced navigation information describes road lanes of a road segment; and

receiving an autonomous vehicle map, wherein:

the autonomous vehicle map includes a spline corresponding to a lane in the road segment;

the autonomous vehicle map includes position information of a first landmark identified proximate to the road segment, the position information including at least one of a physical size of the first landmark, a distance between the first landmark and the road segment, a height of the first landmark, or a distance between the first landmark and a second landmark;

the position information of the first landmark is based on the crowdsourced navigation information from the plurality of vehicles; and

the autonomous vehicle map is configured for an autonomous vehicle to use the position information of the first landmark for vehicle localization relative to the spline.

18. The at least one non-transitory machine-readable device of claim 17 , wherein the crowdsourced navigation information includes road geometry data.

19. The at least one non-transitory machine-readable device of claim 17 , wherein the plurality of vehicles includes autonomous vehicles.

20. The at least non-transitory one machine-readable device of claim 17 , wherein the sensor data obtained by the sensors includes road geometry data.

21. The method of claim 1 , wherein the position information of the first landmark identified proximate to the road segment is associated with a signature of the first landmark in the autonomous vehicle map.

22. The method of claim 1 , wherein generating the autonomous vehicle map includes combining different parts of the crowdsourced navigation information, the different parts being associated with different ones of the plurality of vehicles.

23. The method of claim 22 , wherein combining the different parts of the crowdsourced navigation information includes averaging the different parts of the crowdsourced navigation information.

24. The method of claim 1 , wherein generating the autonomous vehicle map includes matching, using the position information of the first landmark, a first curve based on first navigation information associated with a first vehicle and a second curve based on second navigation information associated with a second vehicle.

25. The method of claim 1 , wherein the autonomous vehicle map further includes the distance between the first landmark and a second landmark, and the autonomous vehicle is configured to use the distance for vehicle localization.

26. The method of claim 1 , wherein the autonomous vehicle map is configured for an autonomous vehicle to use the position information of the first landmark for vehicle localization along the spline.

27. The method of claim 26 , wherein the spline corresponds to a target trajectory for the autonomous vehicle.

28. The method of claim 1 , wherein the spline corresponds to a target trajectory in the lane and the autonomous vehicle map is configured for the autonomous vehicle to use the position information of the first landmark for vehicle localization relative to the target trajectory.

29. The method of claim 1 , wherein generating the autonomous vehicle map comprises matching, using two or more landmarks, curves determined by different vehicles during different drives.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2022
From: SHASHUA, AMNON; GDALYAHU, YORAM; SPRINGER, OFER; REISMAN, ARAN; BRAUNSTEIN, DANIEL
To: MOBILEYE VISION TECHNOLOGIES LTD.
Reel/Frame 061787/0128 →
Continuity (23)
Continuation 15673323 · Aug 9, 2017
Continuation PCTUS2016017411 · Feb 10, 2016
Provisional Application 62277068 · Jan 11, 2016
Provisional Application 62275046 · Jan 5, 2016
Provisional Application 62275007 · Jan 5, 2016
Provisional Application 62274968 · Jan 5, 2016
Provisional Application 62274883 · Jan 5, 2016
Provisional Application 62271103 · Dec 22, 2015
Provisional Application 62270431 · Dec 21, 2015
Provisional Application 62270418 · Dec 21, 2015
Provisional Application 62270408 · Dec 21, 2015
Provisional Application 62269818 · Dec 18, 2015
Provisional Application 62267643 · Dec 15, 2015
Provisional Application 62261598 · Dec 1, 2015
Provisional Application 62261578 · Dec 1, 2015
Provisional Application 62219733 · Sep 17, 2015
Provisional Application 62215764 · Sep 9, 2015
Provisional Application 62192576 · Jul 15, 2015
Provisional Application 62181784 · Jun 19, 2015
Provisional Application 62170728 · Jun 4, 2015
Provisional Application 62164055 · May 20, 2015
Provisional Application 62114091 · Feb 10, 2015
Related Publication 20190384294A1 · Dec 19, 2019
Cited By (2)
US 12,314,364 US 12,485,755