IP Library Granted Patent US 9,623,905
Granted Patent B2
US 9,623,905 · App. 15/273,030 · Granted Apr 18, 2017

Autonomous vehicle navigation based on recognized landmarks

Inventors: Amnon Shashua (Jerusalem, IL); Yoram Gdalyahu (Jerusalem, IL); Ofer Springer (Jerusalem, IL); Aran Reisman (Givatayim, IL); Daniel Braunstein (Jerusalem, IL)
Assignee: Mobileye Vision Technologies Ltd.
B62D15/025G01C21/32G05D1/0088G05D1/0212G05D1/0246G08G1/09623G08G1/167
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,623,905
App. No.
15/273,030
Granted
Apr 18, 2017
Kind
B2
Abstract

A system for autonomously navigating a vehicle along a road segment is disclosed. The system may have at least one processor. The processor may be programmed to receive from an image capture device at least one image representative of an environment of the vehicle. The processor may also be programmed to analyze the at least one image to identify at least one recognized landmark. Further, the processor may be programmed to determine a current location of the vehicle relative to a predetermined road model trajectory associated with the road segment based, at least in part, on a predetermined location of the recognized landmark. In addition, the processor may be programmed to determine an autonomous steering action for the vehicle based on a direction of the predetermined road model trajectory at the determined current location of the vehicle relative to the predetermined road model trajectory.

Claims (45)

1. A system for autonomously navigating a vehicle along a road segment, the system comprising:

at least one processor programmed to:

receive from an image capture device at least one image representative of an environment of the vehicle;

analyze the at least one image to identify at least one recognized landmark;

determine a current location of the vehicle relative to a predetermined road model trajectory associated with the road segment based, at least in part, on a predetermined location of the recognized landmark; and

determine an autonomous steering action for the vehicle based on a direction of the predetermined road model trajectory at the determined current location of the vehicle relative to the predetermined road model trajectory.

2. The system of claim 1 , wherein the recognized landmark includes at least one of a traffic sign, an arrow marking, a lane marking, a dashed lane marking, a traffic light, a stop line, a directional sign, a reflector, a landmark beacon, or a lamppost.

3. The system of claim 1 , wherein the recognized landmark includes a change in spacing of lines on the road segment.

4. The system of claim 1 , wherein the recognized landmark includes a sign for a business.

5. The system of claim 1 , wherein the predetermined road model trajectory includes a three-dimensional polynomial representation of a target trajectory along the road segment.

6. The system of claim 1 , wherein navigation between recognized landmarks includes integration of vehicle velocity to determine a location of the vehicle along the predetermined road model trajectory.

7. The system of claim 1 , wherein the processor is further programmed to adjust a steering system of the vehicle based on the autonomous steering action to navigate the vehicle.

8. The system of claim 1 , wherein the processor is further programmed to:

determine a distance of the vehicle from the at least one recognized landmark; and

determine whether the vehicle is positioned on the predetermined road model trajectory associated with the road segment based on the distance.

9. The system of claim 8 , wherein the processor is further programmed to adjust the steering system of the vehicle to move the vehicle from a current position of the vehicle to a position on the predetermined road model trajectory when the vehicle is not positioned on the predetermined road model trajectory.

10. A vehicle, comprising:

a body;

at least one image capture device configured to acquire at least one image representative of an environment of the vehicle; and

at least one processor programmed to:

receive from the at least one image capture device the at least one image;

analyze the at least one image to identify at least one recognized landmark;

determine a current location of the vehicle relative to a predetermined road model trajectory associated with the road segment based, at least in part, on a predetermined location of the recognized landmark; and

determine an autonomous steering action for the vehicle based on a direction of the predetermined road model trajectory at the determined current location of the vehicle relative to the predetermined road model trajectory.

11. The vehicle of claim 10 , wherein the recognized landmark includes at least one of a traffic sign, an arrow marking, a lane marking, a dashed lane marking, a traffic light, a stop line, a directional sign, a reflector, a landmark beacon, a lamppost, a change is spacing of lines on the road, or a sign for a business.

12. The vehicle of claim 10 , wherein the predetermined road model trajectory includes a three-dimensional polynomial representation of a target trajectory along the road segment.

13. The vehicle of claim 10 , wherein navigation between recognized landmarks includes integration of vehicle velocity to determine a location of the vehicle along the predetermined road model trajectory.

14. The vehicle of claim 10 , wherein the processor is further programmed to adjust the steering system of the vehicle based on the autonomous steering action to navigate the vehicle.

15. The vehicle of claim 10 , wherein the processor is further programmed to:

determine a distance of the vehicle from the at least one recognized landmark; and

determine whether the vehicle is positioned on the predetermined road model trajectory associated with the road segment based on the distance.

16. The vehicle of claim 15 , wherein the processor is further programmed to adjust the steering system of the vehicle to move the vehicle from a current position of the vehicle to a position on the predetermined road model trajectory when the vehicle is not positioned on the predetermined road model trajectory.

17. A method of navigating a vehicle, comprising:

receiving, from an image capture device associated with the vehicle, at least one image representative of an environment of the vehicle;

analyzing, using a processor associated with the vehicle, the at least one image to identify at least one recognized landmark;

determining a current position of the vehicle relative to a predetermined road model trajectory associated with the road segment based, at least in part, on a predetermined location of the recognized landmark;

determining an autonomous steering action for the vehicle based on a direction of the predetermined road model trajectory at the determined current location of the vehicle relative to the predetermined road model trajectory; and

adjusting a steering system of the vehicle based on the autonomous steering action to navigate the vehicle.

18. The method of claim 17 , further including determining a location of the vehicle along the predetermined road model trajectory by integrating the vehicle velocity.

19. The method of claim 17 , further including:

determining, using the processor, a distance of the vehicle from the at least one recognized landmark; and

determining whether the vehicle is positioned on the predetermined road model trajectory associated with the road segment based on the distance.

20. The method of claim 19 , further including:

determining a transformation required to move the vehicle from a current position of the vehicle to a position on the predetermined road model trajectory; and

adjusting the steering system of the vehicle based on the transformation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2017
From: SHASHUA, AMNON; GDALYAHU, YORAM; SPRINGER, OFER; REISMAN, ARAN; BRAUNSTEIN, DANIEL
To: MOBILEYE VISION TECHNOLOGIES LTD.
Reel/Frame 041477/0454 →
Continuity (22)
Continuation PCTUS2016017411 · Feb 10, 2016
Provisional Application 62114091 · Feb 10, 2015
Provisional Application 62164055 · May 20, 2015
Provisional Application 62170728 · Jun 4, 2015
Provisional Application 62181784 · Jun 19, 2015
Provisional Application 62192576 · Jul 15, 2015
Provisional Application 62215764 · Sep 9, 2015
Provisional Application 62219733 · Sep 17, 2015
Provisional Application 62261578 · Dec 1, 2015
Provisional Application 62261598 · Dec 1, 2015
Provisional Application 62267643 · Dec 15, 2015
Provisional Application 62269818 · Dec 18, 2015
Provisional Application 62270408 · Dec 21, 2015
Provisional Application 62270418 · Dec 21, 2015
Provisional Application 62270431 · Dec 21, 2015
Provisional Application 62271103 · Dec 22, 2015
Provisional Application 62274883 · Jan 5, 2016
Provisional Application 62274968 · Jan 5, 2016
Provisional Application 62275007 · Jan 5, 2016
Provisional Application 62275046 · Jan 5, 2016
Provisional Application 62277068 · Jan 11, 2016
Related Publication 20170008562A1 · Jan 12, 2017