IP Library Granted Patent US 9,696,719
Granted Patent B2
US 9,696,719 · App. 15/272,610 · Granted Jul 4, 2017

Super landmarks as navigation aids

Inventor: Yuval Aviel (Eshtaol, IL)
Assignee: Mobileye Vision Technologies Ltd.
G05D1/0088B60W30/18B62D15/025G01C21/14G01C21/165G01C21/32G01C21/34G01C21/3476G01C21/36G01C21/3623G01C21/3691G05D1/0212G05D1/0246G05D1/0278G05D1/0287G06F17/30241G06F17/30377G06K9/00791G06K9/00798G08G1/0112G08G1/09623G08G1/096725G08G1/167B60W2420/42B60W2550/22B60W2720/10G06T7/00G06T2207/20081G06T2207/30256G06T2207/30261H04L67/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,696,719
App. No.
15/272,610
Granted
Jul 4, 2017
Kind
B2
Abstract

Systems and methods are provided for autonomously navigating a vehicle along a road segment. In one implementation, a system includes at least one processor programmed to receive from a camera at least one image representative of an environment of the vehicle. The at least one image may be analyzed to identify at least one recognized landmark based upon one or more landmark group characteristics associated with a group of recognized landmarks. The current location of the vehicle relative to a predetermined road model trajectory associated with the road segment may be determined based, at least in part, on a predetermined location of the recognized landmark. An autonomous steering action for the vehicle may be determined based on a direction of the predetermined road model trajectory at the determined current location of the vehicle relative to the predetermined road model trajectory.

Claims (41)

1. A system for autonomously navigating a vehicle along a road segment, the system comprising:

at least one processor programmed to:

receive from a camera at least one image representative of an environment of the vehicle;

analyze the at least one image to identify at least one recognized landmark, wherein the at least one recognized landmark is part of a group of recognized landmarks, and identification of the at least one recognized landmark is based, at least in part, upon one or more landmark group characteristics associated with the group of recognized landmarks;

update a current location of the vehicle relative to a predetermined road model trajectory associated with the road segment based, at least in part, on a predetermined location of the recognized landmark; and

determine an autonomous steering action for the vehicle based on a direction of the predetermined road model trajectory at the determined current location of the vehicle relative to the predetermined road model trajectory.

2. The system of claim 1 , wherein the at least one recognized landmark includes at least one of a traffic sign, an arrow marking, a lane marking, a dashed lane marking, a traffic light, a stop line, a directional sign, a reflector, a landmark beacon, or a lamppost.

3. The system of claim 1 , wherein the at least one recognized landmark includes a sign for a business.

4. The system of claim 1 , wherein the predetermined road model trajectory includes a three-dimensional polynomial representation of a target trajectory along the road segment.

5. The system of claim 1 , wherein the at least one processor is further programmed to determine a current location of the vehicle along the predetermined road model trajectory based on a vehicle velocity.

6. The system of claim 1 , wherein the one or more landmark group characteristics include relative distances between members of the group of recognized landmarks.

7. The system of claim 1 , wherein the one or more landmark group characteristics include an ordering sequence of members of the group of recognized landmarks.

8. The system of claim 1 , wherein the one or more landmark group characteristics include a number of landmarks included in the group of recognized landmarks.

9. The system of claim 1 , wherein identification of the at least one recognized landmark is based, at least in part, upon a super landmark signature associated with the group of recognized landmarks.

10. The system of claim 1 , wherein the at least one processor is programmed to determine an autonomous steering action for the vehicle by comparing a heading direction of the vehicle to the predetermined road model trajectory at the determined current location of the vehicle.

11. A computer-implemented method for autonomously navigating a vehicle along a road segment, the method comprising the following operations performed by one or more processors:

receiving from a camera at least one image representative of an environment of the vehicle;

analyzing the at least one image to identify at least one recognized landmark, wherein the at least one recognized landmark is part of a group of recognized landmarks, and identification of the at least one recognized landmark is based, at least in part, upon one or more landmark group characteristics associated with the group of recognized landmarks;

updating a current location of the vehicle relative to a predetermined road model trajectory associated with the road segment based, at least in part, on a predetermined location of the recognized landmark; and

determining an autonomous steering action for the vehicle based on a direction of the predetermined road model trajectory at the determined current location of the vehicle relative to the predetermined road model trajectory.

12. The method of claim 11 , wherein the at least one recognized landmark includes at least one of a traffic sign, an arrow marking, a lane marking, a dashed lane marking, a traffic light, a stop line, a directional sign, a reflector, a landmark beacon, or a lamppost.

13. The method of claim 11 , wherein the at least one recognized landmark includes a sign for a business.

14. The method of claim 11 , wherein the one or more landmark group characteristics include relative distances between members of the group of recognized landmarks.

15. The method of claim 11 , wherein the one or more landmark group characteristics include an ordering sequence of members of the group of recognized landmarks.

16. A tangible and non-transitory computer-readable storage medium that comprises a set of instructions that are executable by at least one processor to cause the at least one processor to perform a method for autonomously navigating a vehicle along a road segment, the method comprising:

receiving from a camera at least one image representative of an environment of the vehicle;

analyzing the at least one image to identify at least one recognized landmark, wherein the at least one recognized landmark is part of a group of recognized landmarks, and identification of the at least one recognized landmark is based, at least in part, upon one or more landmark group characteristics associated with the group of recognized landmarks;

updating a current location of the vehicle relative to a predetermined road model trajectory associated with the road segment based, at least in part, on a predetermined location of the recognized landmark; and

determining an autonomous steering action for the vehicle based on a direction of the predetermined road model trajectory at the determined current location of the vehicle relative to the predetermined road model trajectory.

17. The tangible and non-transitory computer-readable storage medium of claim 16 , wherein the at least one landmark includes at least one of a traffic sign, an arrow marking, a lane marking, a dashed lane marking, a traffic light, a stop line, a directional sign, a reflector, a landmark beacon, or a lamppost.

18. The tangible and non-transitory computer-readable storage medium of claim 16 , wherein the at least one recognized landmark includes a sign for a business.

19. The tangible and non-transitory computer-readable storage medium of claim 16 , wherein the one or more landmark group characteristics include relative distances between members of the group of recognized landmarks.

20. The tangible and non-transitory computer-readable storage medium of claim 16 , wherein the one or more landmark group characteristics include an ordering sequence of members of the group of recognized landmarks.

21. The system of claim 1 , wherein the one or more landmark group characteristics associated with the group of recognized landmarks include a relationship shared by members of the group of recognized landmarks.

22. The system of claim 1 , wherein the one or more landmark group characteristics associated with the group of recognized landmarks include a spatial relationship between members of the group of recognized landmarks.

23. The system of claim 9 , wherein the super landmark signature associated with the group of recognized landmarks is configured to enable recognition of members of the group of recognized landmarks.

24. The system of claim 9 , wherein the super landmark signature associated with the group of recognized landmarks is configured to enable recognition of at least one of a number of landmarks include in the group of recognized landmarks, relative distances between members of the group of recognized landmarks, or an ordering sequence of members of the group of recognized landmarks.

25. The method of claim 11 , wherein the one or more landmark group characteristics associated with the group of recognized landmarks include a relationship shared by members of the group of recognized landmarks.

26. The method of claim 11 , wherein the one or more landmark group characteristics associated with the group of recognized landmarks include a spatial relationship between members of the group of recognized landmarks.

27. The tangible and non-transitory computer-readable storage medium of claim 16 , wherein the one or more landmark group characteristics associated with the group of recognized landmarks include a relationship shared by members of the group of recognized landmarks.

28. The tangible and non-transitory computer-readable storage medium of claim 16 , wherein the one or more landmark group characteristics associated with the group of recognized landmarks include a spatial relationship between members of the group of recognized landmarks.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 22, 2017
From: AVIEL, YUVAL
To: MOBILEYE VISION TECHNOLOGIES LTD.
Reel/Frame 041346/0201 →
Continuity (22)
Continuation PCTUS2016017411 · Feb 10, 2016
Provisional Application 62114091 · Feb 10, 2015
Provisional Application 62164055 · May 20, 2015
Provisional Application 62170728 · Jun 4, 2015
Provisional Application 62181784 · Jun 19, 2015
Provisional Application 62192576 · Jul 15, 2015
Provisional Application 62215764 · Sep 9, 2015
Provisional Application 62219733 · Sep 17, 2015
Provisional Application 62261578 · Dec 1, 2015
Provisional Application 62261598 · Dec 1, 2015
Provisional Application 62267643 · Dec 15, 2015
Provisional Application 62269818 · Dec 18, 2015
Provisional Application 62270408 · Dec 21, 2015
Provisional Application 62270418 · Dec 21, 2015
Provisional Application 62270431 · Dec 21, 2015
Provisional Application 62271103 · Dec 22, 2015
Provisional Application 62274883 · Jan 5, 2016
Provisional Application 62274968 · Jan 5, 2016
Provisional Application 62275007 · Jan 5, 2016
Provisional Application 62275046 · Jan 5, 2016
Provisional Application 62277068 · Jan 11, 2016
Related Publication 20170010104A1 · Jan 12, 2017