IP Library Granted Patent US 9,709,986
Granted Patent B2
US 9,709,986 · App. 15/272,789 · Granted Jul 18, 2017

Navigation based on expected landmark location

Inventors: Yoram Gdalyahu (Jerusalem, IL); Amnon Shashua (Jerusalem, IL); Yoav Taieb (Jerusalem, IL); Daniel Braunstein (Jerusalem, IL); David Huberman (Jerusalem, IL); Levi Bellaiche (Jerusalem, IL)
Assignee: Mobileye Vision Technologies Ltd.
G05D1/0088B60W30/14B60W30/18B62D15/025G01C21/14G01C21/165G01C21/32G01C21/34G01C21/3407G01C21/3476G01C21/36G01C21/3623G01C21/3644G01C21/3691G05D1/0212G05D1/0221G05D1/0246G05D1/0251G05D1/0253G05D1/0278G05D1/0287G06F17/30241G06F17/30377G06K9/00791G06K9/00798G06K9/00818G08G1/0112G08G1/09623G08G1/096725G08G1/096805G08G1/167B60W2420/42B60W2550/22B60W2710/18B60W2710/20B60W2720/10G01S19/10G05D2201/0213G06T7/00G06T2207/20081G06T2207/30256G06T2207/30261H04L67/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,709,986
App. No.
15/272,789
Granted
Jul 18, 2017
Kind
B2
Abstract

A system for autonomously navigating a vehicle along a road segment may be based on a predetermined landmark location. The system may include at least one processor programmed to receive from a camera, at least one image representative of an environment of the vehicle, and determine a position of the vehicle along a predetermined road model trajectory associated with the road segment based, at least in part, on information associated with the at least one image. The at least one processor may be further programmed to identify a recognized landmark forward of the vehicle based on the determined position, wherein the recognized landmark is beyond a sight range of the camera, and determine a current distance between the vehicle and the recognized landmark by comparing the determined position of the vehicle with a predetermined position of the recognized landmark. The at least one processor may also be programmed to determine an autonomous navigational response for the vehicle based on the determined current distance.

Claims (32)

1. A system for autonomously navigating a vehicle along a road segment based on a predetermined landmark location, the system comprising:

at least one processor programmed to:

receive from a camera, at least one image representative of an environment of the vehicle;

determine a position of the vehicle along a predetermined road model trajectory associated with the road segment based, at least in part, on information associated with the at least one image;

identify a recognized landmark forward of the vehicle based on the determined position, wherein the recognized landmark is beyond a sight range of the camera;

determine a current distance between the vehicle and the recognized landmark by comparing the determined position of the vehicle with a predetermined position of the recognized landmark; and

determine an autonomous navigational response for the vehicle based on the determined current distance.

2. The system of claim 1 , wherein the predetermined position of the recognized landmark is determined as an average of a plurality of acquired position measurements associated with the recognized landmark, wherein the plurality of acquired position measurements are determined based on acquisition of at least one environmental image, analysis of the at least one environmental image to identify the recognized landmark in the environment, reception of global positioning system (GPS) data, analysis of the at least one environmental image to determine a relative position of the recognized landmark with respect to the vehicle, and determination of a globally localized position of the recognized landmark based on at least the GPS data and the determined relative position.

3. The system of claim 1 , wherein the autonomous navigational response includes application of brakes associated with the vehicle.

4. The system of claim 1 , wherein the autonomous navigational response includes modifying a steering angle of the vehicle.

5. The system of claim 1 , wherein the recognized landmark includes a stop line, a traffic light, a stop sign, or a curve along the road segment.

6. The system of claim 1 , wherein the camera is included in the vehicle.

7. A method for autonomously navigating a vehicle along a road segment based on a predetermined landmark location, the method comprising:

receiving from a camera, at least one image representative of an environment of the vehicle;

determining a position of the vehicle along a predetermined road model trajectory associated with the road segment based, at least in part, on information associated with the at least one image;

identifying a recognized landmark forward of the vehicle based on the determined position, wherein the recognized landmark is beyond a sight range of the camera;

determining a current distance between the vehicle and the recognized landmark by comparing the determined position of the vehicle with a predetermined position of the recognized landmark; and

determining an autonomous navigational response for the vehicle based on the determined current distance.

8. The method of claim 7 , wherein the predetermined position of the recognized landmark is determined as an average of a plurality of acquired position measurements associated with the recognized landmark, wherein the plurality of acquired position measurements are determined based on acquisition of at least one environmental image, analysis of the at least one environmental image to identify the recognized landmark in the environment, reception of global positioning system (GPS) data, analysis of the at least one environmental image to determine a relative position of the recognized landmark with respect to the vehicle, and determination of a globally localized position of the recognized landmark based on at least the GPS data and the determined relative position.

9. The method of claim 7 , wherein the autonomous navigational response includes application of brakes associated with the vehicle.

10. The method of claim 7 , wherein the autonomous navigational response includes modifying a steering angle of the vehicle.

11. The method of claim 7 , wherein the recognized landmark includes a stop line, a traffic light, a stop sign, or a curve along the road segment.

12. The method of claim 7 , wherein the camera is included in the vehicle.

13. A non-transitory computer readable medium storing instructions causing at least one processor to perform autonomous navigation of a vehicle along a road segment, the instructions causing the processor to perform the steps of:

receiving from a camera, at least one image representative of an environment of the vehicle;

determining a position of the vehicle along a predetermined road model trajectory associated with the road segment based, at least in part, on information associated with the at least one image;

identifying a recognized landmark forward of the vehicle based on the determined position, wherein the recognized landmark is beyond a sight range of the camera;

determining a current distance between the vehicle and the recognized landmark by comparing the determined position of the vehicle with a predetermined position of the recognized landmark; and

determining an autonomous navigational response for the vehicle based on the determined current distance.

14. The non-transitory computer readable medium of claim 13 , wherein the autonomous navigational response includes application of brakes associated with the vehicle.

15. The non-transitory computer readable medium of claim 13 , wherein the autonomous navigational response includes modifying a steering angle of the vehicle.

16. The non-transitory computer readable medium of claim 13 , wherein the recognized landmark includes a stop line, a traffic light, a stop sign, or a curve along the road segment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2017
From: GDALYAHU, YORAM; SHASHUA, AMNON; TAIEB, YOAV; BRAUNSTEIN, DANIEL; HUBERMAN, DAVID; BELLAICHE, LEVI
To: MOBILEYE VISION TECHNOLOGIES LTD.
Reel/Frame 041679/0757 →
Continuity (22)
Continuation PCTUS2016017411 · Feb 10, 2016
Provisional Application 62114091 · Feb 10, 2015
Provisional Application 62164055 · May 20, 2015
Provisional Application 62170728 · Jun 4, 2015
Provisional Application 62181784 · Jun 19, 2015
Provisional Application 62192576 · Jul 15, 2015
Provisional Application 62215764 · Sep 9, 2015
Provisional Application 62219733 · Sep 17, 2015
Provisional Application 62261578 · Dec 1, 2015
Provisional Application 62267643 · Dec 15, 2015
Provisional Application 62269818 · Dec 18, 2015
Provisional Application 62270408 · Dec 21, 2015
Provisional Application 62270431 · Dec 21, 2015
Provisional Application 62271103 · Dec 22, 2015
Provisional Application 62274883 · Jan 5, 2016
Provisional Application 62274968 · Jan 5, 2016
Provisional Application 62275007 · Jan 5, 2016
Provisional Application 62275046 · Jan 5, 2016
Provisional Application 62277068 · Jan 11, 2016
Provisional Application 62261598 · Dec 1, 2015
Provisional Application 62270418 · Dec 21, 2015
Related Publication 20170010105A1 · Jan 12, 2017