IP Library Granted Patent US 11,054,827
Granted Patent B2
US 11,054,827 · App. 15/673,323 · Granted Jul 6, 2021

Navigating road junctions

Inventors: Yoram Gdalyahu (Jerusalem, IL); Amnon Shashua (Jerusalem, IL); Yoav Taieb (Jerusalem, IL); Daniel Braunstein (Jerusalem, IL); David Huberman (Jerusalem, IL); Levi Bellaiche (Jerusalem, IL)
Assignee: MOBILEYE VISION TECHNOLOGIES LTD.
G05D1/0088B60W30/14B60W30/18B62D15/025G01C21/14G01C21/165G01C21/32G01C21/34G01C21/3407G01C21/3476G01C21/36G01C21/3602G01C21/3623G01C21/3644G01C21/3691G05D1/0212G05D1/0219G05D1/0221G05D1/0246G05D1/0251G05D1/0253G05D1/0278G05D1/0287G06F16/2379G06F16/29G06K9/00791G06K9/00798G06K9/00818G06K9/00825G06K9/3258G08G1/0112G08G1/09623G08G1/096725G08G1/096805G08G1/167B60W2420/42B60W2555/60B60W2710/18B60W2710/20B60W2720/10G01S19/10G05D2201/0213G06T7/00G06T2207/20081G06T2207/30256G06T2207/30261H04L67/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,054,827
App. No.
15/673,323
Granted
Jul 6, 2021
Kind
B2
Abstract

A system for autonomously navigating a vehicle through a road junction may include at least one processor programmed to receive from an image capture device at least one image representative of an environment of the vehicle. The processor may also be configured to analyze the image to identify two or more landmarks located in the environment of the vehicle and to determine, for each of the two or more landmarks, a directional indicator relative to the vehicle. The processor may be configured to determine a current location of the vehicle relative to the road junction based on an intersection of the directional indicators a heading for the vehicle based on the directional indicators for the two or more landmarks. The processor may be configured to determine a steering angle for the vehicle by comparing the vehicle heading with a predetermined road model trajectory at the current location of the vehicle.

Claims (62)

1. A system for autonomously navigating a vehicle through a road junction, the system comprising:

at least one processor comprising circuitry and a memory, wherein the memory includes instructions that when executed by the circuitry cause the at least one processor to:

receive at least one image acquired by an image capture device, the at least one image being representative of an environment of the vehicle;

analyze the at least one image to identify two or more landmarks located in the environment of the vehicle;

determine a first directional indicator relative to the vehicle, the first directional indicator being a vector extending from the vehicle towards a first landmark;

determine a second directional indicator relative to the vehicle, the second directional indicator being a vector extending from the vehicle towards a second landmark;

determine a current location of the vehicle relative to the road junction as an intersection point of the first directional indicator and the second directional indicator;

determine a heading for the vehicle based on the directional indicators for the two or more landmarks;

determine a direction of a predetermined road model trajectory at the current location of the vehicle, wherein the predetermined road model trajectory represents a target vehicle path along a road segment and an elevation change associated with the target vehicle path; and

determine a steering angle for the vehicle based on aligning the vehicle heading with the direction of the predetermined road model trajectory at the current location of the vehicle.

2. The system of claim 1 , wherein the predetermined road model trajectory includes a three-dimensional polynomial representation of a target trajectory along the road segment.

3. The system of claim 1 , wherein the memory includes instructions that when executed by the circuitry cause the at least one processor to determine a third directional indicator for a third landmark.

4. The system of claim 1 , wherein the memory includes instructions that when executed by the circuitry cause the at least one processor to transmit a control signal specifying the steering angle to a steering system of the vehicle.

5. The system of claim 1 , wherein the memory includes instructions that when executed by the circuitry cause the at least one processor to retrieve the predetermined road model trajectory from a database included in the vehicle.

6. The system of claim 1 , wherein the memory includes instructions that when executed by the circuitry cause the at least one processor to retrieve the predetermined road model trajectory from a database accessible to the vehicle over a wireless communications interface.

7. The system of claim 1 , wherein the image capture device is included in the vehicle.

8. The system of claim 1 , wherein the memory includes instructions that when executed by the circuitry cause the at least one processor to determine the heading for the vehicle by:

determining a previous location of the vehicle relative to the road junction based on the intersection point of the first directional indicator and the second directional indicator; and

determining the heading based on the previous location and the current location.

9. A vehicle, comprising:

a body;

at least one image capture device; and

at least one processor comprising circuitry and a memory, wherein the memory includes instructions that when executed by the circuitry cause the at least one processor to:

receive at least one image acquired by the at least one image capture device, the at least one image being representative of an environment of the vehicle;

analyze the at least one image to identify two or more landmarks located in the environment of the vehicle;

determine a first directional indicator relative to the vehicle, the first directional indicator being a vector extending from the vehicle towards a first landmark;

determine a second directional indicator relative to the vehicle, the second directional indicator being a vector extending from the vehicle towards a second landmark;

determine a current location of the vehicle relative to the road junction as an intersection point of the first directional indicator and the second directional indicator;

determine a heading for the vehicle based on the directional indicators for the two or more landmarks;

determine a direction of a predetermined road model trajectory at the current location of the vehicle, wherein the predetermined road model trajectory represents a target vehicle path along a road segment and an elevation change associated with the target vehicle path; and

determine a steering angle for the vehicle based on aligning the vehicle heading with the direction of the predetermined road model trajectory at the current location of the vehicle.

10. The vehicle of claim 9 , wherein the predetermined road model trajectory includes a three-dimensional polynomial representation of a target trajectory along the road segment.

11. The vehicle of claim 9 , wherein the memory includes instructions that when executed by the circuitry cause the at least one processor to determine a third directional indicator for a third landmark.

12. The vehicle of claim 9 , wherein the memory includes instructions that when executed by the circuitry cause the at least one processor to transmit a control signal specifying the steering angle to a steering system of the vehicle.

13. The vehicle of claim 9 , wherein the predetermined road model trajectory is retrieved from at least one of a database included in the vehicle or a database accessible to the vehicle over a wireless communications interface.

14. The vehicle of claim 9 , wherein the memory includes instructions that when executed by the circuitry cause the at least one processor to determine a heading for the vehicle by:

determining a previous location of the vehicle relative to the road junction based on the intersection point of the first directional indicator and the second directional indicator; and

determining the heading based on the previous location and the current location.

15. A method of navigating a vehicle, comprising:

receiving at least one image acquired by an image capture device, the at least one image being representative of an environment of the vehicle;

analyzing, using at least one processor, the at least one image to identify two or more landmarks located in the environment of the vehicle;

determining a first directional indicator relative to the vehicle, the first directional indicator being a vector extending from the vehicle towards a first landmark;

determining a second directional indicator relative to the vehicle, the second directional indicator being a vector extending from the vehicle towards a second landmark;

determining a current location of the vehicle relative to the road junction as an intersection point of the first directional indicator and the second directional indicator;

determining a heading for the vehicle based on the directional indicators for the two or more landmarks;

determining a direction of a predetermined road model trajectory at the current location of the vehicle, wherein the predetermined road model trajectory represents a target vehicle path along a road segment and an elevation change associated with the target vehicle path; and

determining a steering angle for the vehicle based on aligning the vehicle heading with the direction of the predetermined road model trajectory at the current location of the vehicle.

16. The method of claim 15 , wherein the predetermined road model trajectory includes a three-dimensional polynomial representation of a target trajectory along the road segment.

17. The method of claim 15 , further including retrieving the predetermined road model trajectory from at least one of a database included in the vehicle or a database accessible to the vehicle over a wireless communications interface.

18. The method of claim 15 , further including transmitting a control signal specifying the steering angle to a steering system of the vehicle.

19. The method of claim 15 , wherein determining the heading for the vehicle further includes:

determining a previous location of the vehicle relative to the road junction based on the intersection point of the first directional indicator and the second directional indicator; and

determining the heading based on the previous location and the current location.

20. A non-transitory computer readable medium containing instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:

receiving at least one image acquired by an image capture device, the at least one image being representative of an environment of a vehicle;

analyzing the at least one image to identify two or more landmarks located in the environment of the vehicle;

determining a first directional indicator relative to the vehicle, the first directional indicator being a vector extending from the vehicle towards a first landmark;

determining a second directional indicator relative to the vehicle, the second directional indicator being a vector extending from the vehicle towards a second landmark;

determining a current location of the vehicle relative to a road junction as an intersection point of the first directional indicator and the second directional indicator;

determining a heading for the vehicle based on the directional indicators for the two or more landmarks;

determining a direction of a predetermined road model trajectory at the current location of the vehicle, wherein the predetermined road model trajectory represents a target vehicle path along a road segment and an elevation change associated with the target vehicle path; and

determining a steering angle for the vehicle based on aligning the vehicle heading with the direction of the predetermined road model trajectory at the current location of the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2017
From: GDALYAHU, YORAM; SHASHUA, AMNON; TAIEB, YOAV; BRAUNSTEIN, DANIEL; HUBERMAN, DAVID; BELLAICHE, LEVI
To: MOBILEYE VISION TECHNOLOGIES LTD.
Reel/Frame 043348/0668 →
Continuity (22)
Continuation PCTUS2016017411 · Feb 10, 2016
Provisional Application 62114091 · Feb 10, 2015
Provisional Application 62164055 · May 20, 2015
Provisional Application 62170728 · Jun 4, 2015
Provisional Application 62181784 · Jun 19, 2015
Provisional Application 62192576 · Jul 15, 2015
Provisional Application 62215764 · Sep 9, 2015
Provisional Application 62219733 · Sep 17, 2015
Provisional Application 62261578 · Dec 1, 2015
Provisional Application 62261598 · Dec 1, 2015
Provisional Application 62267643 · Dec 15, 2015
Provisional Application 62269818 · Dec 18, 2015
Provisional Application 62270408 · Dec 21, 2015
Provisional Application 62270418 · Dec 21, 2015
Provisional Application 62270431 · Dec 21, 2015
Provisional Application 62271103 · Dec 22, 2015
Provisional Application 62274883 · Jan 5, 2016
Provisional Application 62274968 · Jan 5, 2016
Provisional Application 62275007 · Jan 5, 2016
Provisional Application 62275046 · Jan 5, 2016
Provisional Application 62277068 · Jan 11, 2016
Related Publication 20170336792A1 · Nov 23, 2017
Cited By (1)
US 12,509,074