IP Library › Granted Patent US 11,851,085
Granted Patent B2
US 11,851,085 · App. 17/244,040 · Granted Dec 26, 2023

Navigation and mapping based on detected arrow orientation

Inventors: Avigdor Eldar (Modiin, IL); Eli Peker (Jerusalem, IL); Matan Sulami (Tel Aviv, IL)
Assignee: Mobileye Vision Technologies Ltd.
B60W60/001B60T7/12B60W10/18B60W10/20B60W30/12B60W30/18072B60W30/18109B62D6/001G01C21/30G01C21/3407G01C21/3626G01C21/3691G01C21/3815G01C21/3848G01C21/3885G05D1/0088G05D1/0214G05D1/0221G05D1/0246G05D1/0278G05D1/0287G06V20/56G06V20/584G06V20/588G08G1/0112G08G1/07G08G1/143G08G1/22B60W2300/123B60W2420/42B60W2520/06B60W2520/12B60W2552/05B60W2552/30B60W2552/45B60W2552/53B60W2554/60B60W2555/60B60W2556/40B60W2556/55B60W2556/65G01C21/38G01C21/3807G01C21/3841G05D2201/0213G07C5/0808
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,851,085
App. No.
17/244,040
Granted
Dec 26, 2023
Kind
B2
Abstract

A system for vehicle navigation is provided. The system includes at least one processing circuitry programmed to receive via a data interface one or more images captured by one or more cameras representative of an environment of a vehicle, identify, based on analysis of the one or more images, at least one direction of at least one directional arrow on a road surface in the one or more images, determine a direction of travel for the vehicle based on the at least one direction of the at least one directional arrow on the road surface, determine at least one navigational action for the vehicle based on the determined direction of travel for the vehicle, and cause one or more actuator systems of the vehicle to implement the determined at least one navigational action for the vehicle.

Claims (36)

1. A system for vehicle navigation, the system comprising: a memory interface circuit; and at least one processing circuitry programmed to: receive via at least one data interface one or more images captured by one or more cameras representative of an environment of a vehicle; identify, based on analysis of the one or more images, at least one direction of at least one directional arrow on a road surface in the one or more images, wherein the at least one directional arrow is identified within a corresponding lane of the road surface, and wherein the at least one direction is identified based on at least one tip point of the at least one directional arrow represented in the one or more images; determine a direction of travel for the vehicle in the corresponding lane based on the at least one direction of the at least one directional arrow on the road surface; determine at least one navigational action for the vehicle based on the determined direction of travel for the vehicle and a planned trajectory for the vehicle that uses the corresponding lane; and cause one or more actuator systems of the vehicle to implement the determined at least one navigational action for the vehicle, wherein to identify, based on analysis of the one or more images, the at least one direction of the at least one directional arrow on the road surface in the one or more images includes to identify directions of respective directional arrows located in the corresponding lane in which the vehicle travels and located in an adjacent lane.

2. The system of claim 1 , wherein to identify, based on analysis of the one or more images, the at least one direction of the at least one directional arrow on the road surface in the one or more images includes to identify, based on analysis of the one or more images, a left direction of a left directional arrow, a right direction of a right directional arrow, or a forward direction of a forward directional arrow, a left or forward direction of a left/forward directional arrow, a right or forward direction of a right/forward directional arrow, and a left or right direction of a left/right directional arrow on the road surface.

3. The system of claim 1 , wherein to identify, based on analysis of the one or more images, the at least one direction of the at least one directional arrow on the road surface in the one or more images includes to identify, based on analysis of the one or more images, at least two directions of at least one directional arrow on the road surface, wherein the at least two directions comprises a left and forward direction of a left/forward directional arrow, a right and forward direction of a right/forward directional arrow, and a left and right direction of a left/right directional arrow on the road surface.

4. The system of claim 1 , wherein to determine the at least one navigational action for the vehicle based on the determined direction of travel for the vehicle includes to maintain a current heading direction of the vehicle with the trajectory for the vehicle if the direction of the at least one directional arrow is consistent with the current heading direction of the vehicle.

5. The system of claim 1 , wherein to determine a direction of travel for the vehicle in the corresponding lane based on the at least one direction of the at least one directional arrow on the road surface, includes to determine a forward direction of travel for the vehicle based on a forward direction of a forward directional arrow.

6. The system of claim 1 , the at least one processing circuitry further programmed to:

identify a left or forward direction of a left or forward directional arrow in the one or more images;

determine a forward direction of travel for the vehicle based on the left or forward direction of the left or forward directional arrow;

determine a forward navigational action for the vehicle based on the forward direction of travel for the vehicle; and

cause the one or more actuator systems of the vehicle to maintain a current heading direction of the vehicle.

7. The system of claim 1 , the at least one processing circuitry further programmed to:

identify a left or forward direction of a left or forward directional arrow on the road surface in the one or more images;

identify a right direction of a right directional arrow on the road surface in the one or more images;

determine if the right direction of the right directional arrow is substantially opposite to a current heading direction of the vehicle; and

determine a navigational action for the vehicle to move the vehicle to a correct direction of travel if the right directional arrow is substantially opposite to the current heading direction of the vehicle.

8. The system of claim 1 , further comprising:

one or more cameras.

9. A vehicle comprising: a memory interface circuitry; and at least one processing circuitry programmed to: receive via at least one data interface one or more images captured by one or more cameras representative of an environment of the vehicle; identify, based on analysis of the one or more images, at least one direction of at least one directional arrow on a road surface in the one or more images, wherein the at least one directional arrow is identified within a corresponding lane of the road surface, and wherein the at least one direction is identified based on at least one tip point of the at least one directional arrow represented in the one or more images; determine a direction of travel for the vehicle in the corresponding lane based on the at least one direction of the at least one directional arrow on the road surface; determine at least one navigational action for the vehicle based on the determined direction of travel for the vehicle and a planned trajectory for the vehicle that uses the corresponding lane; and cause one or more actuator systems of the vehicle to implement the determined at least one navigational action for the vehicle, wherein to identify, based on analysis of the one or more images, the at least one direction of the at least one directional arrow on the road surface in the one or more images includes to identify directions of respective directional arrows located in the corresponding lane in which the vehicle travels and located in an adjacent lane.

10. The vehicle of claim 9 , further comprising:

one or more cameras.

11. A non-transitory computer-readable storage media comprising program instructions, when executed by at least one processing circuitry, cause the processing circuitry to perform operations comprising: receiving via a data interface one or more images captured by one or more cameras representative of an environment of a vehicle; identifying, based on analysis of the one or more images, at least one direction of at least one directional arrow on a road surface in the one or more images, wherein the at least one directional arrow is identified within a corresponding lane of the road surface in which the vehicle travels, and wherein the at least one direction is identified based on at least one tip point of the at least one directional arrow represented in the one or more images; determining a direction of travel for the vehicle in the corresponding lane based on the at least one direction of the at least one directional arrow on the road surface; determining at least one navigational action for the vehicle based on the determined direction of travel for the vehicle and a planned trajectory for the vehicle that uses the corresponding lane; and causing one or more actuator systems of the vehicle to implement the determined at least one navigational action for the vehicle, wherein identifying, based on analysis of the one or more images, the at least one direction of the at least one directional arrow on the road surface in the one or more images includes identifying directions of respective directional arrows located in the corresponding lane in which the vehicle travels and located in an adjacent lane.

12. The non-transitory computer-readable storage media of claim 11 , wherein identifying, based on analysis of the one or more images, the at least one direction of the at least one directional arrow on the road surface in the one or more images includes identifying, based on analysis of the one or more images, a left direction of a left directional arrow, a right direction of a right directional arrow, or a forward direction of a forward directional arrow, a left or forward direction of a left/forward directional arrow, a right or forward direction of a right/forward directional arrow, and a left or right direction of a left/right directional arrow on the road surface.

13. The non-transitory computer-readable storage media of claim 11 , wherein identifying, based on analysis of the one or more images, the at least one direction of the at least one directional arrow on the road surface in the one or more images includes identifying, based on analysis of the one or more images, at least two directions of at least one directional arrow on the road surface, wherein the at least two directions comprises a left and forward direction of a left/forward directional arrow, a right and forward direction of a right/forward directional arrow, and a left and right direction of a left/right directional arrow on the road surface.

14. The non-transitory computer-readable storage media of claim 11 , wherein determining the at least one navigational action for the vehicle based on the determined direction of travel for the vehicle includes maintaining a current heading direction of the vehicle with the trajectory for the vehicle if the direction of the at least one directional arrow is consistent with the current heading direction of the vehicle.

15. The non-transitory computer-readable storage media of claim 11 , wherein determining the direction of travel for the vehicle in the corresponding lane based on the at least one direction of the at least one directional arrow on the road surface includes determining a forward direction of travel for the vehicle based on a forward direction of a forward directional arrow.

16. The non-transitory computer-readable storage media of claim 11 , the operations further comprising:

identifying a left or forward direction of a left or forward directional arrow in the one or more images;

determining a forward direction of travel for the vehicle based on the left or forward direction of the left or forward directional arrow;

determining a forward navigational action for the vehicle based on the forward direction of travel for the vehicle; and

causing the one or more actuator systems of the vehicle to maintain a current heading direction of the vehicle.

17. The non-transitory computer-readable storage media of claim 11 , the operations further comprising:

identifying a left or forward direction of a left or forward directional arrow on the road surface in the one or more images;

identifying a right direction of a right directional arrow on the road surface in the one or more images;

determining if the right direction of the right directional arrow is substantially opposite to a current heading direction of the vehicle; and

determining a navigational action for the vehicle to move the vehicle to a correct direction of travel if the right directional arrow is substantially opposite to the current heading direction of the vehicle.

18. A system for vehicle navigation, the system comprising: a memory interface circuitry means; at least one processing circuitry means for: receiving via a data interface one or more images captured by one or more cameras representative of an environment of a vehicle; identifying, based on analysis of the one or more images, at least one direction of at least one directional arrow on a road surface in the one or more images, wherein the at least one directional arrow is identified within a corresponding lane of the road surface in which the vehicle travels, and wherein the at least one direction is identified based on at least one tip point of the at least one directional arrow represented in the one or more images; determining a direction of travel for the vehicle in the corresponding lane based on the at least one direction of the at least one directional arrow on the road surface; determining at least one navigational action for the vehicle based on the determined direction of travel for the vehicle and a planned trajectory for the vehicle that uses the corresponding lane; and causing one or more actuator systems of the vehicle to implement the determined at least one navigational action for the vehicle, wherein identifying, based on analysis of the one or more images, the at least one direction of the at least one directional arrow on the road surface in the one or more images includes identifying directions of respective directional arrows located in the corresponding lane in which the vehicle travels and located in an adjacent lane.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2021
From: ELDAR, AVIGDOR
To: INTEL CORPORATION
Reel/Frame 056083/0966 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2021
From: PEKER, ELI; SULAMI, MATAN
To: MOBILEYE VISION TECHNOLOGIES LTD.
Reel/Frame 056084/0103 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2021
From: INTEL CORPORATION
To: MOBILEYE VISION TECHNOLOGIES LTD.
Reel/Frame 056084/0176 →
Continuity (8)
Continuation 17096495 · Nov 12, 2020
Continuation PCTUS2019032429 · May 15, 2019
Provisional Application 62805646 · Feb 14, 2019
Provisional Application 62800845 · Feb 4, 2019
Provisional Application 62797639 · Jan 28, 2019
Provisional Application 62771335 · Nov 26, 2018
Provisional Application 62671779 · May 15, 2018
Related Publication 20210245780A1 · Aug 12, 2021
Cited By (1)
US 12,326,337