IP Library Granted Patent US 11,372,416
Granted Patent B2
US 11,372,416 · App. 16/479,588 · Granted Jun 28, 2022

Systems and methods for navigating with sensing uncertainty

Inventors: Shai Shalev-Shwartz (Jerusalem, IL); Shaked Shammah (Jerusalem, IL); Amnon Shashua (Mevaseret Zion, IL)
Assignee: Mobileye Vision Technologies Ltd.
G05D1/0214B60W30/0956G05D1/0231G05D1/0257G05D1/0278B60W2554/00B60W2556/50G06V20/56
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,372,416
App. No.
16/479,588
Granted
Jun 28, 2022
Kind
B2
Abstract

The present disclosure relates to navigational systems for vehicles. In one implementation, such a navigational system may receive a first output from a first sensor and a second output from a second sensor; identify a target object in the first output; determine whether the target object is included in the second output; and determine a detected driving condition associated with the target object and whether the condition triggers a navigational constraint. If the navigational constraint is not triggered, the system may cause a first navigational adjustment if the target object is included in both the first output and the second output, and may forego any navigational adjustments if the target object is included in the first output but not in the second output. If the navigational constraint is triggered and the target object is included either in the first or second output, the system may cause a second navigational adjustment.

Claims (85)

1. A navigational system for a host vehicle, the navigational system comprising:

at least one processing device comprising circuitry and a memory, wherein the memory includes instructions that when executed by the circuitry cause the at least one processing device to:

receive a first output captured by a first sensor onboard the host vehicle, wherein the first output is associated with a first portion of an environment of the host vehicle;

receive a second output captured by a second sensor onboard the host vehicle, wherein the second output is associated with a second portion of the environment of the host vehicle, and wherein the second portion at least partially overlaps with the first portion;

identify a representation of a target object in the first output;

determine whether a representation of the target object is included in the second output;

determine, based on at least one of the first output or the second output, a detected driving condition associated with the target object and whether the detected driving condition triggers at least one navigational constraint, the at least one navigational constraint being configured to limit one or more navigational actions available to the host vehicle;

based on a determination that the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in both the first output and the second output, cause at least a first adjustment to one or more navigational actuators of the host vehicle in response to the target object;

based on a determination that the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in the first output, but a representation of the target object is not included in the second output at a location in the second output corresponding to a location of the target object in the first output, forego any adjustments to the one or more navigational actuators of the host vehicle in response to the target object; and

based on a determination that the at least one navigational constraint is triggered by the detected driving condition and a representation of the target object is included either in the first output or in the second output, cause at least a second adjustment to the one or more navigational actuators of the host vehicle in response to the target object, wherein the second adjustment is different from the first adjustment.

2. The navigational system of claim 1 , wherein the target object includes another vehicle.

3. The navigational system of claim 1 , wherein the target object includes a stationary object on a roadway.

4. The navigational system of claim 1 , wherein the target object includes a pedestrian.

5. The navigational system of claim 1 , wherein the target object includes a lane marking.

6. The navigational system of claim 1 , wherein the target object is associated with an occlusion zone.

7. The navigational system of claim 1 , wherein the at least one navigational constraint is associated with a distance to a detected object.

8. The navigational system of claim 1 , wherein the at least one navigational constraint is associated with a distance to a detected pedestrian.

9. The navigational system of claim 1 , wherein the at least one navigational constraint is associated with a size of a detected occlusion zone.

10. The navigational system of claim 1 , wherein the at least one navigational constraint is associated with a distance to a detected occlusion zone.

11. The navigational system of claim 1 , wherein the at least one navigational constraint is associated with a type of object an occlusion zone is based on.

12. The navigational system of claim 1 , wherein the at least one navigational constraint includes a predetermined safety constraint.

13. The navigational system of claim 1 , wherein the at least one navigational constraint is associated with a relative speed between the host vehicle and a detected object.

14. The navigational system of claim 1 , wherein the at least one navigational constraint includes a time-to-collision to a detected object.

15. The navigational system of claim 1 , wherein the detected driving condition includes a detected object.

16. The navigational system of claim 1 , wherein the detected driving condition includes a detected vehicle.

17. The navigational system of claim 1 , wherein the detected driving condition includes a detected pedestrian.

18. The navigational system of claim 1 , wherein the detected driving condition includes a detected lane of a roadway.

19. The navigational system of claim 1 , wherein the detected driving condition includes a detected occlusion zone.

20. The navigational system of claim 1 , wherein the first sensor includes a camera.

21. The navigational system of claim 20 , wherein the second sensor includes a LIDAR.

22. The navigational system of claim 20 , wherein the second sensor includes a radar.

23. The navigational system of claim 20 , wherein the second sensor includes a Global Positioning System (GPS) sensor.

24. A navigational system fora host vehicle, the navigational system comprising:

at least one processing device comprising circuitry and a memory, wherein the memory includes instructions that when executed by the circuitry cause the at least one processing device to:

receive a first output captured by a first sensor onboard the host vehicle, wherein the first output is associated with a first portion of an environment of the host vehicle;

receive a second output captured by a mapping system onboard the host vehicle, wherein the second output is associated with a second portion of the environment of the host vehicle, and wherein the second portion at least partially overlaps with the first portion;

identify a representation of a target object in the first output;

determine whether a representation of the target object is included in the second output;

determine, based on at least one of the first output or the second output, a detected driving condition associated with the target object and whether the detected driving condition triggers at least one navigational constraint, the at least one navigational constraint being configured to limit one or more navigational actions available to the host vehicle;

based on a determination that the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in both the first output and the second output, cause at least a first adjustment to one or more navigational actuators of the host vehicle in response to the target object;

based on a determination that the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in the first output, but a representation of the target object is not included in the second output at a location in the second output corresponding to a location of the target object in the first output, forego any adjustments to the one or more navigational actuators of the host vehicle in response to the target object; and

based on a determination that the at least one navigational constraint is triggered by the detected driving condition and a representation of the target object is included either in the first output or in the second output, cause at least a second adjustment to the one or more navigational actuators of the host vehicle in response to the target object, wherein the second adjustment is different from the first adjustment.

25. The navigational system of claim 24 , wherein the mapping system is configured to access a database to retrieve at least one map associated with the second portion of the environment of the vehicle.

26. The navigational system of claim 25 , wherein at least a portion of the database is included in the host vehicle.

27. The navigational system of claim 25 , wherein the mapping system is further configured to wirelessly access at least a portion of the database via at least one network.

28. A host vehicle, the host vehicle comprising:

a first sensor;

a second sensor; and

at least one processing device comprising circuitry and a memory, wherein the memory includes instructions that when executed by the circuitry cause the at least one processing device to:

receive a first output captured by the first sensor, wherein the first output is associated with a first portion of an environment of the host vehicle;

receive a second output captured by the second sensor, wherein the second output is associated with a second portion of the environment of the host vehicle, and wherein the second portion at least partially overlaps with the first portion;

identify a representation of a target object in the first output;

determine whether a representation of the target object is included in the second output;

determine, based on at least one of the first output or the second output, a detected driving condition associated with the target object and whether the detected driving condition triggers at least one navigational constraint, the at least one navigational constraint being configured to limit one or more navigational actions available to the host vehicle;

if the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in both the first output and the second output, cause at least a first adjustment to one or more navigational actuators of the host vehicle in response to the target object;

based on a determination that the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in the first output, but a representation of the target object is not included in the second output at a location in the second output corresponding to a location of the target object in the first output, forego any adjustments to the one or more navigational actuators of the host vehicle in response to the target object; and

based on a determination that the at least one navigational constraint is triggered by the detected driving condition and a representation of the target object is included either in the first output or in the second output, cause at least a second adjustment to the one or more navigational actuators of the host vehicle in response to the target object, wherein the second adjustment is different from the first adjustment.

29. A method for navigating a host vehicle, the method comprising:

receiving a first output captured by a first sensor onboard the host vehicle, wherein the first output is associated with a first portion of an environment of the host vehicle;

receiving a second output captured by a second sensor onboard the host vehicle, wherein the second output is associated with a second portion of the environment of the host vehicle, and wherein the second portion at least partially overlaps with the first portion;

identifying a representation of a target object in the first output;

determining whether a representation of the target object is included in the second output;

determining, based on at least one of the first output or the second output, a detected driving condition associated with the target object and whether the detected driving condition triggers at least one navigational constraint, the at least one navigational constraint being configured to limit one or more navigational actions available to the host vehicle;

based on a determination that the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in both the first output and the second output, causing at least a first adjustment to one or more navigational actuators of the host vehicle in response to the target object;

based on a determination that the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in the first output, but a representation of the target object is not included in the second output at a location in the second output corresponding to a location of the target object in the first output, foregoing any adjustments to the one or more navigational actuators of the host vehicle in response to the target object; and

based on a determination that the at least one navigational constraint is triggered by the detected driving condition and a representation of the target object is included either in the first output or in the second output, causing at least a second adjustment to the one or more navigational actuators of the host vehicle in response to the target object, wherein the second adjustment is different from the first adjustment.

30. The navigational system of claim 1 , wherein the determination whether the representation of the target object is included in the second output is based on an analysis of a location of the target object in the first output.

31. A non-transitory computer readable medium containing instructions that when executed by at least one processor, cause the at least one processor to perform a method for navigating a host vehicle, the method comprising:

receiving a first output captured by a first sensor onboard the host vehicle, wherein the first output, is associated with a first portion of an environment of the host vehicle;

receiving a second output captured by a second sensor onboard the host vehicle, wherein the second output is associated with a second portion of the environment of the host vehicle, and wherein the second portion at least partially overlaps with the first portion;

identifying a representation of a target object in the first output;

determining whether a representation of the target object is included in the second output;

determining, based on at least one of the first output or the second output, a detected driving condition associated with the target object and whether the detected driving condition triggers at least one navigational constraint, the at least one navigational constraint being configured to limit one or more navigational actions available to the host vehicle;

based on a determination that the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in both the first output and the second output, causing at least a first adjustment to one or more navigational actuators of the host vehicle in response to the target object;

based on a determination that the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in the first output, but a representation of the target object is not included in the second output at a location in the second output corresponding to a location of the target object in the first output, foregoing any adjustments to the one or more navigational actuators of the host vehicle in response to the target object; and

based on a determination that the at least one navigational constraint is triggered by the detected driving condition and a representation of the target object is included either in the first output or in the second output, causing at least a second adjustment to the one or more navigational actuators of the host vehicle in response to the target object, wherein the second adjustment is different from the first adjustment.

32. A non-transitory computer readable medium containing instructions that when executed by at least one processor, cause the at least one processor to perform a method for navigating a host vehicle, the method comprising:

receiving a first output captured by a first sensor onboard the host vehicle, wherein the first output is associated with a first portion of an environment of the host vehicle;

receiving a second output captured by a mapping system onboard the host vehicle, wherein the second output is associated with a second portion of the environment of the host vehicle, and wherein the second portion at least partially overlaps with the first portion;

identifying a representation of a target object in the first output;

determining whether a representation of the target object is included in the second output;

determining, based on at least one of the first output or the second output, a detected driving condition associated with the target object and whether the detected driving condition triggers at least one navigational constraint, the at least one navigational constraint being configured to limit one or more navigational actions available to the host vehicle;

based on a determination that the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in both the first output and the second output, causing at least a first adjustment to one or more navigational actuators of the host vehicle in response to the target object;

based on a determination that the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in the first output, but a representation of the target object is not included in the second output at a location in the second output corresponding to a location of the target object in the first output, foregoing any adjustments to the one or more navigational actuators of the host vehicle in response to the target object; and

based on a determination that the at least one navigational constraint is triggered by the detected driving condition and a representation of the target object is included either in the first output or in the second output, causing at least a second adjustment to the one or more navigational actuators of the host vehicle in response to the target object, wherein the second adjustment is different from the first adjustment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2019
From: SHALEV-SHWARTZ, SHAI; SHAMMAH, SHAKED; SHASHUA, AMNON
To: MOBILEYE VISION TECHNOLOGIES LTD.
Reel/Frame 049824/0996 →
Continuity (2)
Provisional Application 62465301 · Mar 1, 2017
Related Publication 20190377354A1 · Dec 12, 2019
Cited By (3)
US 12,285,226 US 12,491,037 US 12,497,024