Granted Patent B2

US 11,681,291 · App. 15/673,334 · Granted Jun 20, 2023

Inventors: Amnon Shashua (Jerusalem, IL); Yoram Gdalyahu (Jerusalem, IL); Ofer Springer (Jerusalem, IL); Aran Reisman (Givatayim, IL); Daniel Braunstein (Jerusalem, IL)

Assignee: Mobileye Vision Technologies Ltd.

G05D1/0088B60W30/14B60W30/18B62D15/025G01C21/14G01C21/1652G01C21/1656G01C21/34G01C21/3407G01C21/3476G01C21/36G01C21/3602G01C21/3623G01C21/3644G01C21/3691G01C21/3896G05D1/0212G05D1/0219G05D1/0221G05D1/0246G05D1/0251G05D1/0253G05D1/0278G05D1/0287G06F16/2379G06F16/29G06V20/56G06V20/582G06V20/584G06V20/588G06V20/63G08G1/0112G08G1/09623G08G1/096725G08G1/096805G08G1/167B60W2420/42B60W2555/60B60W2710/18B60W2710/20B60W2720/10G01S19/10G05D2201/0213G06T7/00G06T2207/20081G06T2207/30256G06T2207/30261H04L67/12

Abstract

Claims (67)

1. A system for navigating a vehicle, the system comprising:

at least one processor comprising circuitry and a memory, wherein the memory includes instructions that when executed by the circuitry cause the at least one processor to:

receive a plurality of images acquired by an image capture device from an environment of the vehicle;

analyze at least one of the plurality of images to identify:

a first free space boundary on a driver side of the vehicle and extending forward of the vehicle, the first free space boundary being associated with a first edge of a drivable surface on the driver side, wherein the drivable surface comprises a plurality of lanes of travel sharing a common direction of travel along a road segment,

a second free space boundary on a passenger side of the vehicle and extending forward of the vehicle, the second free space boundary being associated with a second edge of the drivable surface on the passenger side, the first edge and the second edge corresponding to at least one of a road edge, a road barrier, a parked car, a curb, a lane dividing structure, a tunnel wall, or a bridge structure, and

a forward free space boundary forward of the vehicle and extending between the first free space boundary and the second free space boundary;

identify a free space region forward of the vehicle, the free space region being defined by the first free space boundary, the second free space boundary, and the forward free space boundary;

calculate a distance to maintain between the vehicle and each of the first free space boundary and the second free space boundary, the distance being determined based on a speed of the vehicle and a width of the free space region, the width of the free space region being defined based on a lateral distance between the first edge of the drivable surface and the second edge of the drivable surface;

determine a navigational path for the vehicle through the free space region, the navigational path being selected to maintain the calculated distance between the vehicle and the first free space boundary and between the vehicle and the second free space boundary; and

cause the vehicle to travel on at least a portion of the determined navigational path within the free space region forward of the vehicle.

2. The system of claim 1 , wherein the at least one processor is further programmed to identify, based on analysis of the at least one of the plurality of images, an obstacle forward of the vehicle and exclude the identified obstacle from the free space region forward of the vehicle.

3. The system of claim 2 , wherein the obstacle includes a pedestrian.

4. The system of claim 2 , wherein the obstacle includes another vehicle.

5. The system of claim 2 , wherein the obstacle includes debris.

6. The system of claim 1 , wherein the memory further includes instructions executable by the circuitry to cause the at least one processor to identify, based on analysis of the at least one of the plurality of images, an obstacle forward of the vehicle and exclude a region surrounding the identified obstacle from the free space region forward of the vehicle.

7. The system of claim 6 , wherein the memory further includes instructions executable by the circuitry to cause the at least one processor to determine the region surrounding the identified obstacle based on a type of the obstacle.

8. A vehicle comprising:

a body, the body including a driver side and a passenger side;

an image capture device; and

at least one processor comprising circuitry and a memory, wherein the memory includes instructions that when executed by the circuitry cause the at least one processor to:

receive a plurality of images acquired by the image capture device from an environment of the vehicle;

analyze at least one of the plurality of images to identify:

a first free space boundary on the driver side of the body and extending forward of the body, the first free space boundary being associated with a first edge of a drivable surface on the driver side, wherein the drivable surface comprises a plurality of lanes of travel sharing a common direction of travel along a road segment,

a second free space boundary on the passenger side of the body and extending forward of the body, the second free space boundary being associated with a second edge of the drivable surface on the passenger side, the first edge and the second edge corresponding to at least one of a road edge, a road barrier, a parked car, a curb, a lane dividing structure, a tunnel wall, or a bridge structure, and

a forward free space boundary forward of the body and extending between the first free space boundary and the second free space boundary;

identify a free space region forward of the vehicle, the free space region being defined by the first free space boundary, the second free space boundary, and the forward free space boundary;

calculate a distance to maintain between the vehicle and each of the first free space boundary and the second free space boundary, the distance being determined based on a speed of the vehicle and a width of the free space region, the width of the free space region being defined based on a lateral distance between the first edge of the drivable surface and the second edge of the drivable surface;

determine a navigational path for the vehicle through the free space region, the navigational path being selected to maintain the calculated distance between the vehicle and the first free space boundary and between the vehicle and the second free space boundary; and

cause the vehicle to travel on at least a portion of the determined navigational path within the free space region forward of the vehicle.

9. A method of navigating a vehicle, the method comprising:

receiving a plurality of images acquired by an image capture device from an environment of the vehicle;

analyzing at least one of the plurality of images to identify:

a first free space boundary on a driver side of the vehicle and extending forward of the vehicle, the first free space boundary being associated with a first edge of a drivable surface on the driver side, wherein the drivable surface comprises a plurality of lanes of travel sharing a common direction of travel along a road segment,

a second free space boundary on a passenger side of the vehicle and extending forward of the vehicle, the second free space boundary being associated with a second edge of the drivable surface on the passenger side, the first edge and the second edge corresponding to at least one of a road edge, a road barrier, a parked car, a curb, a lane dividing structure, a tunnel wall, or a bridge structure, and

a forward free space boundary forward of the vehicle and extending between the first free space boundary and the second free space boundary;

identifying a free space region forward of the vehicle, the free space region being defined by the first free space boundary, the second free space boundary, and the forward free space boundary;

calculating a distance to maintain between the vehicle and each of the first free space boundary and the second free space boundary, the distance being determined based on a speed of the vehicle and a width of the free space region, the width of the free space region being defined based on a lateral distance between the first edge of the drivable surface and the second edge of the drivable surface;

determining a navigational path for the vehicle through the free space region, the navigational path being selected to maintain the calculated distance between the vehicle and the first free space boundary and between the vehicle and the second free space boundary; and

causing the vehicle to travel on at least a portion of the determined navigational path within the free space region forward of the vehicle.

10. The method of claim 9 , further comprising:

identifying, based on analysis of the at least one of the plurality of images, an obstacle forward of the vehicle; and

excluding the identified obstacle from the free space region forward of the vehicle.

11. The method of claim 10 , wherein the obstacle includes a pedestrian.

12. The method of claim 10 , wherein the obstacle includes another vehicle.

13. The method of claim 10 , wherein the obstacle includes debris.

14. The method of claim 9 , further comprising:

identifying, based on analysis of the at least one of the plurality of images, an obstacle forward of the vehicle; and

excluding a region surrounding the identified obstacle from the free space region forward of the vehicle.

15. The method of claim 14 , further comprising determining the region surrounding the identified obstacle based on one or more of the following: the speed of the vehicle, a type of the obstacle, an image capture rate of the image capture device, and a movement speed of the obstacle.

16. The system of claim 1 , wherein the forward free space boundary forward of the vehicle is associated with a focal length of the image capture device.

17. The method of claim 9 , wherein the forward free space boundary forward of the vehicle is associated with a focal length of the image capture device.

18. The system of claim 1 , wherein the predetermined distance is further determined based on a number of obstacles within the free space region.

19. A non-transitory computer-readable medium comprising instructions that are executable by at least one processor to cause the at least one processor to perform a method of navigating a vehicle, the method comprising:

receiving a plurality of images acquired by an image capture device from an environment of the vehicle;

analyzing at least one of the plurality of images to identify:

a first free space boundary on a driver side of the vehicle and extending forward of the vehicle, the first free space boundary being associated with a first edge of a drivable surface on the driver side, wherein the drivable surface comprises a plurality of lanes of travel sharing a common direction of travel along a road segment,

a second free space boundary on a passenger side of the vehicle and extending forward of the vehicle, the second free space boundary being associated with a second edge of the drivable surface on the passenger side, the first edge and the second edge corresponding to at least one of a road edge, a road barrier, a parked car, a curb, a lane dividing structure, a tunnel wall, or a bridge structure, and

a forward free space boundary forward of the vehicle and extending between the first free space boundary and the second free space boundary;

identifying a free space region forward of the vehicle, the free space region being defined by the first free space boundary, the second free space boundary, and the forward free space boundary;

calculating a distance to maintain between the vehicle and each of the first free space boundary and the second free space boundary, the distance being determined based on a speed of the vehicle and a width of the free space region, the width of the free space region being defined based on a lateral distance between the first edge of the drivable surface and the second edge of the drivable surface;

determining a navigational path for the vehicle through the free space region, the navigational path being selected to maintain the calculated distance between the vehicle and the first free space boundary and between the vehicle and the second free space boundary; and

causing the vehicle to travel on at least a portion of the determined navigational path within the free space region forward of the vehicle.

20. The system of claim 6 , wherein the memory further includes instructions executable by the circuitry to cause the at least one processor to determine the region surrounding the identified obstacle based on a speed of the vehicle.

21. The system of claim 6 , wherein the memory further includes instructions executable by the circuitry to cause the at least one processor to determine the region surrounding the identified obstacle based on an image capture rate of the image capture device.

22. The system of claim 6 , wherein the memory further includes instructions executable by the circuitry to cause the at least one processor to determine the region surrounding the identified obstacle based on a movement speed of the obstacle.

23. The system of claim 1 , wherein the drivable surface includes a road surface.

Assignments (1)

Continuity (22)