Systems and method for controlling driver assistance features of a vehicle based on images of a road surface condition
The present disclosure is directed to systems and methods for controlling driver assistance features of a vehicle based on images of a vehicle trajectory condition. In one form, the present disclosure provides a system comprising a memory, an imaging device positioned in a vehicle that is configured to generate images of a surface in front of the vehicle, and at least one processor configured to determine a vehicle trajectory condition based on images generated by the imaging device; when the vehicle trajectory condition is determined to be a first condition based on the images, operate a driver assistance system of the vehicle with a first set of feature cascades; and when the vehicle trajectory condition is determined to be a second condition based on the images, operate the driver assistance system of the vehicle with a second set of feature cascades.
1. A system comprising:
a memory;
an imaging device positioned in a vehicle that is configured to generate images of a surface in front of the vehicle; and
at least one processor configured to execute instructions stored in the memory and to:
determine a vehicle trajectory condition based on images of the surface in front of the vehicle generated by the imaging device;
when the vehicle trajectory condition is determined to be a first condition based on the images, operate a driver assistance system of the vehicle with a first set of feature cascades, where the at least one processor is configured to determine that the vehicle trajectory condition is the first condition when the images of the surface in front of the vehicle indicate that the surface is dry asphalt; and
when the vehicle trajectory condition is determined to be a second condition based on the images, operate the driver assistance system of the vehicle with a second set of feature cascades, wherein the first set of feature cascades is different from the second set of feature cascades, wherein the at least one processor is configured to determine that the vehicle trajectory condition is the second condition when the images of the surface in front of the vehicle indicate that the surface is at least one of dry dirt, wet asphalt, gravel, wet dirt, snow, or ice;
wherein when the at least one processor determines that the vehicle trajectory condition is the second condition, the at least one processor is further configured to:
determine a friction coefficient of the surface based on the images and vehicle braking information; and
modify one or more feature cascades based on the determined friction coefficient of the surface.
2. The system of claim 1 , wherein the driver assistance system comprises at least one of an adaptive cruise control, an automatic emergency braking system, or a following distance alerting system.
3. The system of claim 1 , wherein the braking information is based on a measurement of how much the vehicle is decelerated with a brake application at the vehicle.
4. The system of claim 1 , wherein:
the driver assistance system comprises an adaptive cruise control; and
to modify one or more feature cascades, the processor is configured to adjust a follow distance of the adaptive cruise control based on the determined friction coefficient.
5. The system of claim 1 , wherein:
the driver assistance system comprises an automatic emergency braking system; and
to modify one or more feature cascades, the processor is configured to adjust a calculated time to collision for the automatic emergency braking system based on the determined friction of coefficient.
6. The system of claim 1 , wherein:
the driver assistance system comprises a following distance alert system; and
to modify one or more feature cascades, the processor is configured to adjust a threshold in the following distance alert system at which the processor provides an alert to a driver regarding the following distance.
7. The system of claim 1 , wherein the imaging device comprises a forward-facing camera.
8. The system of claim 1 , wherein the vehicle is an autonomous vehicle.
9. A method, comprising:
determine, with one or more processors, a vehicle trajectory condition based on images of a surface in front of a vehicle that are generated by an imaging device positioned in the vehicle to generate images of the surface in front of the vehicle;
when the vehicle trajectory condition is determined to be a first condition based on the images, operate, with the one or more processors, a driver assistance system of the vehicle with a first set of feature cascades, where the one or more processors determine that the vehicle trajectory condition is the first condition when the images of the surface in front of the vehicle indicate that the surface is dry asphalt; and
when the vehicle trajectory condition is determined to be a second condition based on the images, operate, with the one or more processors, the driver assistance system of the vehicle with a second set of feature cascades, wherein the first set of feature cascades is different from the second set of feature cascades, wherein the one or more processor determine that the vehicle trajectory condition is the second condition when the images of the surface in front of the vehicle indicate that the surface is at least one of dry dirt, wet asphalt, gravel, wet dirt, snow, or ice;
wherein when the one or more processors determine that the vehicle trajectory condition is the second condition, the one or more processors further:
determine a friction coefficient of the surface based on the images and vehicle braking information; and
modify one or more feature cascades based on the determined friction coefficient of the surface.
10. The method of claim 9 , wherein the driver assistance system comprises at least one of an adaptive cruise control, an automatic emergency braking system, or a following distance alerting system.
11. The method of claim 9 , wherein the braking information is based on a measurement of how much a vehicle is decelerated with a brake application at the vehicle.
12. The method of claim 9 , wherein:
the driver assistance system comprises an adaptive cruise control; and
modifying one or more feature cascades comprises adjusting, with the one or more processors, a follow distance of the adaptive cruise control based on the determined friction coefficient.
13. The method of claim 9 , wherein:
the driver assistance system comprises an automatic emergency braking system; and
modify one or more feature cascades comprises adjusting, with the one or more processors, a calculated time to collision for the automatic emergency braking system based on the determined friction of coefficient.
14. The method of claim 9 , wherein:
the driver assistance system comprises a following distance alert system; and
modifying one or more feature cascades comprises adjusting, with the one or more processors, a threshold in the following distance alert system at which an alert is generated and displayed to a driver regarding the following distance.
15. The method of claim 9 , wherein the imaging device comprises a forward-facing camera.
16. The method of claim 9 , wherein the vehicle is an autonomous vehicle.