Human machine interface for commercial vehicle camera systems
A method for operating a vehicle camera system including receiving a first image from at least one video camera, identifying a first object in the first image, determining a distance between a vehicle component and the identified object, modifying the first image by incorporating a human machine interface (HMI) within the first image, wherein the human machine interface includes a display configured to communicate the distance between the object and the vehicle component, and displaying the modified image to a vehicle operator.
1. A method for operating a vehicle camera system comprising:
receiving a first image from at least one video camera;
identifying a first object in the first image;
determining a distance between a vehicle component and the identified object, wherein the vehicle component is an ego part capable of moving independently of the vehicle;
modifying the first image by incorporating a human machine interface (HMI) within the first image, thereby creating a modified mirror-replacement image wherein the human machine interface includes a display configured to communicate the distance between the object and the vehicle component; and
displaying the modified image to a vehicle operator.
2. The method of claim 1 , wherein determining the distance between the object and the vehicle component is at least partially based on an image analysis of the first image.
3. The method of claim 1 , wherein determining the distance between the object and the vehicle component is at least partially based on at least one physical sensor reading.
4. The method of claim 3 , wherein the at least one physical sensor reading includes at least one of a radar sensor reading, a LIDAR sensor reading, an infrared sensor reading, a time of flight sensor and an ultrasonic sensor reading.
5. The method of claim 3 , wherein the at least one physical sensor reading includes a radar sensor reading and an ultrasonic reading.
6. The method of claim 1 , wherein the steps of modifying the first image by incorporating the human machine interface (HMI) within the first image, thereby creating a modified mirror-replacement image, and displaying the modified mirror-replacement image to the vehicle operator are performed in response to the determined distance being below a predefined threshold distance.
7. The method of claim 6 , wherein the threshold distance is approximately 30 meters.
8. The method of claim 6 , wherein the threshold distance is an activation distance for at least one automated driver assistance feature.
9. The method of claim 5 , wherein the radar sensor reading provides an accuracy on the scale of feet and the ultrasonic reading provides an accuracy on the scale of inches.
10. The method of claim 1 , wherein the vehicle component part is a trailer.
11. The method of claim 1 , wherein the human machine interface comprises at least one of a numerical indicator, a multi-color overlay, and a bar-graph.
12. The method of claim 11 , wherein the human machine interface comprises a combination of at least two of the numerical indicator, the multi-color overlay, and the bar-graph.
13. The method of claim 11 , wherein the human machine interface comprises an object indicator identifying the detected object in the displayed image.
14. The method of claim 1 , wherein generating the first image comprises generating a mirror replacement image by combining a plurality of images originating from distinct vehicle cameras.
15. The method of claim 1 , further comprising overlaying at least one distance line on top of the first image, wherein the at least one distance line is calibrated at a predefined distance using the distance displayed in the human machine interface.
16. A vehicle system comprising:
at least one exterior facing camera;
a controller including an input connected to an output of the at least one exterior facing camera;
an interior facing display connected to the controller;
wherein the controller includes a memory storing instructions configured to cause the controller to identify a first object in a first image received by the controller, determine a distance between a vehicle component and the identified object, wherein the vehicle component is an ego part capable of moving independently of the vehicle, modify the first image by incorporating a human machine interface (HMI) within the first image, and output the modified image to the display; and
wherein the human machine interface includes a display configured to communicate the distance between the object and the vehicle component.
17. The vehicle system of claim 16 , wherein the controller is connected to a proximity sensor, the proximity sensor being configured to determine a distance between the proximity sensor and a detected object.
18. The vehicle system of claim 17 , wherein the proximity sensor includes at least one of at least one of a radar sensor, a LIDAR sensor, an infrared sensor, a time of flight sensor and an ultrasonic sensor.
19. The vehicle system of claim 18 , wherein the proximity sensor includes a radar sensor and an ultrasonic sensor.
20. The vehicle system of claim 16 , wherein the controller further includes an at least partially image based object detection module.
21. The vehicle system of claim 20 , wherein the at least partially image based object detection module includes supplemental sensor based object detection.