Collision warning system and method for vehicle
A collision warning system and method are provided. The system includes an image capturing apparatus, a sensing apparatus, and a computing apparatus. The computing apparatus analyzes a vehicle side image to generate a plurality of objects and an object coordinate corresponding to each of the objects. The computing apparatus calculates an aerial view coordinate corresponding to each of the objects based on the object coordinates and a pitch angle corresponding to the image capturing apparatus. The computing apparatus calculates a predicted collision time between the vehicle and each of the objects based on a vehicle speed, a turning angle, and the aerial view coordinates. The computing apparatus generates a plurality of warning regions and determines a warning scope corresponding to each of the warning regions based on the predicted collision times.
1. A collision warning system, comprising:
an image capturing apparatus, being installed at a side position of a vehicle to generate a vehicle side image;
a sensor, being configured to sense a vehicle speed and a turning angle of the vehicle; and
a processor, being connected to the image capturing apparatus and the sensor through a network, and being configured to perform following operations:
analyzing the vehicle side image to generate a plurality of objects and an object coordinate corresponding to each of the objects;
calculating an aerial view coordinate corresponding to each of the objects based on the object coordinates and a pitch angle corresponding to the image capturing apparatus;
calculating a predicted collision time between the vehicle and each of the objects based on the vehicle speed, the turning angle, and the aerial view coordinates; and
generating a plurality of warning regions and determining a warning scope corresponding to each of the warning regions based on the predicted collision times.
2. The collision warning system of claim 1 , wherein the processor further stores an object detection model, and the processor further performs following operations:
performing an object detection operation on the vehicle side image through the object detection model to generate the objects and the object coordinates corresponding to each of the objects.
3. The collision warning system of claim 1 , wherein the processor further performs following operations:
performing a distortion correction operation on the vehicle side image based on an apparatus parameter of the image capturing apparatus to generate a corrected object coordinate corresponding to each of the objects; and
generating the aerial view coordinate corresponding to each of the objects based on the corrected object coordinates and the pitch angle corresponding to the image capturing apparatus.
4. The collision warning system of claim 1 , wherein the processor further performs following operations:
calculating a horizontal distance and a vertical distance between each of the objects and the image capturing apparatus based on the aerial view coordinates; and
calculating the predicted collision time between the vehicle and each of the objects based on the vehicle speed, the turning angle, and the horizontal distance and the vertical distance corresponding to each of the objects.
5. The collision warning system of claim 1 , wherein the processor further performs following operations:
calculating a horizontal distance between each of the objects and the image capturing apparatus based on the aerial view coordinates;
determining whether there exists at least one shortest horizontal distance lower than a first horizontal preset distance among the horizontal distances corresponding to each of the aerial view coordinates; and
generating a warning message when determining that there exists the at least one shortest horizontal distance.
6. The collision warning system of claim 1 , wherein the processor further performs following operations:
determining whether there exists a second aerial view coordinate among the aerial view coordinates that a distance to the image capturing apparatus is lower than a second preset horizontal distance and a second preset vertical distance when determining that the turning angle of the vehicle is less than a threshold and the vehicle speed is greater than zero; and
generating a warning message when determining that there exists the second aerial view coordinate that the distance to the image capturing apparatus is lower than the second preset horizontal distance and the second preset vertical distance.
7. The collision warning system of claim 1 , wherein the collision warning system further comprises a display, and the display is configured to display the warning regions to remind a driver of the vehicle.
8. The collision warning system of claim 7 , wherein the processor further performs following operations:
determining whether a third aerial view coordinate among the aerial view coordinates is located in the warning regions, wherein the warning regions comprises at least a first warning region, a second warning region, and a third warning region;
generating a warning scope image corresponding to the vehicle side image based on the warning scope of each of the warning regions when the third aerial view coordinate is located in the third warning region;
generating a stained image corresponding to the vehicle side image to remind the driver when the third aerial view coordinate is located in the second warning region; and
generating a warning sound to remind the driver when the third aerial view coordinate is located in the third warning region.
9. The collision warning system of claim 1 , wherein the processor further performs following operations:
determining whether the turning angle of the vehicle is greater than or equal to a threshold and the vehicle speed is greater than zero; and
generating the warning regions and determining the warning scope corresponding to each of the warning regions based on the predicted collision times when determining that the turning angle of the vehicle is greater than or equal to the threshold and the vehicle speed is greater than zero.
10. The collision warning system of claim 1 , wherein the processor further performs following operations:
determining whether the vehicle emits a turn signal and the vehicle speed is greater than zero; and
generating the warning regions and determining the warning scope corresponding to each of the warning regions based on the predicted collision times when determining that the vehicle emits the turn signal and the vehicle speed is greater than zero.
11. A collision warning method, being adapted for use in a collision warning system, the collision warning system comprising an image capturing apparatus, a sensor, and a processor, the image capturing apparatus being installed at a side position of a vehicle and being configured to generate a vehicle side image, the sensor being configured to sense a vehicle speed and a turning angle of the vehicle, the collision warning method being performed by the processor and comprising following steps:
analyzing the vehicle side image to generate a plurality of objects and an object coordinate corresponding to each of the objects;
calculating an aerial view coordinate corresponding to each of the objects based on the object coordinates and a pitch angle corresponding to the image capturing apparatus;
calculating a predicted collision time between the vehicle and each of the objects based on the vehicle speed, the turning angle, and the aerial view coordinates; and
generating a plurality of warning regions and determining a warning scope corresponding to each of the warning regions based on the predicted collision times.
12. The collision warning method of claim 11 , wherein the processor further stores an object detection model, and the collision warning method further comprises following steps:
performing an object detection operation on the vehicle side image through the object detection model to generate the objects and the object coordinates corresponding to each of the objects.
13. The collision warning method of claim 11 , wherein the collision warning method further comprises following steps:
performing a distortion correction operation on the vehicle side image based on an apparatus parameter of the image capturing apparatus to generate a corrected object coordinate corresponding to each of the objects; and
generating the aerial view coordinate corresponding to each of the objects based on the corrected object coordinates and the pitch angle corresponding to the image capturing apparatus.
14. The collision warning method of claim 11 , wherein the collision warning method further comprises following steps:
calculating a horizontal distance and a vertical distance between each of the objects and the image capturing apparatus based on the aerial view coordinates; and
calculating the predicted collision time between the vehicle and each of the objects based on the vehicle speed, the turning angle, and the horizontal distance and the vertical distance corresponding to each of the objects.
15. The collision warning method of claim 11 , wherein the collision warning method further comprises following steps:
calculating a horizontal distance between each of the objects and the image capturing apparatus based on the aerial view coordinates;
determining whether there exists at least one shortest horizontal distance lower than a first horizontal preset distance among the horizontal distances corresponding to each of the aerial view coordinates; and
generating a warning message when determining that there exists the at least one shortest horizontal distance.
16. The collision warning method of claim 11 , wherein the collision warning method further comprises following steps:
determining whether there exists a second aerial view coordinate among the aerial view coordinates that a distance to the image capturing apparatus is lower than a second preset horizontal distance and a second preset vertical distance when determining that the turning angle of the vehicle is less than a threshold and the vehicle speed is greater than zero; and
generating a warning message when determining that there exists the second aerial view coordinate that the distance to the image capturing apparatus is lower than the second preset horizontal distance and the second preset vertical distance.
17. The collision warning method of claim 11 , wherein the collision warning system further comprises a display, and the display is configured to display the warning regions to remind a driver of the vehicle.
18. The collision warning method of claim 17 , wherein the collision warning method further comprises following steps:
determining whether a third aerial view coordinate among the aerial view coordinates is located in the warning regions, wherein the warning regions comprises at least a first warning region, a second warning region, and a third warning region;
generating a warning scope image corresponding to the vehicle side image based on the warning scope of each of the warning regions when the third aerial view coordinate is located in the third warning region;
generating a stained image corresponding to the vehicle side image to remind the driver when the third aerial view coordinate is located in the second warning region; and
generating a warning sound to remind the driver when the third aerial view coordinate is located in the third warning region.
19. The collision warning method of claim 11 , wherein the collision warning method further comprises following steps:
determining whether the turning angle of the vehicle is greater than or equal to a threshold and the vehicle speed is greater than zero; and
generating the warning regions and determining the warning scope corresponding to each of the warning regions based on the predicted collision times when determining that the turning angle of the vehicle is greater than or equal to the threshold and the vehicle speed is greater than zero.
20. The collision warning method of claim 11 , wherein the collision warning method further comprises following steps:
determining whether the vehicle emits a turn signal and the vehicle speed is greater than zero; and
generating the warning regions and determining the warning scope corresponding to each of the warning regions based on the predicted collision times when determining that the vehicle emits the turn signal and the vehicle speed is greater than zero.