System and method of traffic signal violation risk assessment and warning
A system and method for traffic signal violation risk assessment for a vehicle. The system includes a sensor such as a front camera module (FCM) configured to capture an image in a field of view forward the vehicle; a vehicle communications system configured for at least one of vehicle-to-infrastructure (V2I) communications and telematic communications with an infrastructure unit, wherein the infrastructure unit is capable of providing intersection information; and a traffic signal violation risk assessment (TSVR) module in communication with the FCM and the vehicle communications system. The TSVR module analyzes the captured image to determine an intersection, a traffic light at the intersection, and a traffic light current state (TLCS); collect intersection information from the infrastructure unit, and determine a risk of traffic signal violation based on the information and implement a physical action to mitigate the risk.
1 . A method of traffic signal violation risk assessment, comprising:
approaching, by a host vehicle, an intersection;
determining, by a module, the intersection has a traffic signal;
gathering intersection information, wherein the intersection information includes traffic signal data comprising a traffic signal current state (TSCS) and a time to next state (TTNS);
determining a time of arrival at the intersection (TAI) by the host vehicle;
determining a risk level of a traffic signal violation by the host vehicle based on the TSCS, TTNS, and TAI by the host vehicle, wherein the risk level of the traffic signal violation includes one of: a no risk level, a low risk level, and a high risk level; and
implementing a first remedial action in response to the risk level determined to be a low risk, and a second remedial action in response to the risk level determined to be a high risk; and
wherein the first remedial action includes a unicast warning and the second remedial action includes a geocast warning; and
wherein the geocast warning includes altering the TSCS and activating a strobe light to mitigate the high risk.
2 . The method of claim 1 , wherein the second remedial action further includes taking partial control of the host vehicle by a vehicle control module, wherein the partial control includes at least one of emergency braking, steering control, and preconditioning of the host vehicle.
3 . The method of claim 1 , wherein the TSCS includes one of a GO state and a STOP state; and further includes determining the TSCS is the STOP state and the TAI is less than the TTNS, or the TSCS is the GO state and the TAI is greater than the TTNS before determining the risk level of the traffic signal violation by the host vehicle.
4 . The method of claim 1 , wherein the host vehicle includes a forward viewing camera configured to capture images of dynamic traffic signals forward of the host vehicle; and wherein the TSCS of the traffic signal is determined based on the captured images.
5 . The method of claim 1 , wherein the TSCS and TTNS of the traffic signal is gathered wirelessly from at least one of a remote server, a roadside unit (RSU), and a mobile edge computer (MEC) in communications with the traffic signal.
6 . The method of claim 1 , further includes:
determining, by a driver monitoring system (DMS), a current attention state of an operator of the host vehicle; and
determining, by an ambient light sensor module, an intensity of sunlight based on a horizontal direction of sunlight and whether the sunlight is directly within a cone of vision of the operator; and
wherein determining the risk level of the traffic signal violation by the host vehicle is further based on the current attention state of the operator and intensity of sunlight.
7 . The method of claim 6 , wherein the intersection information further includes traffic information on remote vehicles approaching the intersection; and wherein determining the risk level of the traffic signal violation by the host vehicle is further based on the traffic information on the remote vehicles approaching the intersection.
8 . The method of claim 7 , further includes:
obtaining a location of the intersection;
determining at least one of an intersection score and a number of times the host vehicle has traveled through the intersection; and
determining a familiarity of the intersection based on the number of times the host vehicle has traveled through the intersection.
9 . The method of claim 8 , wherein determining the risk level of the traffic signal violation by the host vehicle includes fusing the intersection information, the current attention state of the operator, the intensity of sunlight, and the familiarity with the intersection utilizing one of a look-up table and a fuzzy logic approach.
10 . The method of claim 1 , wherein the intersection information further includes traffic information on a remote vehicle approaching the intersection; and further includes:
determining a time of arrival at the intersection (TAI) by the remote vehicle; and
determining the risk level of the traffic signal violation by the remote vehicle based on the TSCS, TTNS, and TAI by the remote vehicle.
11 . A system for traffic signal violation risk assessment for a vehicle, comprising:
a vehicle sensor configured to capture data in a field of view forward the vehicle;
a vehicle communications system configured for at least one of vehicle-to-infrastructure (V2I) communications and telematic communications with an infrastructure unit, wherein the infrastructure unit is capable of providing intersection information; and
a traffic signal violation risk assessment (TSVR) module in communication with the vehicle sensor and the vehicle communications system, wherein the TSVR module is configured to:
analyze the captured data to determine an intersection, a traffic light at the intersection, and a traffic light current state (TLCS);
collect intersection information from the infrastructure unit, wherein the intersection information includes a time to next state (TTNS) of the traffic light at the intersection;
determine a risk of traffic signal violation based on the TLCS and TTNS; and
implement a physical action to mitigate the risk of traffic signal violation;
wherein determine the risk of the traffic signal violation includes determine one of a low risk and a high risk;
wherein the physical action includes unicasting a warning in response to the determined low risk and geocasting a warning in response to the determined high risk; and
wherein the geocasting the warning includes altering the TLCS and activating a strobe light to mitigate the high risk.
12 . The system of claim 11 , wherein the TSVR module is further configured to:
determine a time of arrival at the intersection (TAI) by the vehicle; and
wherein the TLCS includes one of a GO state and a STOP state, and the TLCS is the STOP state and the TAI is less than the TTNS, OR the TSCS is the GO state and the TAI is greater than the TTNS before initiating the determine the risk of the traffic signal violation.
13 . The system of claim 11 , further comprising an ambient light sensor module configured to determine an intensity of sunlight; and wherein the TSVR module is further configured to the determine risk of traffic signal violation based on the TLCS, the TTN, and the intensity of sunlight.
14 . The system of claim 13 , further comprising a driver monitoring system configured to determine a current attention state of an operator of the vehicle; and wherein the TSVR module is further configured to the risk of the traffic signal violation based on the TLCS, the TTN, the intensity of sunlight, and the current attention state of the operator.
15 . The system of claim 14 , wherein the TSVR module is further configured to:
determine a location of the intersection; and
determine a level of familiarity with the intersection based on the location of the intersection and historical travel logs; and
wherein the TSVR module is further configured to the risk of traffic signal violation based on the TLCS, the TTN, the intensity of sunlight, the current attention state of the operator, and the level of familiarity with the intersection.
16 . The system of claim 15 , wherein the TSVR module is further configured to utilize a look-up table or fuzzy logic to fuse the intersection information, the intensity of sunlight, the current attention state of the operator, and the level of familiarity with the intersection to determine the risk of the traffic signal violation.
17 . The system of claim 11 , wherein the vehicle communications system is further configured for vehicle-to-vehicle (V2V) communications with a remote vehicle; and
wherein the TSVR module is further configured to use the V2V communications to identify the remote vehicle approaching the intersection; and
wherein determine the risk of the traffic signal violation is based on the TLCS, the TTN, and the remote vehicle approaching the intersection.
18 . A traffic signal violation risk assessment (TSVR) module comprising:
a processor; and
a computer readable media comprising instructions to cause the processor to:
analyze an image of a front view of a vehicle to identify an intersection;
determine the intersection has a traffic signal;
communicate with infrastructure units to determine a current state of the traffic signal, a time until the next change of state of the traffic signal, and vehicle traffic approaching the intersection;
determine a level of risk of traffic signal violation by the vehicle based on the current state of the traffic signal, a time until the next change of state of the traffic signal, and the vehicle traffic approaching the intersection, wherein the level of risk includes one of a low risk and a high risk; and
unicast a warning in response to the determined low risk and geocasting a multimodal proactive warning in response to the determined high risk; and
wherein the geocasting the multimodal proactive warning includes altering the current state of the traffic signal and activating a strobe light to mitigate the determined high risk.
19 . The TSVR module of claim 18 , wherein the computer readable media further comprises instructions to cause the processor to issues instructions to a vehicle controller to take at least partial control of the vehicle in response to the predetermined high risk.