Mobile device usage monitoring for commercial vehicle fleet management
A driver monitoring system according to an example of the present disclosure includes a camera configured to record images of a driver within a cabin of a vehicle. At least one vehicle sensor is configured to detect an anomalous driving event of the vehicle based on predefined criteria. A controller is in communication with the camera and the at least one vehicle sensor. The controller is configured to, based on the detection, obtain a particular image taken by the camera that depicts the driver during the anomalous event. The controller is configured to transmit the particular image to a fleet manager, store the particular image in a local repository of anomalous driving images, or both.
1. A driver monitoring system, comprising:
a gaze tracking camera configured to record images of a driver within a cabin of a vehicle and determine a gaze direction of the driver in the recorded images; and
a controller in communication with the gaze tracking camera, operatively connected to memory, and configured to:
detect a potential distracted driving event based on the gaze direction of the driver as depicted in a particular image of the recorded images being outside of a predefined alert driver area for an amount of time exceeding a predefined time threshold;
provide the particular image to a convolutional neural network that has been trained with images depicting drivers utilizing mobile devices;
determine, based on feedback from the convolutional neural network, whether the driver is utilizing a mobile device in the particular image;
based on the determination indicating that the driver is utilizing the mobile phone in the particular image, perform one or both of the following predefined actions: transmit the particular image to a fleet manager, and store the particular image in a local repository of anomalous driving images in the memory;
based on the determination indicating that the driver is not utilizing the mobile phone in the particular image, omit performance of said one or both of the predefined actions, and further train the convolutional neural network using the particular image;
adjust one or both of the predefined time threshold and the predefined alert driver area based on at least one of traffic density, weather conditions, object detection external to the vehicle, and a geographic location of the vehicle; AND
select one or both of the predefined time threshold and the predefined alert driver area based on an experience level of the driver.
2. The driver monitoring system of claim 1 , wherein the controller is configured to transmit one or more of the following distracted driving alerts to the driver based on the potential distracted driving event:
an audio notification through a vehicle speaker;
an audio notification to a wireless headset worn by the driver; and
a visual notification on an electronic display within the cabin.
3. The driver monitoring system of claim 1 , wherein the gaze tracking camera is a video camera, and the images are recorded in a video feed from the video camera.
4. The driver monitoring system of claim 1 , wherein the controller is configured to:
obtain additional images depicting the driver from the gaze tracking camera, or another camera, at random intervals; and
transmit the additional images to a fleet manager, store the additional images in the local repository of anomalous driving images, or both.
5. The driver monitoring system of claim 1 , wherein the controller is configured to transmit the particular image to the fleet manager based on the detection of the potential distracted driving event.
6. The driver monitoring system of claim 1 , wherein the controller is configured to adjust one or both of the predefined time threshold and the predefined alert driver area based on traffic density.
7. The driver monitoring system of claim 1 , wherein the controller is configured to adjust one or both of the predefined time threshold and the predefined alert driver area based on weather conditions.
8. The driver monitoring system of claim 1 , wherein the controller is configured to adjust one or both of the predefined time threshold and the predefined alert driver area based on object detection of objects external to the vehicle.
9. The driver monitoring system of claim 1 , wherein the controller is configured to adjust one or both of the predefined time threshold and the predefined alert driver area based on a geographic location of the vehicle.
10. A method of monitoring a driver, comprising:
a gaze tracking camera recording images of a driver within a cabin of a vehicle and determining a gaze direction of the driver in the recorded images; and
an electronic control unit:
detecting a potential distracted driving event based on the gaze direction of the driver, as depicted in a particular image of the recorded images, being outside of a predefined alert driver area for an amount of time exceeding a predefined time threshold;
providing the particular image to a convolutional neural network that has been trained with mobile device usage images depicting drivers utilizing mobile devices;
determining, based on feedback from the convolutional neural network, whether the driver is utilizing a mobile device in the particular image;
based on the determination indicating that the driver is utilizing the mobile phone in the particular image, performing at least one of the following predefined actions: transmitting the particular image to a fleet manager; and storing the particular image in a local repository of anomalous driving images in memory;
based on the determination indicating that the driver is not utilizing the mobile phone in the particular image, omitting performance of said one or both of the predefined actions, and further training the convolutional neural network using the particular image;
adjusting one or both of the predefined time threshold and the predefined alert driver area based on at least one of traffic density, weather conditions, object detection external to the vehicle, and a geographic location of the vehicle; AND
selecting one or both of the predefined time threshold and the predefined alert driver area based on an experience level of the driver.
11. The method of claim 10 , wherein said performing at least one of the following predefined actions comprises transmitting the particular image to the fleet manager.
12. A driver monitoring system, comprising:
a gaze tracking camera configured to record images of a driver within a cabin of a vehicle and determine a gaze direction of the driver in the recorded images; and
a controller in communication with the gaze tracking camera, operatively connected to memory, and configured to:
detect a potential distracted driving event based on the gaze direction of the driver as depicted in a particular image of the recorded images being outside of a predefined alert driver area for an amount of time exceeding a predefined time threshold; and
perform one or both of the following predefined actions based on the detection of the potential distracted driving event: transmit the particular image to a fleet manager, and store the particular image in a local repository of anomalous driving images in the memory;
wherein the controller is configured to perform at least one of:
adjust one or both of the predefined time threshold and the predefined alert driver area based on at least one of traffic density, weather conditions, object detection external to the vehicle, and a geographic location of the vehicle; and
select one or both of the predefined time threshold and the predefined alert driver area based on an experience level of the driver.
13. A method of monitoring a driver, comprising:
a gaze tracking camera recording images of a driver within a cabin of a vehicle and determine a gaze direction of the driver in the recorded images; and
an electronic control unit:
detecting a potential distracted driving event based on the gaze direction of the driver as depicted in a particular image of the recorded images being outside of a predefined alert driver area for an amount of time exceeding a predefined time threshold; and
performing one or both of the following predefined actions based on the detection of the potential distracted driving event: transmit the particular image to a fleet manager, and store the particular image in a local repository of anomalous driving images in the memory;
performing at least one of:
adjust one or both of the predefined time threshold and the predefined alert driver area based on at least one of traffic density, weather conditions, object detection external to the vehicle, and a geographic location of the vehicle; and
select one or both of the predefined time threshold and the predefined alert driver area based on an experience level of the driver.