SYSTEMS AND METHODS FOR IN-CAB FEEDBACK CONTROL USING VIRTUAL COACHING SESSIONS
A computing device of a vehicle and/or a remote computing device may generate a driving score tor a driver based on risky or unsafe driving behavior the driver engages in. The computing device can generate a driving score for the driver and monitor the driver over time to adjust or update the driving score. Tire computing device can initiate virtual coaching sessions in which the driver can access videos of tire driver engaging in. risky driving behavior to see when the risky driving behavior occurred. The computing device can determine whether the driver improved based on the driving score and/or determine whether the driver interacted with the 2024/186657 virtual coaching sessions. Responsive to determining the driver did not improve and/or interact with the virtual coaching sessions, the computing device can subsequently instruct the vehicle to generate alerts when the driver engages in similar risky driving behavior. WO
1 . A method, comprising:
receiving, by one or more processors, visual data from a camera mounted on or in a vehicle;
detecting, by the one or more processors, a plurality of driving events of a driving event type based on the visual data, the plurality of driving events corresponding to a driver driving a vehicle during the plurality of driving events;
generating, by the one or more processors, a first score for a component of a driving score associated with the driving event type based at least on the plurality of driving events at a first time period;
segmenting, by the one or more processors for the driver, one or more video recordings of at least one of the plurality of driving events from the received visual data;
responsive to determining the first score satisfies a first threshold, presenting, by the one or more processors, a message configured to display the segmented one or more video recordings of the at least one of the plurality of driving events;
generating, by the one or more processors, a second score for the component of the driving score at a second time period after presenting the message configured to display the segmented one or more video recordings of the at least one of the plurality of driving events; and
in response to determining a change in value between the first score and the second score does not satisfy a second threshold and in response to detection of a new driving event of the driving event type, instructing, by the one or more processors, the vehicle to activate an audio or visual alert.
2 . The method of claim 1 , wherein detecting the plurality of driving events of the driving event type comprises detecting, by the one or more processors, the plurality of driving events using a machine learning model on one or more features depicted in the visual data.
3 . The method of claim 2 , wherein detecting the plurality of driving events of the driving event type using the machine learning model comprises detecting, by an onboard processor located in or on the vehicle of the one or more processors, the plurality of driving events of the driving event type using the machine learning model.
4 . The method of claim 1 , wherein segmenting the one or more video recordings of the at least one of the plurality of driving events comprises:
generating, by the one or more processors, a segment of video data for each of the at least one of the plurality of driving events, each segment depicting a different driving event of the at least one of the plurality of driving events; and
storing, by the one or more processors, the segment of video data for each of the at least one of the plurality of driving events in a location in memory with an identifier of an account of the driver.
5 . The method of claim 4 , wherein presenting the message configured to display the segmented one or more video recordings of the at least one of the plurality of driving events comprises:
transmitting, by the one or more processors, the message comprising a pointer to the location in memory to a computing device associated with the account of the driver, the pointer configured to redirect an application executing on the computing device to access the segment of video data for each of the at least one of the plurality of driving events.
6 . The method of claim 1 , further comprising:
determining, by the one or more processors, the second score for the component of the driving score satisfies a third threshold subsequent to the instructing the vehicle to activate the audio or visual alert; and
responsive to determining the second score for the component of the driving score satisfies the third threshold, transmitting, by the one or more processors, an instruction to the vehicle to stop activating the audio or visual alert for the driving event type.
7 . The method of claim 1 , further comprising:
determining, by the one or more processors, the driver has interacted with the one or more video recordings; and
responsive to determining the driver has interacted with the one or more video recordings, transmitting, by the one or more processors, an instruction to the vehicle to stop activating the audio or visual alert for the driving event type.
8 . The method of claim 1 , comprising:
responsive to determining, by the one or more processors, that the driver has interacted with the one or more video recordings, extending, by the one or more processors, the second time period; and
generating, by the one or more processors, the second score for the component of the driving score at the extended second time period after the presenting the message configured to display the segmented one or more video recordings of the at least one of the plurality of driving events.
9 . The method of claim 1 , further comprising:
in response to determining a change in value between the second score and a third score for the component of the driving score generated at a third time period after generation of the second score satisfies a third threshold, instantiating, by the one or more processors, a video conferencing portal between an account of the driver and an account of a driving coach.
10 . The method of claim 1 , further comprising:
in response to determining a change in value between the first score and the second score does not satisfy the second threshold and in response to the detection of the new driving event of the driving event type, instructing, by the one or more processors, the vehicle to activate haptic feedback of one or more devices within the vehicle.
11 . A system comprising:
one or more processors configured by machine-readable instructions to:
receive visual data from a camera mounted on or in a vehicle;
detect a plurality of driving events of a driving event type based on the visual data, the plurality of driving events corresponding to a driver driving a vehicle during the plurality of driving events;
generate a first score for a component of a driving score associated with the driving event type based at least on the plurality of driving events at a first time period;
segment, for the driver, one or more video recordings of at least one of the plurality of driving events from the received visual data;
responsive to determining the first score satisfies a first threshold, present a message configured to display the segmented one or more video recordings of the at least one of the plurality of driving events;
generate a second score for the component of the driving score at a second time period after presenting the message configured to display the segmented one or more video recordings of the at least one of the plurality of driving events; and
in response to determining a change in value between the first score and the second score does not satisfy a second threshold and in response to detection of a new driving event of the driving event type, instruct the vehicle to activate an audio or visual alert.
12 . The system of claim 11 , wherein the one or more processors are configured to detect the plurality of driving events of the driving event type by detecting the plurality of driving events using a machine learning model on one or more features depicted in the visual data.
13 . The system of claim 12 , wherein an onboard processor located in the vehicle of the one or more processors is configured to detect the plurality of driving events of the driving event type using the machine learning model.
14 . The system of claim 11 , wherein the one or more processors are configured to segment the one or more video recordings of the at least one of the plurality of driving events by:
generating a segment of video data for each of the at least one of the plurality of driving events, each segment depicting a different driving event of the at least one of the plurality of driving events; and
storing the segment of video data for each of the at least one of the plurality of driving events in a location in memory with an identifier of an account of the driver.
15 . The system of claim 14 , wherein the one or more processors are configured to present the message configured to display the segmented one or more video recordings of the at least one of the plurality of driving events by:
transmitting the message comprising a pointer to the location in memory to a computing device associated with the account of the driver, the pointer configured to redirect an application executing on the computing device to access the segment of video data for each of the at least one of the plurality of driving events.
16 . The system of claim 11 , wherein the one or more processors are further configured to:
determine the second score for the component of the driving score has satisfies a third threshold subsequent to the instructing the vehicle to activate the audio or visual alert; and
responsive to determining the second score for the component of the driving score satisfies the third threshold, transmit an instruction to the vehicle to stop activating the audio or visual alert for the driving event type.
17 - 20 . (canceled)