Attention level determination
Aspects of the present disclosure relate to a control system, a system, a method, a vehicle and a non-transitory computer readable medium for receiving user movement data indicative of movement of a user's head; receiving object movement data indicative of movement of an object, the object being associated with a non-driving task; determining one or more relative movement parameters indicative of the relative movement of the user's head with respect to the object based at least in part on the received user movement data and the object movement data; and determining an attention level of the user to the non-driving task based at least in part on the determined relative movement parameter.
1 . A control system for a vehicle, the control system comprising one or more controllers, the control system being configured to:
receive user movement data indicative of movement of a user's head;
receive object movement data indicative of movement of an object, the object being associated with a non-driving task;
determine one or more relative movement parameters indicative of the relative movement of the user's head with respect to the object based at least in part on the received user movement data and the object movement data, wherein determining the one or more relative movement parameters comprises:
calculating a cross-correlation between the user movement data and the object movement data as a function of time lag displacement;
determining a correlation strength based on a peak value of the cross-correlation; and
determining a time delay between the object movement and corresponding user head movement based on the time lag displacement at the peak value;
determine an attention level of the user to the non-driving task based at least in part on the determined one or more relative movement parameters; and
output a control signal to one or more vehicle systems for controlling the vehicle based at least in part on the determined attention level of the user.
2 . The control system according to claim 1 , the control system configured to:
determine a type of non-driving task; and
select a user movement model based on the type of non-driving task, wherein the attention level is determined based on the user movement model.
3 . The control system according to claim 1 , the control system configured to:
determine a control strategy for engaging the user with a driving task based at least in part on the determined attention level of the user; and
output a control signal indicative of the determined control strategy to one or more vehicle systems for controlling the one or more vehicle systems in accordance with the determined control strategy for engaging the user with the driving task.
4 . The control system according to claim 1 , wherein the attention level is determined to be high when the time delay is below a first predetermined time value and/or when the correlation strength is above a first predetermined correlation value.
5 . The control system according to claim 1 , wherein the attention level is determined to be low when the time delay is above a second predetermined time value and/or when the correlation strength is below a second predetermined correlation value.
6 . The control system according to claim 1 , wherein the attention level is generated by a machine-learning model based on the time delay and/or the correlation strength.
7 . The control system according to claim 1 , wherein the user movement data is received from one or more first sensors and the object movement data is received from one or more second sensors.
8 . The control system according to claim 7 , wherein any or all of the one or more first sensors and the one or more second sensors comprise orientation-based motion sensors.
9 . The control system according to claim 7 , wherein any or all of the one or more first sensors and the one or more second sensors comprise image sensors.
10 . The control system according to claim 1 , wherein the movement of the user's head comprises movements along or about one or more axes.
11 . The control system according to claim 10 , wherein the axes comprise one or more of the group consisting of: a nodding axis, a shaking axis, and a rolling axis.
12 . A method for controlling a vehicle, the method comprising:
receiving user movement data indicative of movement of a user's head;
receiving object movement data indicative of movement of an object, the object being associated with a non-driving task;
determining one or more relative movement parameters indicative of relative movement of the user's head with respect to the object based at least in part on the received user movement data and the received object movement data, wherein determining the one or more relative movement parameters comprises:
calculating a time-varying correlation strength between the user's head movement and object movement; and
determining a time delay between object movements and corresponding head movements for multiple time windows;
determining an attention level of the user to the non-driving task based on both the correlation strength and time delay values across the multiple time windows; and
outputting a control signal to one or more vehicle systems for controlling the vehicle based at least in part on the determined attention level of the user.
13 . The method according to claim 12 , comprising:
determining a control strategy for engaging the user with a driving task based at least in part on the determined attention level of the user; and
outputting a control signal indicative of the determined control strategy to one or more vehicle systems for controlling the one or more vehicle systems in accordance with the determined control strategy for engaging the user with the driving task.
14 . The method according to claim 12 , comprising:
determining a type of non-driving task;
selecting a user movement model based on the type of non-driving task, wherein the attention level is determined in based on the user movement model.
15 . The method according to claim 12 , wherein the attention level is generated by a machine-learning model based on the time delay and/or the correlation strength.
16 . The method according to claim 12 , wherein the movement of the user's head comprises movements along or about one or more axes.
17 . The control system according to claim 1 , wherein the control system is implemented within a vehicle.
18 . A tangible, non-transitory computer readable medium storing computer readable instructions that, when executed by a processor, cause the processor to perform the method of claim 12 .