Method for classification of eye closures
The present invention generally relates to a method for improving the reliability of a portion of physiological data from an image sensor monitoring an operator positioned in an operator compartment of a vehicle. An embodiment of the method includes receiving, from the image sensor, physiological data including information relating to at least one of eye, face, head, arms and body motion of the operator, identifying an indication of at least an eyelid closure, eye movement or head movement of the operator based on the physiological data; comparing at least one of the physiological data and a lighting condition within the operator compartment with a set of rules for a current operator status; and classifying the type of eyelid closure, eye movement and/or head movement by correlating the identified eyelid closure, eye movement and/or head movement and a result of the comparison.
1. A method for improving the reliability of a portion of physiological data from an image sensor monitoring an operator positioned in an operator compartment of a vehicle, the method comprising:
receiving, from the image sensor, physiological data comprising information relating to at least one of eye, face, head, arms and body motion of the operator;
identifying an indication of at least one of an eyelid closure, eye movement and head movement of the operator based on the physiological data;
comparing at least one of the physiological data and a lighting condition within the operator compartment with a set of rules for a current operator status; and
classifying a type of at least one of eyelid closure, eye movement and head movement by correlating the identified indication of the at least one of eyelid closure, eye movement and head movement and a result of the comparison.
2. Method according to claim 1 , wherein comparing the physiological data with the set of rules for a current operator status comprises
identifying a confidence indication comprised with the physiological data being lower than a threshold, and
providing an error classification of the physiological data if the confidence level is lower than the threshold.
3. Method according to claim 1 , wherein comparing the physiological data with the set of rules for a current operator status comprises identifying a change in at least one of a position and direction of the face comprised with the physiological data being larger than a threshold, and providing an error classification of the physiological data if the change in at least one of position and direction of the face is larger than the threshold.
4. Method according to claim 1 , wherein comparing the physiological data with the set of rules for a current operator status comprises
estimating a matching level between at least one of an eyelid movement, eye movement and head movement comprised with the physiological data and at least one of an eyelid movement, eye movement and head movement template, and
providing an error classification of the physiological data if the matching level is lower than a threshold.
5. Method according to claim 1 , wherein comparing the physiological data with the set of rules for a current operator status comprises identifying at least one of eye, face and body movement representing a non-drowsy state of the operator, and providing a non-drowsiness classification of the physiological data if a non-drowsiness state is identified.
6. Method according to claim 1 , wherein comparing the lighting condition within the operator compartment with the set of rules for a current operator status comprises identifying at least one of an illumination level towards the operator, and a changing lighting condition within the operator compartment.
7. Method according to claim 6 , wherein identifying at least one of the illumination level towards the operator, and the changing lighting condition within the operator compartment comprises analyzing at least one of a contrast level, illumination level, and a frequency of illumination level of image data comprised with
the physiological data from the image sensor, or
from light sensor arranged within the operator compartment of the vehicle.
8. A control system for improving the reliability of a portion of physiological data from an image sensor monitoring an operator positioned in an operator compartment of a vehicle, the control device comprising a control unit configured to:
receive, from the image sensor, physiological data comprising information relating to at least one of eye, face, head, arms and body motion of the operator;
identify an indication of at least one of an eyelid closure, eye movement, and head movement of the operator based on the physiological data;
compare at least one of the physiological data and a lighting condition within the operator compartment with a set of rules for a current operator status; and
classify the type of at least one of eyelid closure, eye movement and head movement by correlating the identified at least one of eyelid closure, eye movement and head movement and a result of the comparison.
9. Control system according to claim 8 , wherein the control unit is further configured to, when comparing the physiological data with the set of rules for a current operator status, identify a confidence indication comprised with the physiological data being lower than a threshold, and providing an error classification of the physiological data if the confidence level is lower than the threshold.
10. Control system according to claim 8 , wherein the control unit is further configured to, when comparing the physiological data with the set of rules for a current operator status, identify a change in at least one of a position and direction of the face comprised with the physiological data being larger than a threshold, and providing an error classification of the physiological data if the change in at least one of position and direction of the face is larger than the threshold.
11. Control system according to claim 8 , wherein the control system is a driver assistance system for a vehicle.
12. A non-transitory computer readable medium embodying a computer program product for improving the reliability of a portion of physiological data from an image sensor monitoring an operator positioned in an operator compartment of a vehicle, the computer program product comprising code configured to, when executed by a processor:
receive, from the image sensor, physiological data comprising information relating to at least one of eye, face, head, arms and body motion of the operator;
identify an indication of at least one of an eyelid closure, eye movement and head movement of the operator based on the physiological data;
compare at least one of the physiological data and a lighting condition within the operator compartment with a set of rules for a current operator status; and
classify the type of at least one of eyelid closure, eye movement and head movement by correlating the identified at least one of eyelid closure, eye movement and head movement and a result of the comparison.