Data processing device, monitoring system, awakening system, data processing method, and data processing program

1. A data processing device that performs data processing of monitoring a person, the data processing device comprising a processor configured with a program to perform operations comprising:

operation as a calculator configured to calculate pupil movement and head movement of the person;

operation as an evaluator configured to evaluate a suitability degree of a situation in calculating vestibulo-ocular reflex movement based on the pupil movement and the head movement of the person;

operation as a provision unit configured to provide the suitability degree evaluated by the evaluator to data relating to the pupil movement and the head movement of the person calculated by the calculator;

operation as a selector configured to select a first technique of calculating sleepiness based on the vestibulo-ocular reflex movement of the person or a second technique different from the first technique based on the suitability degree provided to the data;

operation as a first sleepiness calculator configured to calculate the sleepiness based on the first technique when the selector selects the first technique; and

operation as a second sleepiness calculator configured to calculate the sleepiness based on the second technique when the selector selects the second technique.

2. The data processing device according to claim 1 , wherein the processor is configured with the program to perform operations such that:

operation as the selector is further configured to select the first technique when the suitability degree satisfies a predetermined condition; and

operation as the selector is further configured to select the second technique when the suitability degree does not satisfy the predetermined condition.

3. The data processing device according to claim 2 , wherein

the processor is configured with the program to perform operations such that operation as the first sleepiness calculator comprising operation as a reflex movement calculator configured to calculate the vestibulo-ocular reflex movement of the person based on the data in consideration of the suitability degree, and

the sleepiness is calculated based on the vestibulo-ocular reflex movement of the person calculated by the reflex movement calculator.

4. The data processing device according to claim 2 , wherein

the processor is configured with the program to perform operations such that operation as the second sleepiness calculator comprising operation as a saccadic movement calculator configured to calculate saccadic movement of an eye of the person, and

the sleepiness is calculated based on the saccadic movement of the person calculated by the saccadic movement calculator.

5. The data processing device according to claim 2 , wherein

the processor is configured with the program to perform operations such that operation as the second sleepiness calculator comprising operation as an eyelid movement calculator configured to calculate an index based on eyelid movement of the person, and

the sleepiness is calculated based on the index based on the eyelid movement calculated by the eyelid movement calculator.

6. The data processing device according to claim 2 , wherein the processor is configured with the program to perform operations further comprising operation as an awakening controller configured to perform control of awakening the person based on the sleepiness calculated by the first sleepiness calculator or the second sleepiness calculator.

7. The data processing device according to claim 2 , wherein the processor is configured with the program to perform operations such that operation as the evaluator is further configured to evaluate the suitability degree based on a state of the person or an object operated by the person.

8. The data processing device according to claim 7 , wherein

the object comprises a vehicle, and

the person comprises a driver of the vehicle.

9. The data processing device according to claim 1 , wherein

the processor is configured with the program to perform operations such that operation as the first sleepiness calculator comprising operation as a reflex movement calculator configured to calculate the vestibulo-ocular reflex movement of the person based on the data in consideration of the suitability degree, and

the sleepiness is calculated based on the vestibulo-ocular reflex movement of the person calculated by the reflex movement calculator.

10. The data processing device according to claim 1 , wherein

the processor is configured with the program to perform operations such that operation as the second sleepiness calculator comprising operation as a saccadic movement calculator configured to calculate saccadic movement of an eye of the person, and

the sleepiness is calculated based on the saccadic movement of the person calculated by the saccadic movement calculator.

11. The data processing device according to claim 1 , wherein

the processor is configured with the program to perform operations such that operation as the second sleepiness calculator comprising operation as an eyelid movement calculator configured to calculate an index based on eyelid movement of the person, and

the sleepiness is calculated based on the index based on the eyelid movement calculated by the eyelid movement calculator.

12. The data processing device according to claim 1 , wherein the processor is configured with the program to perform operations further comprising operation as an awakening controller configured to perform control of awakening the person based on the sleepiness calculated by the first sleepiness calculator or the second sleepiness calculator.

13. An awakening system comprising:

the data processing device according to claim 12 ; and

an awakening device controlled by the awakening controller of the data processing device.

14. The data processing device according to claim 1 , wherein the processor is configured with the program to perform operations such that operation as the evaluator is further configured to evaluate the suitability degree based on a state of the person or an object operated by the person.

15. The data processing device according to claim 14 , wherein

the object comprises a vehicle, and

the person comprises a driver of the vehicle.

16. The data processing device according to claim 15 , wherein the processor is configured with the program to perform operations such that operation as the evaluator is further configured to evaluate the suitability degree based on at least one of a noise component included in the data, a sight line direction of the driver, a running state of the vehicle, and a detection state of the object existing in a traveling direction of the vehicle.

17. The data processing device according to claim 15 , wherein

the processor is configured with the program to perform operations further comprising operation as an acquisition unit configured to acquire acceleration of the vehicle, and

the processor is configured with the program to perform operations such that operation as the evaluator is further configured to evaluate the suitability degree based on a relationship between a change in acceleration of the vehicle acquired from the vehicle and the head movement or the pupil movement of the driver calculated by the calculator.

18. A monitoring system comprising:

the data processing device according to claim 1 ; and

an imaging device configured to capture an image including the person, wherein the calculator of the data processing device calculates the pupil movement and the head movement of the person using the image acquired from the imaging device.

19. A data processing method for monitoring a person, the data processing method comprising:

calculating pupil movement and head movement of the person;

evaluating a suitability degree of a situation in calculating vestibulo-ocular reflex movement based on the pupil movement and the head movement of the person;

providing the evaluated suitability degree to data relating to the calculated pupil movement and the calculated head movement of the person;

selecting a first technique of calculating sleepiness based on the vestibulo-ocular reflex movement of the person or a second technique different from the first technique based on the suitability degree provided to the data;

calculating the sleepiness based on the first technique in response to selecting the first technique; and

calculating the sleepiness based on the second technique in response to selecting the second technique.

20. A non-transitory computer-readable storage medium storing a data processing program, which when read and executed, causes at least one computer to perform data processing of monitoring a person, the data processing program, which when read and executed, causes the at least one computer to perform operations comprising:

calculating pupil movement and head movement of the person;

evaluating a suitability degree of a situation in calculating vestibulo-ocular reflex movement based on the pupil movement and the head movement of the person;

providing the evaluated suitability degree to data relating to the calculated pupil movement and the calculated head movement of the person;

selecting a first technique of calculating sleepiness based on the vestibulo-ocular reflex movement of the person or a second technique different from the first technique based on the suitability degree provided to the data;

calculating the sleepiness based on the first technique in response to selecting the first technique; and

calculating the sleepiness based on the second technique in response to selecting the second technique.