Driver fatigue monitoring system and method
View Patent ↗Method and system for monitoring a vehicle driver includes an optical imaging system that obtains images of the driver, and a processor coupled to the optical imaging system and arranged to analyze the images obtained by the optical imaging system to locate a head of the driver in the images and monitor the driver's head or a part thereof over time. The processor also determines, based on the monitoring of the driver's head or part thereof, whether the driver has lost the ability to operate the vehicle. A reactive component is affected by the processor's determination that the driver has lost the ability to operate the vehicle, and requires action by the driver to indicate regaining of the ability to operate the vehicle or exerting control over the vehicle to slow the vehicle and bring it to a stop.
1. A vehicle including a system for monitoring a driver of the vehicle during movement of the vehicle under control of the driver, the vehicle comprising
an information obtaining system arranged within the vehicle and that obtains information about the driver;
a processor arranged within the vehicle and coupled to said information obtaining system, said processor analyzing the information obtained by said information obtaining system and movement of the vehicle to determine during movement of the vehicle and based on the obtained information and movement of the vehicle, whether the driver has lost the ability to continue to control the vehicle, the loss of ability to continue to control the vehicle arising from the driver falling asleep or otherwise being incapable of controlling the vehicle after initially having been awake or otherwise capable of controlling the vehicle; and
a reactive component arranged within the vehicle coupled to said processor and which is affected by the determination by said processor that the driver has lost the ability to continue to control the vehicle,
said reactive component requiring action by the driver to indicate regaining of the ability to control movement of the vehicle.
2. The vehicle of claim 1 , wherein said processor uses a trained pattern recognition technique to obtain the information about the driver.
3. The vehicle of claim 1 , wherein said information obtaining system obtains images of the driver and derives information about the driver from the obtained images, said optical imaging system comprising a plurality of optical imagers spaced apart from one another and each positioned to obtain images of a face of the driver.
4. The vehicle of claim 1 , wherein said information obtaining system obtains images of the driver and derives information about the driver from the obtained images and said processor monitors the driver's head by determining a position of the head of the driver in images obtained at different times and analyzing the determined position of the head of the driver in the different images.
5. The vehicle of claim 1 , wherein said reactive component comprises a warning light or a warning sound generating device.
6. The vehicle of claim 1 , wherein said reactive component comprises a button which, when pressed, indicates that the driver has regained the ability to operate the vehicle.
7. The vehicle of claim 1 , further comprising a horn and lights, said processor operating said horn and lights to warn other vehicles of the inability of the driver to operate the vehicle.
8. The vehicle of claim 1 , wherein said information obtaining system obtains images of the driver and derives information about the driver from the obtained images.
9. The vehicle of claim 1 , wherein said processor is configured to analyze the information obtained by said information obtaining system and movement of the vehicle relative to a map to determine during movement of the vehicle and based on the obtained information and movement of the vehicle relative to the map, whether the driver has lost the ability to continue to control the vehicle.
10. The vehicle of claim 1 , wherein said processor is configured to analyze the information obtained by said information obtaining system and movement of the vehicle relative to lane boundaries to determine during movement of the vehicle and based on the obtained information and movement of the vehicle relative to the lane boundaries, whether the driver has lost the ability to continue to control the vehicle.
11. The vehicle of claim 1 , wherein the movement of the vehicle analyzed by said processor includes at least one of acceleration of the vehicle, an angle of a steering wheel of the vehicle and angular motion of the vehicle.
12. The vehicle of claim 1 , wherein said processor is configured to analyze the information obtained by said information obtaining system and movement of the vehicle relative to traffic control elements to determine during movement of the vehicle and based on the obtained information and movement of the vehicle relative to the traffic control elements, whether the driver has lost the ability to continue to control the vehicle.
13. The vehicle of claim 12 , wherein the traffic control elements include stop lights and stop signs.
14. The vehicle of claim 1 , wherein said processor is configured to analyze the information obtained by said information obtaining system and movement of the vehicle relative to movement of other vehicles previously travelling the same road to determine during movement of the vehicle and based on the obtained information and movement of the vehicle relative to the movement of other vehicles, whether the driver has lost the ability to continue to control the vehicle.
15. The vehicle of claim 1 , wherein said processor is configured to analyze the information obtained by said information obtaining system and movement of the vehicle by analyzing movement of the driver relative to movement of the vehicle to determine during movement of the vehicle and based on the relative movement of the driver to the vehicle, whether the driver has lost the ability to continue to control the vehicle.
16. The vehicle of claim 1 , wherein said reactive component is configured to generate an audio or visual cue directed to the driver and requiring a responsive action by the driver to the generated audio or visual cue to indicate that the driver has regained the ability to operate the vehicle.
17. The vehicle of claim 16 , wherein said reactive component is configured require a responsive physical action by the driver to the generated audio or visual cue to indicate that the driver has regained the ability to operate the vehicle.
18. The vehicle of claim 1 , wherein said processor is trained in a training stage to recognize changes in driver behavior indicative of loss of ability to operate the vehicle.
19. The vehicle of claim 1 , wherein said information obtaining system obtains information about the driver using ultrasonic or electromagnetic waves.
20. The vehicle of claim 1 , further comprising a frame, said information obtaining system, said processor and said reactive system being arranged on said frame.
21. A vehicle including a system for monitoring a driver of the vehicle during movement of the vehicle under control of the driver, the vehicle comprising
an information obtaining system arranged within the vehicle and that obtains information about the driver;
a processor arranged within the vehicle and coupled to said information obtaining system, said processor analyzing the information obtained by said information obtaining system and movement of the vehicle to determine during movement of the vehicle and based on the obtained information and movement of the vehicle, whether the driver has lost the ability to continue to control the vehicle, the loss of ability to continue to control the vehicle arising from the driver falling asleep or otherwise being incapable of controlling the vehicle after initially having been awake or otherwise capable of controlling the vehicle; and
a reactive component arranged within the vehicle and coupled to said processor and which is affected by the determination by said processor that the driver has lost the ability to continue to control the vehicle,
said reactive component exerting control over the vehicle to slow the vehicle and bring it to a stop.
22. A method for monitoring operation of a vehicle by a driver during movement of the vehicle under control of the driver, comprising:
obtaining information about the driver using an on-board system;
analyzing, using a processor on the vehicle, the information obtained about the driver and movement of the vehicle to determine during movement of the vehicle and based on the information and movement of the vehicle, whether the driver has lost the ability to continue to control the vehicle, the loss of ability to continue to control the vehicle arising from the driver falling asleep or otherwise being incapable of controlling the vehicle after initially having been awake or otherwise capable of controlling the vehicle; and
upon a determination that the driver has lost the ability to continue to control the vehicle, affecting a reactive component on the vehicle that requires action by the driver to indicate regaining of the ability to control movement of the vehicle.
23. The method of claim 22 , wherein the processor analyzes the information and movement of the vehicle relative to a map to determine during movement of the vehicle and based on the obtained information and movement of the vehicle relative to the map, whether the driver has lost the ability to continue to control the vehicle.
24. The method of claim 22 , wherein the processor analyzes the information and movement of the vehicle relative to lane boundaries to determine during movement of the vehicle and based on the obtained information and movement of the vehicle relative to the lane boundaries, whether the driver has lost the ability to continue to control the vehicle.
25. The method of claim 22 , wherein the processor analyzes the information and movement of the vehicle relative to traffic control elements to determine during movement of the vehicle and based on the obtained information and movement of the vehicle relative to the traffic control elements, whether the driver has lost the ability to continue to control the vehicle.
26. The method of claim 22 , wherein the processor analyzes the information and movement of the vehicle relative to movement of other vehicles previously travelling the same road to determine during movement of the vehicle and based on the obtained information and movement of the vehicle relative to the movement of other vehicles, whether the driver has lost the ability to continue to control the vehicle.
27. The method of claim 22 , wherein the processor analyzes the information and movement of the vehicle by analyzing movement of the driver relative to movement of the vehicle to determine during movement of the vehicle and based on the relative movement of the driver to the vehicle, whether the driver has lost the ability to continue to control the vehicle.
28. The method of claim 22 , wherein the step of obtaining information about the driver comprises receiving ultrasonic or electromagnetic waves and converting the received waves into information using a processor on the vehicle.