IP Library › Granted Patent US 10,474,914
Granted Patent B2
US 10,474,914 · App. 15/321,048 · Granted Nov 12, 2019

Apparatus detecting driving incapability state of driver

Inventors: Hiroto Banno (Kariya, JP); Takuhiro Omi (Kariya, JP); Yutaka Munaoka (Kariya, JP); Takeshi Enya (Kariya, JP)
Assignee: DENSO CORPORATION
G06K9/00845B60K28/066B60R11/04B60W30/09B60W30/14B60W40/08G06K9/00228G06K9/00281G06K9/52G06T7/292G06T7/593G06T7/73G08B21/02H04N13/204B60K28/06B60W2040/0818B60W2420/42B60W2540/10B60W2540/12B60W2540/18B60W2540/28B60W2550/10B60W2550/30G06K2209/27G06K2209/40G06T2207/10012G06T2207/10016G06T2207/10028G06T2207/20081G06T2207/30201G06T2207/30241G06T2207/30268G08B21/06G08G1/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,474,914
App. No.
15/321,048
Granted
Nov 12, 2019
Kind
B2
Abstract

Apparatus detecting driving incapability state of a driver includes: a head detection portion that successively detects a head portion, which is higher than a neck of the driver, based on an image of a driver's seat captured by an imaging device mounted in a vehicle; and an out-of-frame state detection portion that detects that the driver is incapable of driving, when the head portion detected by the head detection portion is out of a predetermined scope in the image during travelling of the vehicle.

Claims (113)

1. An apparatus detecting driving incapability state of a driver, the apparatus comprising:

a head detection portion that successively detects a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in a vehicle;

an out-of-frame state detection portion that detects that the driver is incapable of driving, when the head portion detected by the head detection portion is out of a predetermined scope in the image during travelling of the vehicle; and

a deformation portion that deforms the predetermined scope in accordance with intention of a user including the driver or with driver information on the driver.

2. An apparatus detecting driving incapability state of a driver, the apparatus comprising:

a head detection portion that successively detects a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in a vehicle;

an out-of-frame state detection portion that detects that the driver is incapable of driving, when the head portion detected by the head detection portion is out of a predetermined scope in the image during travelling of the vehicle; and

a transfer portion that transfers the predetermined scope in accordance with intention of a user including the driver or with driver information on the driver.

3. The apparatus detecting driving incapability state of the driver according to claim 1 , wherein:

the driver information includes at least one of age, a medical history, and a habit of driving posture of the driver.

4. An apparatus detecting driving incapability state of a driver, the apparatus comprising:

a head detection portion that successively detects a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in a vehicle; and

an out-of-frame state detection portion that detects that the driver is incapable of driving, when the head portion detected by the head detection portion is out of a predetermined scope in the image during travelling of the vehicle, wherein

a shape of the predetermined scope is an ellipse having a major axis extending along a width of the vehicle.

5. An apparatus detecting driving incapability state of a driver, the apparatus comprising:

a head detection portion that successively detects a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in a vehicle; and

an out-of-frame state detection portion that detects that the driver is incapable of driving, when the head portion detected by the head detection portion is out of a predetermined scope in the image during travelling of the vehicle, wherein

the out-of-frame state detection portion detects that the driver is incapable of driving, when the head portion is out of the predetermined scope over an out-of-frame determination time.

6. The apparatus detecting driving incapability state of the driver according to claim 5 , wherein:

a first predetermined scope and a second predetermined scope including the first predetermined scope and a scope outer than the first predetermined scope are at least set as predetermined scopes;

the out-of-frame determination time is set for each of the predetermined scopes; and

the out-of-frame state detection portion detects that the driver is incapable of driving, when the head portion is out of at least one of the predetermined scopes over the out-of-frame determination time corresponding to the predetermined scope.

7. The apparatus detecting driving incapability state of the driver according to claim 6 , wherein:

the out-of-frame determination time is set to be shorter as any one of the predetermined scopes is larger.

8. An apparatus detecting driving incapability state of a driver, the apparatus comprising:

a head detection portion that successively detects a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in a vehicle; and

an out-of-frame state detection portion that detects that the driver is incapable of driving, when the head portion detected by the head detection portion is out of a predetermined scope in the image during travelling of the vehicle, wherein

the imaging device is provided by a stereo camera, and

the predetermined scope is provided by a three-dimensionally set scope.

9. An apparatus detecting driving incapability state of a driver, the apparatus comprising:

a head detection portion that successively detects a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in a vehicle;

an out-of-frame state detection portion that detects that the driver is incapable of driving, when the head portion detected by the head detection portion is out of a predetermined scope in the image during travelling of the vehicle; and

a trajectory acquisition portion that acquires a trajectory of the head portion from positions of the head portion detected by the head detection portion,

wherein:

during travelling of the vehicle, the out-of-frame state detection portion detects that the driver is incapable of driving, based on that the head portion detected by the head detection portion is out of a predetermined scope of the image, and the trajectory acquired by the trajectory acquisition portion until the head portion is out of the predetermined scope.

10. An apparatus detecting driving incapability state of a driver, the apparatus comprising:

a head detection portion that successively detects a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in a vehicle;

a trajectory acquisition portion that acquires a trajectory of the head portion from positions of the head portion detected by the head detection portion; and

an out-of-frame state detection portion that detects that the driver is incapable of driving based on the trajectory acquired by the trajectory acquisition portion, during travelling of the vehicle.

11. An apparatus detecting driving incapability state of a driver, the apparatus comprising:

a head detection portion that successively detects a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in a vehicle; and

an out-of-frame state detection portion that detects that the driver is incapable of driving, when the head portion detected by the head detection portion is out of a predetermined scope in the image during travelling of the vehicle, wherein

the predetermined scope is provided by a whole area of the image.

12. The apparatus detecting driving incapability state of the driver according to claim 9 , wherein:

when the head detection portion does not detect the head portion, the head detection portion searches a vicinity of a final position of the trajectory acquired by the trajectory acquisition portion.

13. The apparatus detecting driving incapability state of the driver according to claim 5 , further comprising:

a quantity detection portion that detects a drawing amount of a seat belt of the driver seat,

wherein:

the out-of-frame state detection portion detects that the driver is incapable of driving, when the drawing amount detected by the quantity detection portion is larger than the drawing amount detected at a time of attachment of the seat belt, by a first drawing amount.

14. The apparatus detecting driving incapability state of the driver according to claim 13 , wherein:

the out-of-frame state detection portion detects that the driver is incapable of driving, when the drawing amount per amount detection time, the drawing amount being detected by the quantity detection portion, is larger than a second drawing amount.

15. The apparatus detecting driving incapability state of the driver according to claim 5 , further comprising:

a sitting pressure detection portion that detects pressure distribution of a sitting portion of the driver seat,

wherein:

the out-of-frame state detection portion detects that the driver is incapable of driving, when a high-pressure section in the pressure distribution detected by the sitting pressure detection portion is biased to an end of the sitting portion.

16. The apparatus detecting driving incapability state of the driver according to claim 5 , wherein:

when a position of the head portion successively detected by the head detection portion vibrates with amplitude larger than a predetermined amplitude, the out-of-frame determination time is decreased.

17. The apparatus detecting driving incapability state of the driver according to claim 5 , wherein:

as a moving speed of the head portion successively detected by the head detection portion is faster, the out-of-frame determination time is decreased.

18. The apparatus detecting driving incapability state of the driver according to claim 5 , wherein:

when a moving speed of the head portion is faster as a position of the head portion successively detected by the head detection portion approaches an end of the predetermined scope, the out-of-frame determination time is decreased.

19. The apparatus detecting driving incapability state of the driver according to claim 5 , further comprising:

a spasm detection portion that detects a spasm of the driver,

wherein:

when the spasm detection portion detects the spasm, the out-of-frame determination time is decreased.

20. The apparatus detecting driving incapability state of the driver according to claim 5 , wherein:

as a vehicle speed of the vehicle is higher, the out-of-frame determination time is decreased.

21. The apparatus detecting driving incapability state of the driver according to claim 5 , wherein:

as a time to collision obtained by dividing a distance from a preceding vehicle by a relative speed with respect to the preceding vehicle is smaller, the out-of-frame determination time is decreased.

22. The apparatus detecting driving incapability state of the driver according to claim 5 , further comprising:

a storage portion that registers personal information including a medical history and age of the driver,

wherein:

the out-of-frame determination time is set based on the personal information registered in the storage portion.

23. The apparatus detecting driving incapability state of the driver according to claim 5 , wherein:

when a drive assistance control is performed in the vehicle, the out-of-frame determination time is extended.

24. The apparatus detecting driving incapability state of the driver according to claim 1 , wherein:

a driving incapability state is provided by a state where the driver has a sudden illness.

25. The apparatus detecting driving incapability state of the driver according to claim 2 , wherein:

a driving incapability state is provided by a state where the driver has a sudden illness.

26. The apparatus detecting driving incapability state of the driver according to claim 7 , wherein:

a driving incapability state is provided by a state where the driver has a sudden illness.

27. An apparatus detecting driving incapability state of a driver, the apparatus comprising:

a processor; and

a storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by the processor, perform processing of:

successively detecting a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in a vehicle;

detecting that the driver is incapable of driving when the head portion is out of a predetermined scope in the image during travelling of the vehicle; and

deforming the predetermined scope in accordance with intention of a user including the driver or with driver information on the driver.

28. An apparatus detecting driving incapability state of a driver, the apparatus comprising:

a processor; and

a storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by the processor, perform processing of:

successively detecting a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in a vehicle;

detecting that the driver is incapable of driving when the head portion is out of a predetermined scope in the image during travelling of the vehicle; and

transferring the predetermined scope in accordance with intention of a user including the driver or with driver information on the driver.

29. An apparatus detecting driving incapability state of a driver, the apparatus comprising:

a processor; and

a storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by the processor, perform processing of:

successively detecting a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in a vehicle; and

detecting that the driver is incapable of driving when the head portion is out of a predetermined scope in the image during travelling of the vehicle, wherein

the driver is detected as being incapable of driving when the head portion is out of the predetermined scope over an out-of-frame determination time.

30. An apparatus detecting driving incapability state of a driver, the apparatus comprising:

a processor; and

a storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by the processor, perform processing of:

successively detecting a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in a vehicle;

detecting that the driver is incapable of driving when the head portion is out of a predetermined scope in the image during travelling of the vehicle; and

acquiring a trajectory of the head portion from positions of the head portion detected,

wherein:

during travelling of the vehicle, the driver is detected as being incapable of driving, based on that the head portion detected is out of a predetermined scope of the image, and the trajectory acquired until the head portion is out of the predetermined scope.

31. An apparatus detecting driving incapability state of a driver, the apparatus comprising:

a processor; and

a storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by the processor, perform processing of:

successively detecting a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in a vehicle;

acquiring a trajectory of the head portion from positions of the head portion detected; and

detecting that the driver is incapable of driving based on the trajectory acquired, during travelling of the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2016
From: BANNO, HIROTO; OMI, TAKUHIRO; ENYA, TAKESHI
To: DENSO CORPORATION
Reel/Frame 041143/0184 →
Priority Claims (2)
JP 2014-128387 · Jun 23, 2014 · national
JP 2015-028001 · Feb 16, 2015 · national
Continuity (1)
Related Publication 20170161576A1 · Jun 8, 2017