State detection device, state detection system, and state detection method

1. A state detection device, comprising:

a first solid-state imaging device comprising a plurality of pixels, wherein each pixel of the plurality of pixels is configured to:

receive incident light; and

detect, based on an amount of the incident light, occurrence of an event in a corresponding pixel of the plurality of pixels;

a second solid-state imaging device configured to:

capture a face of a driver; and

obtain image data based on the captured face; and

a state detection unit configured to detect a state of the driver based on the occurrence of the event and the image data.

2. The state detection device according to claim 1 , wherein the state detection unit is further configured to detect at least one of motion of an eyeball, motion of an eyelid, a direction of the face, or a direction of a line of sight of the driver as the state of the driver.

3. The state detection device according to claim 1 , further comprising an action pattern determination unit configured to determine an action pattern based on the detected state of the driver.

4. The state detection device according to claim 3 , wherein

the state detection unit is further configured to detect at least one of motion of an eyeball or motion of an eyelid of the driver, and

the action pattern determination unit is further configured to:

estimate a degree of wakefulness of the driver based on the at least one of the motion of the eyeball or the motion of the eyelid; and

determine the action pattern based on the estimated degree of wakefulness.

5. The state detection device according to claim 4 , wherein the action pattern determination unit is further configured to determine the action pattern, to alert the driver, based on the estimated degree of wakefulness.

6. The state detection device according to claim 3 , further comprising:

an imaging unit configured to image video of an area behind a vehicle; and

a display unit configured to display the video imaged by the imaging unit, wherein

the state detection unit is further configured to detect at least one of a direction of the face or a direction of a line of sight of the driver, and

the action pattern determination unit is further configured to:

determine that the driver looks at or is about to look, at the display unit, based on the at least one of the direction of the face or the direction of the line of sight; and

determine the action pattern based on the determination.

7. The state detection device according to claim 6 , wherein the action pattern determination unit is further configured to:

determine the action pattern to allow the display unit to display the video in a case where the driver looks at or is about to look at the display unit; and

determine the action pattern to turn off the display unit in a case where the driver looks away or is about to look away from the display unit.

8. The state detection device according to claim 3 , further comprising:

an imaging unit configured to image video of an area behind a vehicle;

a sensor configured to detect at least one of an inter-vehicular distance to a following vehicle or a relative speed relative to the following vehicle; and

a display unit a configured to display the video imaged by the imaging unit, wherein

the state detection unit is configured to detect at least one of a direction of the face or a direction of a line of sight of the driver, and

the action pattern determination unit is further configured to determine the action pattern based on at least one of the inter-vehicular distance or the relative speed and at least one of the direction of the face or the direction of the line of sight.

9. The state detection device according to claim 8 , wherein the action pattern determination unit is further configured to:

determine a risk of collision with the following vehicle based on at least one of the inter-vehicular distance or the relative speed;

determine that the driver looks at or is about to look, at the display unit, based on a basis of at least one of the direction of the face or the direction of the line of sight in a case where there is the risk of collision with the following vehicle; and

determine an action pattern to allow the display unit to display the video in a case where the driver looks away or is about to look away from the display unit.

10. A state detection system, comprising:

a first solid-state imaging device comprising a plurality of pixels, wherein each pixel of the plurality of pixels is configured to:

receive incident light; and

detect, based on an amount of the incident light occurrence of an event in a corresponding pixel of the plurality of pixels;

a second solid-state imaging device configured to:

capture a face of a driver; and

obtain image data based on the captured face; and

a state detection unit configured to detect a state of the driver on a based on the occurrence of the event and the image data.

11. A state detection method, comprising:

detecting a state of a driver based on occurrence of an event and image data, wherein

the occurrence of the event is detected by a first solid-state imaging device,

the image data is obtained by a second solid-state imaging device,

the first solid-state imaging device comprises a plurality of pixels, wherein each pixel of the plurality of pixels is configured to:

receive incident light; and

detect, based on an amount of the incident light, the occurrence of the event in a corresponding pixel of the plurality of pixels; and

the second solid-state imaging device is configured to:

capture a face of the driver; and

obtain the image data based on the captured face.