Dynamic lighting and sensor adjustment for occupant monitoring
Systems and methods to proactively adapt image sensor settings of an occupant monitoring system to accommodate ambient lighting changes are provided. The system may track current ambient light, track the driver, and predict upcoming changing lighting conditions. Sensors are used to predict when the ambient light will change and preemptively adjust to prevent dark or washout images. The sensor adjustment may be timed so that the adjustment is made just in time or concurrently with the change in ambient light conditions. The system may predict when the light on the occupant's face will change and proactively readjust the settings of the sensor to accommodate the changed lighting conditions.
1. An imaging system comprising:
one or more environmental sensors;
a camera including one or more image sensors;
an in-cabin light sensor sensing a first in-cabin lighting level;
a predictive lighting module in communication with the one or more environmental sensors, the in-cabin light sensor, and the camera, the predictive lighting module configured to:
receive environmental data from the one or more environmental sensors;
receive the first in-cabin lighting level the in-cabin light sensor;
adjust the one or more image sensors according to the first in-cabin lighting level;
predict a prospective environmental change based on the environmental data;
predict a second in-cabin lighting level based upon the prospective environmental change;
adjust the one or more image sensors according to the second in-cabin lighting level substantially concurrently with the prospective environmental change.
2. The imaging system of claim 1 wherein the one or more image sensors include an infrared sensor.
3. The imaging system of claim 1 wherein the camera includes an occupant-facing camera disposed in a vehicle.
4. The imaging system of claim 1 wherein the one or more environmental sensors include a LiDAR sensor.
5. The imaging system of claim 1 wherein the one or more environmental sensors include a RADAR sensor.
6. The imaging system of claim 1 wherein the one or more environmental sensors include an infrared sensor.
7. The imaging system of claim 1 further comprising a communications module configured to receive the environmental data, the predictive lighting module further receiving the environmental data from the communications module.
8. The imaging system of claim 7 wherein the communications module includes a GPS receiver.
9. An occupant monitoring system of claim 1 wherein the predictive lighting module is further configured to determine a time (T), at which the prospective environmental change will occur, wherein substantially concurrently comprises a time range before and after the time (T).
10. A method of monitoring a vehicle occupant comprising:
receiving environmental data from the one or more environmental sensors;
receiving a first in-cabin lighting level from an in-cabin light sensor;
adjusting one or more image sensors according to the first in-cabin lighting level;
predicting a prospective environmental change based on the environmental data;
predicting a second in-cabin lighting level based upon the prospective environmental change; and
adjusting the one or more image sensors according to the second in-cabin lighting level substantially concurrently with the prospective environmental change.
11. The method of claim 10 further comprising:
determining a time (T), at which the prospective environmental change will occur, wherein substantially concurrently comprises a time range before and after the time (T).
12. The method of claim 10 further comprising:
obtaining a first sequence of images from the one or more image sensors according to the first in-cabin lighting level; and
obtaining a second sequence of images from the one or more image sensors according to the second in-cabin lighting level.
13. The method of claim 10 wherein the one or more image sensors include an infrared sensor.
14. The method of claim 10 wherein the camera includes an occupant-facing camera disposed in a vehicle.
15. The method of claim 10 wherein the one or more environmental sensors include a LiDAR sensor.
16. The method of claim 10 wherein the one or more environmental sensors include a RADAR sensor.
17. The method of claim 10 wherein the one or more environmental sensors include an infrared sensor.
18. The method of claim 10 wherein the environmental data includes GPS data.
19. An occupant monitoring system for a vehicle comprising:
an occupant facing camera, the occupant facing camera comprising one or more image sensors;
an in-cabin light sensor sensing a first in-cabin lighting level;
a communications module configured to receive navigational data;
one or more environmental sensors configured to receive environmental data;
a predictive lighting module in communication with the one or more environmental sensors, the in-cabin light sensor, and the occupant-facing camera, the predictive lighting module configured to:
receive environmental data from the one or more environmental sensors and navigation information from the communications module;
receive the first in-cabin lighting level from the in-cabin light sensor;
adjust the one or more image sensors according to the first in-cabin lighting level;
predict a prospective environmental change based on the environmental data and the navigational data;
predict a second in-cabin lighting level based upon the prospective environmental change; and
adjust the one or more image sensors according to the second in-cabin lighting level substantially concurrently with the prospective environmental change.
20. The occupant monitoring system of claim 19 wherein the predictive lighting module is further configured to determine a time (T), at which the prospective environmental change will occur, wherein substantially concurrently comprises a time range before and after the time (T).