3D detection system for in-cabin automotive ergonomics
A monitoring system for a vehicle includes an imaging device configured to capture a first image type and a second image type. A first illumination source is configured to emit a flood illumination captured by the imaging device in the first image type. A second illumination source is configured to emit an illumination pattern captured by the imaging device in the second image type. A processor is configured to extract a 2D skeletal representation of a vehicle occupant from the first image type and extrapolate a 3D skeletal representation of the vehicle occupant. The processor is further configured to generate at least one of a communication to the vehicle occupant to change a posture or a signal to a vehicle control system to move at least one of a position of a seat or a position of a steering wheel.
1 . A monitoring system for a vehicle comprising:
a first imaging device configured to capture a first image type and a second imaging device configured to capture a second image type in a sequence with the first image type;
a first illumination source configured to emit a flood illumination captured by the first imaging device in the first image type;
a second illumination source configured to emit an illumination pattern captured by the second imaging device in the second image type; and
at least one processor configured to:
extract a 2-dimensional (“2D”) skeletal representation of a vehicle occupant from the first image type;
measure a depth of the 2D skeletal representation with the second image type;
extrapolate a 3-dimensional (“3D”) skeletal representation of the vehicle occupant; and
based on a posture of the vehicle occupant, generate at least one of a communication to the vehicle occupant to change the posture or a signal to a vehicle control system to move at least one of a position of a seat or a position of a steering wheel.
2 . The monitoring system of claim 1 , wherein the flood illumination and the illumination pattern are substantially within an infrared spectrum and the sequence includes capturing the first image type and the second image type substantially simultaneously.
3 . The monitoring system of claim 2 , wherein the illumination pattern includes a structured light illumination and the at least one processor is configured to extrapolate the 3D skeletal representation under the principles of structured light.
4 . The monitoring system of claim 1 , wherein the illumination pattern includes a beam illumination and the at least one processor is configured to extrapolate the 3D skeletal representation under the principles of Time-of-Flight.
5 . The monitoring system of claim 1 , wherein the at least one processor is further configured to:
detect that the 3D skeletal representation has been in the same posture for a threshold period of time; and
generate the communication to the vehicle occupant with a communications module, the communication including at least one of an auditory or visual recommendation to change the posture.
6 . The monitoring system of claim 1 , wherein the at least one processor is further configured to:
detect that the 3D skeletal representation has been in the same posture for a threshold period of time; and
generate the signal to the vehicle control system to move at least one of the position of the seat or the position of the steering wheel automatically without input from the vehicle occupant.
7 . The monitoring system of claim 1 , wherein the at least one processor is further configured to:
identify if the posture includes a drowsiness identifier; and
generate an alert to the vehicle occupant that the drowsiness identifier has been identified.
8 . The monitoring system of claim 1 , wherein the at least one processor is further configured to:
identify if the posture includes a drowsiness identifier; and
generate a signal to a heating and cooling system to adjust a temperature within the vehicle.
9 . A monitoring system for a vehicle comprising:
a rearview mirror assembly including a housing and a display located within the housing;
at least one imaging device located in the housing and configured to capture a first image type and a second image type;
the first image type including a 2-dimensional (“2D”) capture of a flood illumination on a vehicle occupant;
the second image type including depth information of the vehicle occupant; and
at least one processor configured to:
extract a 2-dimensional (“2D”) skeletal representation of the vehicle occupant from the first image type;
measure a depth of the 2D skeletal representation with the depth information;
extrapolate a 3-dimensional (“3D”) skeletal representation of the vehicle occupant; and
generate at least one of a communication on the display to the vehicle occupant to change a posture or a signal to a vehicle control system to move at least one of a position of a seat or a position of a steering wheel.
10 . The monitoring system of claim 9 , wherein the depth information in the second image type is obtained under the principles of stereo vision by comparing the first image type with the second image type.
11 . The monitoring system of claim 10 , further including an illumination source configured to emit the flood illumination.
12 . The monitoring system of claim 10 , wherein the flood illumination includes ambient lighting.
13 . The monitoring system of claim 9 , wherein the depth information in the second image type is obtained under the principles of at least one of a Time-of-Flight or structured light.
14 . The monitoring system of claim 9 , wherein the at least one processor is configured to generate the communication to the vehicle control system to move the position of the seat.
15 . The monitoring system of claim 9 , wherein the at least one processor is configured to generate the communication to the vehicle control system to move the position of the steering wheel.
16 . The monitoring system of claim 9 , wherein the at least one processor is configured to generate the communication on the display to the vehicle occupant to change the posture.
17 . A monitoring system for a vehicle comprising:
at least one imaging device configured to capture a first image type and a second image type in a sequence;
a first illumination source configured to emit a flood illumination captured by the at least one imaging device in the first image type;
a second illumination source including an optical lens including at least one of a collimation element or a diffractive element, the second illumination source configured to emit an illumination pattern captured by the at least one imaging device in the second image type; and
at least one processor configured to:
extract a 2-dimensional (“2D”) skeletal representation of a vehicle occupant from the first image type;
measure a depth of the 2D skeletal representation with the second image type;
extrapolate a 3-dimensional (“3D”) skeletal representation of the vehicle occupant;
recognize an orthopedic identifier related to a poor posture; and
generate at least one of a communication to the vehicle occupant to change the poor posture or a signal to a vehicle control system to adjust least one of a seat or a steering wheel.
18 . The monitoring system of claim 17 , wherein the at least one processor is configured to generate the communication to the vehicle control system to adjust a temperature of a seat warmer in the seat.
19 . The monitoring system of claim 17 , wherein the at least one processor is configured to generate the communication to the vehicle control system to adjust a temperature of a steering wheel warmer in the steering wheel.
20 . The monitoring system of claim 17 , wherein the at least one processor is configured to generate the communication to the vehicle control system to move at least one of a position of a seat or a position of a steering wheel.