Integration of occupant monitoring systems with vehicle control systems
The disclosed method is stored as computer readable instructions and carried out by a processor that is part of a disclosed occupant monitoring system (OMS). The method starts with the receipt of an external signal by the processor. The external signal can be the starting of the vehicle engine, an indication of semi-autonomous or autonomous driving mode, or an indication that the occupant is seated, is in contact with a steering wheel, and/or is in contact with at least one dashboard control. The receipt of the external signal causes the processor to capture an image, analyze the image to determine if at least one monitoring condition is met, generate an adjustment signal if the monitoring condition is not met, and communicate the adjustment signal to at least one VCS, and repeating the monitoring loop. In some implementations, multiple images are captured and analyzed during the cycling of a monitoring loop.
1. An occupant monitoring system (OMS) for monitoring a vehicle occupant, the OMS comprising:
an imaging unit positioned on a steering wheel assembly of a vehicle, the imaging unit having a field of view (FOV) directed towards the vehicle occupant; and
a processor in communication with the imaging unit, a memory, and one or more vehicle control systems disposed within the vehicle, wherein the processor executes computer-readable instructions stored on the memory, the instructions cause the processor to:
capture, by the imaging unit, one or more first images in the FOV;
calculate steering wheel assembly position boundaries based on the one or more first images, wherein the steering wheel assembly position boundaries define a range of positions of the steering wheel assembly that enable monitoring of the vehicle occupant; and
initiate cycling of a monitoring loop upon receipt of a signal from external to the OMS, the monitoring loop comprising:
capturing a second image in the FOV of the imaging unit;
analyzing the second image to determine if a monitoring condition is met, wherein the monitoring condition includes a position of the eyes of the vehicle within an analysis region of the FOV, the analysis region defining a range of acceptable values for the position of the eyes of the vehicle occupant relative to a center of the FOV; and
generating an adjustment signal for a seat positioning system or a steering wheel assembly positioning system if the monitoring condition is not met, wherein the adjustment signal includes instructions to adjust the seat positioning system or the steering wheel assembly positioning system such that the eyes of the vehicle occupant are within the range of acceptable values relative to the center of the FOV, wherein movement of the steering wheel assembly is restricted to positions within the steering wheel assembly position boundaries.
2. The occupant monitoring system of claim 1 , wherein the OMS is in communication with the seat positioning system and the steering wheel assembly positioning system, and wherein the computer-readable instructions further cause the processor to communicate the adjustment signal to the seat positioning system and the steering wheel assembly positioning system.
3. The occupant monitoring system of claim 1 , wherein the adjustment signal comprises information about a seat height, a seat angle, a seat proximity to the imaging unit, or a combination thereof.
4. The occupant monitoring system of claim 1 , wherein the adjustment signal comprises information about a steering column angle, a steering column length, or a steering wheel angle.
5. The occupant monitoring system of claim 1 , wherein the imaging unit is positioned on a steering wheel, on a steering wheel column, or on a dashboard of the vehicle.
6. The occupant monitoring system of claim 1 , wherein the computer-readable instructions further cause the processor to repeat the monitoring loop.
7. The occupant monitoring system of claim 1 , wherein the monitoring condition further comprises at least one of the following criteria: presence of the vehicle occupant in the FOV, a position of the vehicle occupant within the FOV, a proximity of the vehicle occupant to the imaging unit, an angle of the face of the vehicle occupant, or an orientation of the eyes of the vehicle occupant within the FOV.
8. The occupant monitoring system of claim 1 , wherein the signal from external to the OMS is a request to check the monitoring condition for compatibility with a semi-autonomous or autonomous driving mode.
9. The occupant monitoring system of claim 8 , wherein if the monitoring condition is met, the computer-readable instructions further cause the processor to:
generate an authorization signal for communicating to one or more of the one or more vehicle control systems to initiate the semi-autonomous or autonomous driving mode if the monitoring condition is met.
10. A positioning system for updating an occupant position based on a change in a driving mode, the positioning system comprising:
an imaging unit positioned on a steering wheel assembly of a vehicle, the imaging unit having a field of view (FOV) directed towards a vehicle occupant; and
a processor in communication with a memory, a user interface, or one or more vehicle control systems disposed within the vehicle, wherein the processor executes computer-readable instructions stored on the memory upon receipt of an external signal indicating that the vehicle is entering either an occupant-controlled driving mode or a semi-autonomous or autonomous driving mode, the computer-readable instructions causing the processor to:
capture, by the imaging unit, one or more first images in the FOV;
calculate steering wheel assembly position boundaries based on the one or more first images, wherein the steering wheel assembly position boundaries define a range of positions of the steering wheel assembly that enable monitoring of the vehicle occupant;
generate a position signal for communicating to a seat positioning system or a steering assembly positioning system, wherein the position signal causes the seat positioning system or the steering assembly positioning system to adjust a seat or the steering wheel assembly, respectively, to a predetermined occupant preferred position,
capture, by the imaging unit, a second image in the FOV;
analyze the second image to determine if a monitoring condition is met, where the monitoring condition includes a position of the eyes of the vehicle occupant within an analysis region of the FOV, the analysis region defining a range of acceptable values for the position of the eyes of the vehicle occupant relative to a center of the FOV; and
generate an adjustment signal for the seat positioning system or the steering positioning system if the monitoring condition is not met, wherein the adjustment signal includes instructions to adjust the seat positioning system or the steering assembly positioning system such that the eyes of the vehicle occupant are within the range of acceptable values relative to the center of the FOV, wherein movement of the steering wheel assembly is restricted to positions within the steering wheel assembly position boundaries.
11. The positioning system of claim 10 , wherein the external signal indicates that the vehicle is entering the semi-autonomous or autonomous driving mode, wherein the position signal is an occupant-preferred position signal for the semi-autonomous or autonomous driving mode, and wherein the predetermined occupant preferred position is the occupant-preferred position for the semi-autonomous or autonomous driving mode.
12. The positioning system of claim 10 , wherein the signal from external to the OMS indicates that the vehicle is entering an occupant controlled driving mode, the position signal is an occupant preferred position signal for the occupant-controlled driving mode, and the predetermined occupant preferred position is the occupant-preferred position for the occupant controlled driving mode.
13. The positioning system of claim 10 , wherein the external signal is generated by a user input.
14. The positioning system of claim 10 , wherein the external signal is generated by the seat positioning system or the steering positioning system.
15. An occupant monitoring system (OMS) for monitoring at least ono a vehicle occupant, the OMS comprising:
an imaging unit positioned on a steering wheel assembly of a vehicle, the imaging unit having a field of view (FOV) directed towards the vehicle occupant, and
a processor in communication with the imaging unit, a memory, a seat positioning system and a steering assembly positioning system disposed within the vehicle, wherein the processor executes computer-readable instructions stored on the memory, wherein upon receipt of a signal from external to the OMS by the processor, the instructions cause the processor to:
capture, by the imaging unit, one or more first images in the FOV;
calculate steering wheel assembly position boundaries based on the one or more first images, wherein the steering wheel assembly position boundaries define a range of positions of the steering wheel assembly that enable monitoring of the vehicle occupant;
capture, by the imaging unit, a second image in the FOV;
analyze the second image to determine if a monitoring condition is met, where the monitoring condition includes a position of the eyes of the vehicle occupant within an analysis region of the FOV, the analysis region defining a range of acceptable values for the position of the eyes of the vehicle occupant relative to a center of the FOV; and
if the monitoring condition is not met, generate an adjustment signal for the seat positioning system or the steering assembly positioning system, where the adjustment signal includes instructions to adjust the seat positioning system or the steering assembly positioning system such that the eyes of the vehicle occupant are within the range of acceptable values relative to the center of the FOV, wherein movement of the steering wheel assembly is restricted to positions within the steering wheel assembly position boundaries.
16. The occupant monitoring system of claim 15 , wherein the computer-readable instructions further cause the processor to:
generate an occupant dataset based on the captured image, wherein data of the occupant dataset comprises at least one value pertaining to a presence of the vehicle occupant in the FOV, a position of the vehicle occupant within the FOV, a proximity of the vehicle occupant to the imaging unit, an angle of the face of the vehicle occupant, a position of a bodily component, an area of a bodily component, an angle of the bodily component, or an orientation of the eyes of the vehicle occupant within the FOV.
17. The occupant monitoring system of claim 16 , wherein the computer-readable instructions further cause the processor to:
compare the occupant dataset to a monitoring conditions dataset, and
generate the adjustment signal for communicating to the the seat positioning system or the steering assembly positioning system based on deviations of the occupant dataset from the monitoring conditions dataset.
18. The occupant monitoring system of claim 15 , wherein if the monitoring condition is not met, the computer-readable instructions further cause the processor to:
generate a prohibition signal for communicating to a vehicle control system to prohibit a semi-autonomous or autonomous driving mode.
19. The occupant monitoring system of claim 1 , wherein the one or more first images comprise at least two images, wherein the computer-readable instructions further cause the processor to:
generate second adjustment signals for the steering wheel assembly to cause the steering wheel assembly to move from a first position to a second position between capturing a first image of the at least two images and a second image of the at least two images.