IP Library › Granted Patent US 12,403,834
Granted Patent B2
US 12,403,834 · App. 18/603,406 · Granted Sep 2, 2025

Vehicular driver monitoring system with camera at interior mirror assembly

Inventor: Michael J. Baur (Kentwood, MI)
Assignee: Magna Mirrors of America, Inc.
B60R1/29B60R1/087B60R1/1207B60R11/00B60R2001/1253B60R2001/1276B60R2011/0019B60R2011/0028B60R2300/101B60R2300/103B60R2300/8006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,403,834
App. No.
18/603,406
Granted
Sep 2, 2025
Kind
B2
Abstract

A vehicular cabin monitoring system includes an interior rearview mirror assembly having a mirror head adjustable relative to a mounting structure. A camera is accommodated by and moves with the mirror head when the mirror head is adjusted. A first subset of image data captured by the camera is processed for monitoring the driver of the vehicle. A spectrally reflecting mirror element is disposed within the interior cabin and spaced from the rearview mirror. The mirror element spectrally reflects light toward the camera that is representative of an obstructed region within the interior cabin not directly viewable by the camera. The mirror element is disposed at an accessory module of the vehicle. A second subset of image data is representative of light reflected from the mirror element. The cabin monitoring system determines presence of an object within the obstructed region based on processing of the second subset of image data.

Claims (62)

1. A vehicular cabin monitoring system, the vehicular cabin monitoring system comprising:

an interior rearview mirror assembly comprising a mirror head adjustable relative to a mounting structure, wherein the mounting structure is configured to attach at a first interior portion of an interior cabin of a vehicle equipped with the vehicular cabin monitoring system to mount the interior rearview mirror assembly within the interior cabin of the vehicle, and wherein the mirror head comprises a mirror reflective element;

a camera accommodated by the mirror head, wherein, with the interior rearview mirror assembly mounted within the interior cabin of the vehicle, the camera moves together and in tandem with the mirror head when the mirror head is adjusted relative to the mounting structure, and wherein the camera is operable to capture image data;

an electronic control unit (ECU);

wherein image data captured by the camera is transferred to the ECU;

wherein the ECU comprises electronic circuitry and associated software, and wherein the electronic circuitry of the ECU comprises an image processor operable to process image data captured by the camera;

wherein a first subset of the image data captured by the camera is representative of a head of a driver of the vehicle, and wherein at least the first subset of the image data captured by the camera is processed at the ECU for monitoring of the driver of the vehicle;

a spectrally reflecting mirror element disposed within the interior cabin of the vehicle and spaced from the interior rearview mirror assembly, wherein the spectrally reflecting mirror element spectrally reflects light toward the camera that is representative of at least a portion of light incident at an obstructed region within the interior cabin of the vehicle, and wherein the obstructed region within the interior cabin of the vehicle is remote from the head of the driver and is not directly viewable by the camera;

wherein the spectrally reflecting mirror element is disposed at an accessory module of the vehicle, and wherein the accessory module attaches at a second interior portion of the interior cabin of the vehicle to dispose the spectrally reflecting mirror element within the interior cabin of the vehicle;

wherein a second subset of the image data captured by the camera is representative of light reflected from the spectrally reflecting mirror element, and wherein the second subset of the image data captured by the camera is different from the first subset of the image data captured by the camera; and

wherein the vehicular cabin monitoring system, based on processing at the ECU of at least the second subset of the image data captured by the camera, determines presence of an object within the obstructed region within the interior cabin of the vehicle.

2. The vehicular cabin monitoring system of claim 1 , wherein the camera captures image data representative of visible light reflected by the spectrally reflecting mirror element.

3. The vehicular cabin monitoring system of claim 1 , wherein the camera captures image data representative of near infrared (near IR) light reflected by the spectrally reflecting mirror element.

4. The vehicular cabin monitoring system of claim 3 , wherein a near IR light emitter is accommodated by the mirror head, and wherein the near IR light emitter is electrically operable to emit near IR light that illuminates at least a portion of the interior cabin of the vehicle.

5. The vehicular cabin monitoring system of claim 3 , wherein the accessory module accommodates a near IR light emitter, and wherein the near IR light emitter is electrically operable to emit near IR light that illuminates the obstructed region within the interior cabin of the vehicle.

6. The vehicular cabin monitoring system of claim 5 , wherein the accessory module accommodates an electronic accessory of the vehicle, and wherein, with the accessory module attached at the second interior portion of the interior cabin of the vehicle, the electronic accessory and the near IR light emitter electrically connect to a power source of the vehicle via a common electrical connector of the accessory module.

7. The vehicular cabin monitoring system of claim 5 , wherein the vehicular cabin monitoring system synchronizes operation of the near IR light emitter and the camera.

8. The vehicular cabin monitoring system of claim 3 , wherein a near IR light emitter is disposed at one selected from the group consisting of (i) a reading light module of the vehicle that is remote from the accessory module of the vehicle and (ii) a dome light module of the vehicle that is remote from the accessory module of the vehicle.

9. The vehicular cabin monitoring system of claim 1 , wherein the accessory module accommodates a speaker of an audio system of the vehicle.

10. The vehicular cabin monitoring system of claim 1 , wherein the accessory module accommodates an interior light source of the vehicle.

11. The vehicular cabin monitoring system of claim 1 , wherein the accessory module accommodates a grab handle of the vehicle.

12. The vehicular cabin monitoring system of claim 1 , wherein the accessory module and the spectrally reflecting mirror element are disposed along a headliner of the vehicle.

13. The vehicular cabin monitoring system of claim 1 , wherein the obstructed region comprises at least one selected from the group consisting of (i) a rear passenger seat region of the interior cabin of the vehicle, (ii) a rear passenger foot well region of the interior cabin of the vehicle and (iii) a rear cargo area of the interior cabin of the vehicle.

14. The vehicular cabin monitoring system of claim 1 , wherein the spectrally reflecting mirror element comprises an electrically dimmable mirror reflective element, and wherein the electrically dimmable mirror reflective element is electrically operable between at least (i) a first reflective state, where the electrically dimmable mirror reflective element has a first level of reflectance, and (ii) a second reflective state, where the electrically dimmable mirror reflective element has a second level of reflectance, and wherein the first level of reflectance is greater than the second level of reflectance.

15. The vehicular cabin monitoring system of claim 14 , wherein, based on the vehicular cabin monitoring system determining presence of the object within the obstructed region within the interior cabin of the vehicle, the electrically dimmable mirror reflective element is electrically operated in the first reflective state, and wherein, based on the vehicular cabin monitoring system determining absence of the object within the obstructed region within the interior cabin of the vehicle, the electrically dimmable mirror reflective element is electrically operated in the second reflective state.

16. The vehicular cabin monitoring system of claim 1 , wherein the accessory module comprises an electronic accessory of the vehicle, and wherein, with the accessory module attached at the second interior portion of the interior cabin of the vehicle, the electronic accessory electrically connects to a power source of the vehicle.

17. A vehicular cabin monitoring system, the vehicular cabin monitoring system comprising:

an interior rearview mirror assembly comprising a mirror head adjustable relative to a mounting structure, wherein the mounting structure is configured to attach at a first interior portion of an interior cabin of a vehicle equipped with the vehicular cabin monitoring system to mount the interior rearview mirror assembly within the interior cabin of the vehicle, and wherein the mirror head comprises a mirror reflective element;

a camera accommodated by the mirror head, wherein, with the interior rearview mirror assembly mounted within the interior cabin of the vehicle, the camera moves together and in tandem with the mirror head when the mirror head is adjusted relative to the mounting structure, and wherein the camera is operable to capture image data representative of near infrared (near IR) light;

an electronic control unit (ECU);

wherein image data captured by the camera is transferred to the ECU;

wherein the ECU comprises electronic circuitry and associated software, and wherein the electronic circuitry of the ECU comprises an image processor operable to process image data captured by the camera;

wherein a first subset of the image data captured by the camera is representative of a head of a driver of the vehicle, and wherein at least the first subset of the image data captured by the camera is processed at the ECU for monitoring of the driver of the vehicle;

a spectrally reflecting mirror element disposed within the interior cabin of the vehicle and spaced from the interior rearview mirror assembly, wherein the spectrally reflecting mirror element spectrally reflects near IR light toward the camera that is representative of at least a portion of near IR light incident at an obstructed region within the interior cabin of the vehicle, and wherein the obstructed region within the interior cabin of the vehicle is remote from the head of the driver and is not directly viewable by the camera;

wherein the spectrally reflecting mirror element is disposed at an accessory module of the vehicle, and wherein the accessory module attaches at a second interior portion of the interior cabin of the vehicle to dispose the spectrally reflecting mirror element within the interior cabin of the vehicle;

wherein the accessory module accommodates a near IR light emitter, and wherein the near IR light emitter is electrically operable to emit near IR light;

wherein, when the near IR light emitter is electrically operated to emit near IR light, near IR light emitted by the near IR light emitter passes through the spectrally reflecting mirror element to illuminate the obstructed region within the interior cabin of the vehicle;

wherein a second subset of the image data captured by the camera is representative of near IR light reflected from the spectrally reflecting mirror element, and wherein the second subset of the image data captured by the camera is different from the first subset of the image data captured by the camera; and

wherein the vehicular cabin monitoring system, based on processing at the ECU of at least the second subset of the image data captured by the camera, determines presence of an object within the obstructed region within the interior cabin of the vehicle.

18. The vehicular cabin monitoring system of claim 17 , wherein the accessory module accommodates an electronic accessory of the vehicle, and wherein, with the accessory module attached at the second interior portion of the interior cabin of the vehicle, the electronic accessory and the near IR light emitter electrically connect to a power source of the vehicle via a common electrical connector of the accessory module.

19. The vehicular cabin monitoring system of claim 17 , wherein the vehicular cabin monitoring system synchronizes operation of the near IR light emitter and the camera.

20. The vehicular cabin monitoring system of claim 17 , wherein the obstructed region comprises at least one selected from the group consisting of (i) a rear passenger seat region of the interior cabin of the vehicle, (ii) a rear passenger foot well region of the interior cabin of the vehicle and (iii) a rear cargo area of the interior cabin of the vehicle.

21. A vehicular cabin monitoring system, the vehicular cabin monitoring system comprising:

an interior rearview mirror assembly comprising a mirror head adjustable relative to a mounting structure, wherein the mounting structure is configured to attach at a first interior portion of an interior cabin of a vehicle equipped with the vehicular cabin monitoring system to mount the interior rearview mirror assembly within the interior cabin of the vehicle, and wherein the mirror head comprises a mirror reflective element;

a camera accommodated by the mirror head, wherein, with the interior rearview mirror assembly mounted within the interior cabin of the vehicle, the camera moves together and in tandem with the mirror head when the mirror head is adjusted relative to the mounting structure, and wherein the camera is operable to capture image data;

an electronic control unit (ECU);

wherein image data captured by the camera is transferred to the ECU;

wherein the ECU comprises electronic circuitry and associated software, and wherein the electronic circuitry of the ECU comprises an image processor operable to process image data captured by the camera;

wherein a first subset of the image data captured by the camera is representative of a head of a driver of the vehicle, and wherein at least the first subset of the image data captured by the camera is processed at the ECU for monitoring of the driver of the vehicle;

an electrically dimmable mirror reflective element disposed within the interior cabin of the vehicle and spaced from the interior rearview mirror assembly, wherein the electrically dimmable mirror reflective element reflects light toward the camera that is representative of at least a portion of light incident at an obstructed region within the interior cabin of the vehicle, and wherein the obstructed region within the interior cabin of the vehicle is remote from the head of the driver and is not directly viewable by the camera;

wherein the electrically dimmable mirror reflective element is disposed at an accessory module of the vehicle, and wherein the accessory module attaches at a second interior portion of the interior cabin of the vehicle to dispose the electrically dimmable mirror reflective element within the interior cabin of the vehicle;

wherein the accessory module comprises an electronic accessory of the vehicle, and wherein, with the accessory module attached at the second interior portion of the interior cabin of the vehicle, the electronic accessory and the electrically dimmable mirror reflective element electrically connect to a power source of the vehicle via a common electrical connector of the accessory module;

wherein the electrically dimmable mirror reflective element is electrically operable between at least (i) a first reflective state, where the electrically dimmable mirror reflective element has a first level of reflectance, and (ii) a second reflective state, where the electrically dimmable mirror reflective element has a second level of reflectance, and wherein the first level of reflectance is greater than the second level of reflectance;

wherein a second subset of the image data captured by the camera is representative of light reflected from the electrically dimmable mirror reflective element, and wherein the second subset of the image data captured by the camera is different from the first subset of the image data captured by the camera;

wherein the vehicular cabin monitoring system, based on processing at the ECU of at least the second subset of the image data captured by the camera, determines presence of an object within the obstructed region within the interior cabin of the vehicle; and

wherein, based on the vehicular cabin monitoring system determining presence of the object within the obstructed region within the interior cabin of the vehicle, the electrically dimmable mirror reflective element is electrically operated in the first reflective state.

22. The vehicular cabin monitoring system of claim 21 , wherein the camera captures image data representative of visible light reflected by the electrically dimmable mirror reflective element.

23. The vehicular cabin monitoring system of claim 21 , wherein the camera captures image data representative of near infrared (near IR) light reflected by the electrically dimmable mirror reflective element.

24. The vehicular cabin monitoring system of claim 23 , wherein the accessory module accommodates a near IR light emitter, and wherein the near IR light emitter is electrically operable to emit near IR light that illuminates the obstructed region within the interior cabin of the vehicle.

25. The vehicular cabin monitoring system of claim 23 , wherein a near IR light emitter is disposed at one selected from the group consisting of (i) a reading light module of the vehicle that is remote from the accessory module of the vehicle and (ii) a dome light module of the vehicle that is remote from the accessory module of the vehicle.

26. The vehicular cabin monitoring system of claim 21 , wherein the obstructed region comprises at least one selected from the group consisting of (i) a rear passenger seat region of the interior cabin of the vehicle, (ii) a rear passenger foot well region of the interior cabin of the vehicle and (iii) a rear cargo area of the interior cabin of the vehicle.

27. The vehicular cabin monitoring system of claim 21 , wherein, based on the vehicular cabin monitoring system determining absence of the object within the obstructed region within the interior cabin of the vehicle, the electrically dimmable mirror reflective element is electrically operated in the second reflective state.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2024
From: BAUR, MICHAEL J.
To: MAGNA MIRRORS OF AMERICA, INC.
Reel/Frame 066748/0492 →
Continuity (2)
Provisional Application 63490293 · Mar 15, 2023
Related Publication 20240308427A1 · Sep 19, 2024
References Cited (50)
US 10017114B2 · Bongwald · 2018 [cited by applicant]
US 10046706B2 · Larson et al. · 2018 [cited by applicant]
US 10065574B2 · Tiryaki · 2018 [cited by applicant]
US 10324297B2 · Kunze · 2019 [cited by applicant]
US 10442360B2 · LaCross et al. · 2019 [cited by applicant]
US 10958830B2 · Koravadi · 2021 [cited by applicant]
US 11465561B2 · Peterson et al. · 2022 [cited by applicant]
US 11518401B2 · Kulkarni · 2022 [cited by applicant]
US 11582425B2 · Liu · 2023 [cited by applicant]
US 11639134B1 · Huizen et al. · 2023 [cited by applicant]
US 11648956B2 · Caron et al. · 2023 [cited by applicant]
US 11780372B2 · Sobecki et al. · 2023 [cited by applicant]
US 11827153B2 · Miller et al. · 2023 [cited by applicant]
US 20060186651A1 · Aoki · 2006 [cited by examiner]
US 20140336876A1 · Gieseke et al. · 2014 [cited by applicant]
US 20150009010A1 · Biemer · 2015 [cited by applicant]
US 20150015710A1 · Tiryaki · 2015 [cited by applicant]
US 20150022664A1 · Pflug et al. · 2015 [cited by applicant]
US 20150092042A1 · Fursich · 2015 [cited by applicant]
US 20150232030A1 · Bongwald · 2015 [cited by applicant]
US 20150294169A1 · Zhou et al. · 2015 [cited by applicant]
US 20150296135A1 · Wacquant et al. · 2015 [cited by applicant]
US 20150352953A1 · Koravadi · 2015 [cited by applicant]
US 20160137126A1 · Fursich et al. · 2016 [cited by applicant]
US 20160209647A1 · Fursich · 2016 [cited by applicant]
US 20170217367A1 · Pflug et al. · 2017 [cited by applicant]
US 20170274906A1 · Hassan et al. · 2017 [cited by applicant]
US 20180222414A1 · Ihlenburg et al. · 2018 [cited by applicant]
US 20180231976A1 · Singh · 2018 [cited by applicant]
US 20190118717A1 · Blank et al. · 2019 [cited by applicant]
US 20190210615A1 · Caron et al. · 2019 [cited by applicant]
US 20200143560A1 · Lu et al. · 2020 [cited by applicant]
US 20200202151A1 · Wacquant · 2020 [cited by applicant]
US 20200320320A1 · Lynam · 2020 [cited by applicant]
US 20210155167A1 · Lynam et al. · 2021 [cited by applicant]
US 20210162926A1 · Lu · 2021 [cited by applicant]
US 20210245662A1 · Blank et al. · 2021 [cited by applicant]
US 20210291739A1 · Kasarla et al. · 2021 [cited by applicant]
US 20210323473A1 · Peterson et al. · 2021 [cited by applicant]
US 20220242438A1 · Sobecki et al. · 2022 [cited by applicant]
US 20220254132A1 · Rother · 2022 [cited by applicant]
US 20220377219A1 · Conger et al. · 2022 [cited by applicant]
US 20240064274A1 · Blank et al. · 2024 [cited by applicant]
US 20240168355A1 · Baur · 2024 [cited by applicant]
US 20240190456A1 · P et al. · 2024 [cited by applicant]
US 20240217437A1 · LaCross · 2024 [cited by applicant]
US 20240223734A1 · Sobecki et al. · 2024 [cited by applicant]
US 20240233511A1 · Golbon Haghighi et al. · 2024 [cited by applicant]
US 20240242513A1 · Huizen et al. · 2024 [cited by applicant]
US 20240383406A1 · Sobecki · 2024 [cited by applicant]
Cited By (1)
US 12,703,303