IP Library Granted Patent US 11,348,374
Granted Patent B2
US 11,348,374 · App. 17/445,631 · Granted May 31, 2022

Vehicular driver monitoring system

Inventors: Mark E. Kramer (Zeeland, MI); Niall R. Lynam (Holland, MI); David P. O'Connell (Ada, MI); Vernon R. Nise (Caledonia, MI)
Assignee: MAGNA ELECTRONICS
G06V40/28B60K35/00B60K37/06B60R1/12B60R11/02B60R11/0235B60R11/0241G01C21/265G01C21/3611G01C21/3614G01C21/3644G01C21/3664G01C21/3688G06F3/017G06F3/16G06V20/58G06V20/588G06V20/59G06V20/597H04M1/6091H04N5/23293H04N7/183B60K2370/126B60K2370/135B60K2370/143B60K2370/146B60K2370/1438B60K2370/152B60K2370/1526B60K2370/173B60K2370/21B60K2370/52B60K2370/777B60R2001/1253B60R2001/1284B60R2011/0026B60R2011/0033B60R2011/0063B60R2011/0075B60R2011/0085B60R2300/105B60R2300/207B60R2300/303B60R2300/802B60R2300/806B60R2300/8093G01C21/362G01C21/367G01C21/3629G01C21/3632G01C21/3682G06F3/0482G06F3/04842
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,348,374
App. No.
17/445,631
Granted
May 31, 2022
Kind
B2
Abstract

A vehicular driver monitoring system includes an interior rearview mirror assembly disposed in a vehicle and including a mirror reflective element. A camera is disposed at the interior rearview mirror assembly and views a driver sitting at a driver seat of the equipped vehicle. The camera is operable to capture image data. A control includes a vision system-on-a-chip image processor that processes image data captured by the camera. The control, via processing at the vision system-on-a-chip image processor of image data captured by the camera, determines driver movement. The vehicular driver monitoring system generates an output responsive at least in part to the determined driver movement.

Claims (65)

1. A vehicular driver monitoring system, the vehicular driver monitoring system comprising:

a frameless interior rearview mirror assembly disposed in a vehicle equipped with the vehicular driver monitoring system, wherein the frameless interior rearview mirror assembly comprises a mirror reflective element;

wherein the mirror reflective element comprises a electro-optic mirror reflective element having a front glass substrate and a rear glass substrate with an electro-optic medium sandwiched therebetween;

wherein the front glass substrate comprises a first side and a second side separated by a thickness of the front glass substrate, and wherein a transparent electrically conductive coating is at the second side of the front glass substrate and contacts the electro-optic medium;

wherein the rear glass substrate comprises a third side and a fourth side separated by a thickness of the rear glass substrate, and wherein an electrically conductive coating is at the third side of the rear glass substrate and contacts the electro-optic medium;

a camera disposed at the frameless interior rearview mirror assembly;

wherein the camera views a driver sitting at a driver seat of the equipped vehicle;

wherein the camera is operable to capture image data;

a control comprising a vision system-on-a-chip image processor that processes image data captured by the camera;

wherein the control, via processing at the vision system-on-a-chip image processor of image data captured by the camera, determines driver movement; and

wherein the vehicular driver monitoring system generates an output responsive at least in part to the determined driver movement.

2. The vehicular driver monitoring system of claim 1 , wherein the determined driver movement comprises a hand gesture by the driver of the equipped vehicle.

3. The vehicular driver monitoring system of claim 2 , wherein the control, via processing at the vision system-on-a-chip image processor of image data captured by the camera, recognizes hand gestures by the driver of the equipped vehicle.

4. The vehicular driver monitoring system of claim 3 , wherein the control, responsive at least in part to recognition of a hand gesture, generates the output to control a device of the equipped vehicle.

5. The vehicular driver monitoring system of claim 3 , wherein the control, via processing at the vision system-on-a-chip image processor of image data captured by the camera, recognizes sign language.

6. The vehicular driver monitoring system of claim 1 , wherein the frameless interior rearview mirror assembly comprises a mirror casing.

7. The vehicular driver monitoring system of claim 6 , wherein the front glass substrate of the electro-optic mirror reflective element is nested in a portion of the mirror casing.

8. The vehicular driver monitoring system of claim 7 , wherein the portion of the mirror casing has an outer rounded surface that provides a curved transition from a sidewall of the mirror casing to the first side of the front glass substrate.

9. The vehicular driver monitoring system of claim 6 , wherein the camera is disposed behind the electro-optic mirror reflective element and views through the electro-optic mirror reflective element.

10. The vehicular driver monitoring system of claim 1 , wherein the frameless interior rearview mirror assembly includes a head up display device that projects information toward a windshield of the vehicle so as to be viewable by the driver of the equipped vehicle.

11. The vehicular driver monitoring system of claim 1 , comprising a video display device having a video display screen operable to display video images viewable by the driver of the equipped vehicle.

12. The vehicular driver monitoring system of claim 11 , wherein the video display screen displays video images derived from image data captured by an exterior viewing camera disposed at the equipped vehicle.

13. The vehicular driver monitoring system of claim 11 , wherein the video display device is disposed in the frameless interior rearview mirror assembly, and wherein displayed video images are viewable through the electro-optic mirror reflective element of the frameless interior rearview mirror assembly.

14. The vehicular driver monitoring system of claim 13 , wherein, when a portable hand-held device is present in an interior cabin of the equipped vehicle, the portable hand-held device communicates a signal to a vehicle-based receiver, and wherein the video display device displays a listing of choices in responsive to communication of the signal, and wherein the listing of choices displayed by the video display device comprises at least one of (a) a listing of voice mail messages of a portable phone, (b) a listing of phone numbers of a portable phone, (c) a listing of received or transmitted emails, and (d) a listing of titles or tracks stored in memory of a portable playback device or downloadable from an external provider.

15. A vehicular driver monitoring system, the vehicular driver monitoring system comprising:

a frameless interior rearview mirror assembly disposed in a vehicle equipped with the vehicular driver monitoring system, wherein the frameless interior rearview mirror assembly comprises a mirror casing and a mirror reflective element;

wherein the mirror reflective element comprises an electrochromic mirror reflective element having a front glass substrate and a rear glass substrate with an electrochromic medium sandwiched therebetween;

wherein the front glass substrate comprises a first side and a second side separated by a thickness of the front glass substrate, and wherein a transparent electrically conductive coating is at the second side of the front glass substrate and contacts the electrochromic medium;

wherein the rear glass substrate comprises a third side and a fourth side separated by a thickness of the rear glass substrate, and wherein an electrically conductive coating is at the third side of the rear glass substrate and contacts the electrochromic medium;

a camera disposed at the frameless interior rearview mirror assembly;

wherein the camera is disposed behind the electrochromic mirror reflective element and views through the electrochromic mirror reflective element;

wherein the camera views a driver sitting at a driver seat of the equipped vehicle;

wherein the camera is operable to capture image data;

a control comprising a vision system-on-a-chip image processor that processes image data captured by the camera;

wherein the control, via processing at the vision system-on-a-chip image processor of image data captured by the camera, determines driver movement; and

wherein the vehicular driver monitoring system generates an output responsive at least in part to the determined driver movement.

16. The vehicular driver monitoring system of claim 15 , wherein the determined driver movement comprises a hand gesture by the driver of the equipped vehicle.

17. The vehicular driver monitoring system of claim 16 , wherein the control, via processing at the vision system-on-a-chip image processor of image data captured by the camera, recognizes hand gestures by the driver of the equipped vehicle.

18. The vehicular driver monitoring system of claim 17 , wherein the control, responsive at least in part to recognition of a hand gesture, generates the output to control a device of the equipped vehicle.

19. The vehicular driver monitoring system of claim 15 , wherein the front glass substrate of the electrochromic mirror reflective element is nested in a portion of the mirror casing.

20. The vehicular driver monitoring system of claim 19 , wherein the portion of the mirror casing has an outer rounded surface that provides a curved transition from a sidewall of the mirror casing to the first side of the front glass substrate.

21. The vehicular driver monitoring system of claim 15 , comprising a video display device having a video display screen operable to display video images viewable by the driver of the equipped vehicle, wherein the video display screen displays video images derived from image data captured by an exterior viewing camera disposed at the equipped vehicle, and wherein the video display device is disposed in the frameless interior rearview mirror assembly, and wherein displayed video images are viewable through the electrochromic mirror reflective element of the frameless interior rearview mirror assembly.

22. A vehicular driver monitoring system, the vehicular driver monitoring system comprising:

an interior rearview mirror assembly disposed in a vehicle equipped with the vehicular driver monitoring system, wherein the interior rearview mirror assembly comprises a mirror casing and a mirror reflective element;

wherein the mirror reflective element comprises a glass substrate having a first side and a second side separated by a thickness of the glass substrate;

a camera disposed at the interior rearview mirror assembly;

wherein the camera is disposed behind the mirror reflective element and views through the mirror reflective element;

wherein the camera views a driver sitting at a driver seat of the equipped vehicle;

wherein the camera is operable to capture image data;

a control comprising a vision system-on-a-chip image processor that processes image data captured by the camera;

wherein the control, via processing at the vision system-on-a-chip image processor of image data captured by the camera, determines driver movement; and

wherein the vehicular driver monitoring system generates an output responsive at least in part to the determined driver movement.

23. The vehicular driver monitoring system of claim 22 , wherein the determined driver movement comprises a hand gesture by the driver of the equipped vehicle.

24. The vehicular driver monitoring system of claim 23 , wherein the control, via processing at the vision system-on-a-chip image processor of image data captured by the camera, recognizes hand gestures by the driver of the equipped vehicle.

25. The vehicular driver monitoring system of claim 24 , wherein the control, responsive at least in part to recognition of a hand gesture, generates the output to control a device of the equipped vehicle.

26. The vehicular driver monitoring system of claim 22 , wherein the camera is disposed at the mirror casing.

27. The vehicular driver monitoring system of claim 22 , wherein the mirror reflective element comprises a prismatic mirror reflective element.

28. The vehicular driver monitoring system of claim 27 , wherein the interior rearview mirror assembly comprises a frameless interior rearview mirror assembly, and wherein the glass substrate of the prismatic mirror reflective element is nested in a portion of the mirror casing.

29. The vehicular driver monitoring system of claim 22 , wherein the mirror reflective element comprises an electro-optic mirror reflective element.

30. The vehicular driver monitoring system of claim 29 , wherein the electro-optic mirror reflective element comprises a front glass substrate and a rear glass substrate with an electro-optic medium sandwiched therebetween, and wherein the front glass substrate comprises a first side and a second side separated by a thickness of the front glass substrate, and wherein a transparent electrically conductive coating is at the second side of the front glass substrate and contacts the electro-optic medium, and wherein the rear glass substrate comprises a third side and a fourth side separated by a thickness of the rear glass substrate, and wherein an electrically conductive coating is at the third side of the rear glass substrate and contacts the electro-optic medium.

31. The vehicular driver monitoring system of claim 30 , wherein the electro-optic mirror reflective element comprises an electrochromic mirror reflective element.

32. The vehicular driver monitoring system of claim 22 , comprising a video display device having a video display screen operable to display video images viewable by the driver of the equipped vehicle, wherein the video display screen displays video images derived from image data captured by an exterior viewing camera disposed at the equipped vehicle, and wherein the video display device is disposed in the interior rearview mirror assembly, and wherein displayed video images are viewable through the mirror reflective element of the interior rearview mirror assembly.

33. The vehicular driver monitoring system of claim 22 , wherein the interior rearview mirror assembly comprises a frameless interior rearview mirror assembly.

34. The vehicular driver monitoring system of claim 33 , wherein the glass substrate of the mirror reflective element is nested in a portion of the mirror casing.

35. The vehicular driver monitoring system of claim 34 , wherein the portion of the mirror casing has an outer rounded surface that provides a curved transition from a sidewall of the mirror casing to the first side of the glass substrate.

Continuity (14)
Continuation 16564334 · Sep 9, 2019
Continuation 15494647 · Apr 24, 2017
Continuation 15131594 · Apr 18, 2016
Continuation 14556340 · Dec 1, 2014
Continuation 13097576 · Apr 29, 2011
Continuation 11861904 · Sep 26, 2007
Provisional Application 60896134 · Mar 21, 2007
Provisional Application 60902280 · Feb 20, 2007
Provisional Application 60901514 · Feb 13, 2007
Provisional Application 60900282 · Feb 8, 2007
Provisional Application 60879619 · Jan 10, 2007
Provisional Application 60850700 · Oct 10, 2006
Provisional Application 60847502 · Sep 27, 2006
Related Publication 20210383104A1 · Dec 9, 2021
Cited By (11)
US 12,225,278 US 12,258,025 US 12,325,357 US 12,333,770 US 12,342,106 US 12,436,611 US 12,447,899 US 12,508,988 US 12,509,003 US 12,691,822 US 12,709,222