IP Library › Granted Patent US 12,403,931
Granted Patent B2
US 12,403,931 · App. 18/535,183 · Granted Sep 2, 2025

Vehicular driver monitoring system

Inventors: Ramallingeswara Rao P (Andhra Pradesh, IN); Krishnanand Hindoddi (Karnataka, IN)
Assignee: Magna Electronics Inc.
B60W50/16B60W30/165B60W40/04B60W40/09B60W40/105B60W40/107G06V10/774G06V20/597G06V40/10B60W2040/0818B60W2050/143B60W2050/146B60W2420/403B60W2540/229B60W2554/406B60W2554/802
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,403,931
App. No.
18/535,183
Granted
Sep 2, 2025
Kind
B2
Abstract

A vehicular driver monitoring system includes a camera disposed at an interior cabin of a vehicle and that views at least a head region of a driver of the vehicle. The system, based on processing of image data captured by the camera, determines a current behavior of the driver. The system determines a threshold level of distraction associated with the current behavior based on a current operating condition of the vehicle. The system, while the driver is operating the vehicle and based on the determined current behavior and the determined threshold level of distraction, determines that the driver is distracted. Responsive to determination that the driver is distracted, an alert is generated.

Claims (56)

1. A vehicular driver monitoring system, the vehicular driver monitoring system comprising:

a camera disposed at an interior cabin of a vehicle equipped with the vehicular driver monitoring system, wherein the camera views at least a head region of a driver of the vehicle, and wherein the camera is operable to capture image data;

wherein the camera comprises a CMOS imaging array having at least one million photosensors arranged in rows and columns;

an electronic control unit (ECU) comprising electronic circuitry and associated software, wherein the electronic circuitry comprises an image processor for processing image data captured by the camera;

wherein image data captured by the camera is transferred to and processed at the ECU;

wherein the vehicular driver monitoring system, based at least in part on processing of image data captured by the camera and transferred to the ECU, determines a current behavior of the driver;

wherein the vehicular driver monitoring system determines a threshold level of distraction associated with the determined current behavior based at least in part on a current operating condition of the vehicle;

wherein the vehicular driver monitoring system, while the driver is operating the vehicle, determines that the driver is distracted based on (i) the determined current behavior of the driver and (ii) the determined threshold level of distraction associated with the determined current behavior; and

wherein, responsive to determination that the driver is distracted, an alert is generated.

2. The vehicular driver monitoring system of claim 1 , wherein the determined current behavior of the driver comprises use of a mobile device.

3. The vehicular driver monitoring system of claim 2 , wherein the determined current behavior of the driver comprises at least one selected from the group consisting of (i) texting via the mobile device and (ii) making a phone call via the mobile device.

4. The vehicular driver monitoring system of claim 3 , wherein the generated alert comprises a first alert and a second alert, and wherein, based on the determined current behavior of the driver comprising making a phone call via the mobile device, the first alert is generated, and wherein, based on the determined current behavior of the driver comprising texting via the mobile device, the second alert is generated, and wherein the second alert is different than the first alert.

5. The vehicular driver monitoring system of claim 1 , wherein the generated alert comprises at least one selected from the group consisting of (i) an audio alert played at the interior cabin of the vehicle, (ii) a message displayed at a display device of the vehicle, (iii) illumination of an icon at the interior cabin of the vehicle, (iv) vibration of a driver seat of the vehicle, (v) vibration of a steering wheel of the vehicle and (vi) tightening of a seat belt of the vehicle.

6. The vehicular driver monitoring system of claim 1 , wherein the vehicular driver monitoring system is trained using an artificial intelligence (AI) technique to (i) determine the current behavior of the driver and (ii) determine the threshold level of distraction associated with the determined current behavior of the driver.

7. The vehicular driver monitoring system of claim 6 , wherein the AI technique comprises processing image data captured by the camera disposed at the interior cabin of the vehicle.

8. The vehicular driver monitoring system of claim 6 , wherein the AI technique comprises processing image data captured by another camera of another vehicle.

9. The vehicular driver monitoring system of claim 6 , wherein the vehicular driver monitoring system is trained using the AI technique prior to the vehicular driver monitoring system being installed at the vehicle.

10. The vehicular driver monitoring system of claim 6 , wherein the vehicular driver monitoring system is trained using the AI technique as the vehicle is operated to travel along a road.

11. The vehicular driver monitoring system of claim 1 , wherein, based on the determined current behavior of the driver and the current operating condition of the vehicle, the vehicular driver monitoring system determines a level of distraction for the driver, and wherein the vehicular driver monitoring system determines that the driver is distracted based on the determined level of distraction for the driver being greater than the determined threshold level of distraction.

12. The vehicular driver monitoring system of claim 11 , wherein the vehicular driver monitoring system determines (i) a first threshold level of distraction associated with the determined current behavior of the driver and (ii) a second threshold level of distraction associated with the determined current behavior of the driver, and wherein the second threshold level of distraction is different than the first threshold level of distraction, and wherein the generated alert comprises a first alert that is based on the determined level of distraction for the driver being greater than the first threshold level of distraction, and wherein the generated alert comprises a second alert that is based on the determined level of distraction for the driver being greater than the second threshold level of distraction, and wherein the second alert is different than the first alert.

13. The vehicular driver monitoring system of claim 12 , wherein the second alert comprises a greater intensity than the first alert.

14. The vehicular driver monitoring system of claim 1 , wherein the current operating condition of the vehicle comprises at least one selected from the group consisting of (i) a speed of the vehicle, (ii) an acceleration of the vehicle and (iii) a deceleration of the vehicle.

15. The vehicular driver monitoring system of claim 1 , wherein the current operating condition of the vehicle comprises at least one selected from the group consisting of (i) a determined following distance between the vehicle and a leading vehicle, (ii) a determined position of the vehicle within a lane of a roadway in which the vehicle is travelling and (iii) a determined traffic level at or near the vehicle.

16. A vehicular driver monitoring system, the vehicular driver monitoring system comprising:

a camera disposed at an interior cabin of a vehicle equipped with the vehicular driver monitoring system, wherein the camera views at least a head region of a driver of the vehicle, and wherein the camera is operable to capture image data;

wherein the camera comprises a CMOS imaging array having at least one million photosensors arranged in rows and columns;

an electronic control unit (ECU) comprising electronic circuitry and associated software, wherein the electronic circuitry comprises an image processor for processing image data captured by the camera;

wherein image data captured by the camera is transferred to and processed at the ECU;

wherein the vehicular driver monitoring system, based at least in part on processing of image data captured by the camera and transferred to the ECU, determines a current behavior of the driver;

wherein the vehicular driver monitoring system determines a threshold level of distraction associated with the determined current behavior based at least in part on a current operating condition of the vehicle;

wherein the current operating condition of the vehicle comprises at least one selected from the group consisting of (i) a speed of the vehicle, (ii) an acceleration of the vehicle and (iii) a deceleration of the vehicle;

wherein, while the driver is operating the vehicle, and based on the determined current behavior of the driver and the current operating condition of the vehicle, the vehicular driver monitoring system determines a level of distraction for the driver;

wherein the vehicular driver monitoring system determines that the driver is distracted based on the determined level of distraction for the driver being greater than the determined threshold level of distraction associated with the determined current behavior; and

wherein, responsive to determination that the driver is distracted, an alert is generated.

17. The vehicular driver monitoring system of claim 16 , wherein the determined current behavior of the driver comprises use of a mobile device.

18. The vehicular driver monitoring system of claim 17 , wherein the generated alert comprises a first alert and a second alert, and wherein, based on the determined current behavior of the driver comprising making a phone call via the mobile device, the first alert is generated, and wherein, based on the determined current behavior of the driver comprising texting via the mobile device, the second alert is generated, and wherein the second alert is different than the first alert.

19. The vehicular driver monitoring system of claim 16 , wherein the generated alert comprises at least one selected from the group consisting of (i) an audio alert played at the interior cabin of the vehicle, (ii) a message displayed at a display device of the vehicle, (iii) illumination of an icon at the interior cabin of the vehicle, (iv) vibration of a driver seat of the vehicle, (v) vibration of a steering wheel of the vehicle and (vi) tightening of a seat belt of the vehicle.

20. The vehicular driver monitoring system of claim 16 , wherein the current operating condition of the vehicle comprises at least one selected from the group consisting of (i) a determined following distance between the vehicle and a leading vehicle, (ii) a determined position of the vehicle within a lane of a roadway in which the vehicle is travelling and (iii) a determined traffic level at or near the vehicle.

21. A vehicular driver monitoring system, the vehicular driver monitoring system comprising:

a camera disposed at an interior cabin of a vehicle equipped with the vehicular driver monitoring system, wherein the camera views at least a head region of a driver of the vehicle, and wherein the camera is operable to capture image data;

wherein the camera comprises a CMOS imaging array having at least one million photosensors arranged in rows and columns;

an electronic control unit (ECU) comprising electronic circuitry and associated software, wherein the electronic circuitry comprises an image processor for processing image data captured by the camera;

wherein image data captured by the camera is transferred to and processed at the ECU;

wherein the vehicular driver monitoring system, based at least in part on processing of image data captured by the camera and transferred to the ECU, determines a current behavior of the driver;

wherein the vehicular driver monitoring system determines a threshold level of distraction associated with the determined current behavior based at least in part on a current operating condition of the vehicle;

wherein the vehicular driver monitoring system is trained using an artificial intelligence (AI) technique to (i) determine the current behavior of the driver and (ii) determine the threshold level of distraction associated with the determined current behavior of the driver;

wherein the determined current behavior of the driver comprises at least one selected from the group consisting of (i) texting via a mobile device and (ii) making a phone call via the mobile device;

wherein the vehicular driver monitoring system, while the driver is operating the vehicle, determines that the driver is distracted based on (i) the determined current behavior of the driver and (ii) the determined threshold level of distraction associated with the determined current behavior; and

wherein, responsive to determination that the driver is distracted, an alert is generated.

22. The vehicular driver monitoring system of claim 21 , wherein the generated alert comprises a first alert and a second alert, and wherein, based on the determined current behavior of the driver comprising making a phone call via the mobile device, the first alert is generated, and wherein, based on the determined current behavior of the driver comprising texting via the mobile device, the second alert is generated, and wherein the second alert is different than the first alert.

23. The vehicular driver monitoring system of claim 21 , wherein the generated alert comprises at least one selected from the group consisting of (i) an audio alert played at the interior cabin of the vehicle, (ii) a message displayed at a display device of the vehicle, (iii) illumination of an icon at the interior cabin of the vehicle, (iv) vibration of a driver seat of the vehicle, (v) vibration of a steering wheel of the vehicle and (vi) tightening of a seat belt of the vehicle.

24. The vehicular driver monitoring system of claim 21 , wherein the AI technique comprises processing image data captured by the camera disposed at the interior cabin of the vehicle.

25. The vehicular driver monitoring system of claim 21 , wherein the vehicular driver monitoring system is trained using the AI technique prior to the vehicular driver monitoring system being installed at the vehicle.

26. The vehicular driver monitoring system of claim 21 , wherein the vehicular driver monitoring system is trained using the AI technique as the vehicle is operated to travel along a road.

27. The vehicular driver monitoring system of claim 21 , wherein the current operating condition of the vehicle comprises at least one selected from the group consisting of (i) a speed of the vehicle, (ii) an acceleration of the vehicle and (iii) a deceleration of the vehicle.

28. The vehicular driver monitoring system of claim 21 , wherein the current operating condition of the vehicle comprises at least one selected from the group consisting of (i) a determined following distance between the vehicle and a leading vehicle, (ii) a determined position of the vehicle within a lane of a roadway in which the vehicle is travelling and (iii) a determined traffic level at or near the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 11, 2023
From: P, RAMALLINGESWARA RAO; HINDODDI, KRISHNANAND
To: MAGNA ELECTRONICS INC.
Reel/Frame 065828/0752 →
Continuity (2)
Provisional Application 63387104 · Dec 13, 2022
Related Publication 20240190456A1 · Jun 13, 2024
References Cited (57)
US 5550677A · Schofield et al. · 1996 [cited by applicant]
US 5670935A · Schofield et al. · 1997 [cited by applicant]
US 5760962A · Schofield et al. · 1998 [cited by applicant]
US 8258932B2 · Wahlstrom · 2012 [cited by applicant]
US 8922422B2 · Klar et al. · 2014 [cited by applicant]
US 10017114B2 · Bongwald · 2018 [cited by applicant]
US 10099614B2 · Diessner · 2018 [cited by applicant]
US 10671868B2 · Koravadi · 2020 [cited by applicant]
US 10703204B2 · Hassan et al. · 2020 [cited by applicant]
US 10836309B1 · Trundle · 2020 [cited by examiner]
US 10850746B2 · Marti et al. · 2020 [cited by applicant]
US 10963741B2 · Ambeck-Madsen et al. · 2021 [cited by applicant]
US 11167771B2 · Caron et al. · 2021 [cited by applicant]
US 11341671B2 · Lu et al. · 2022 [cited by applicant]
US 11352013B1 · Srinivasan · 2022 [cited by examiner]
US 11433906B2 · Lu · 2022 [cited by applicant]
US 11465561B2 · Peterson et al. · 2022 [cited by applicant]
US 11488399B2 · Wacquant · 2022 [cited by applicant]
US 11493918B2 · Singh · 2022 [cited by applicant]
US 11518401B2 · Kulkarni · 2022 [cited by applicant]
US 11639134B1 · Huizen et al. · 2023 [cited by applicant]
US 11691567B2 · Huizen et al. · 2023 [cited by applicant]
US 11780372B2 · Sobecki et al. · 2023 [cited by applicant]
US 11827153B2 · Miller et al. · 2023 [cited by applicant]
US 20030181822A1 · Victor · 2003 [cited by examiner]
US 20150009010A1 · Biemer · 2015 [cited by applicant]
US 20150015710A1 · Tiryaki · 2015 [cited by applicant]
US 20150092042A1 · Fursich · 2015 [cited by applicant]
US 20150158499A1 · Koravadi · 2015 [cited by applicant]
US 20150294169A1 · Zhou et al. · 2015 [cited by applicant]
US 20150296135A1 · Wacquant et al. · 2015 [cited by applicant]
US 20150352953A1 · Koravadi · 2015 [cited by applicant]
US 20160036917A1 · Koravadi et al. · 2016 [cited by applicant]
US 20160137126A1 · Fursich et al. · 2016 [cited by applicant]
US 20160209647A1 · Fursich · 2016 [cited by applicant]
US 20160221509A1 · Takada et al. · 2016 [cited by applicant]
US 20180009442A1 · Spasojevic et al. · 2018 [cited by applicant]
US 20190054899A1 · Hoyos et al. · 2019 [cited by applicant]
US 20190210615A1 · Caron et al. · 2019 [cited by applicant]
US 20190213429A1 · Sicconi et al. · 2019 [cited by applicant]
US 20190232966A1 · Prakah-Asante et al. · 2019 [cited by applicant]
US 20190258131A9 · Lynam et al. · 2019 [cited by applicant]
US 20190367039A1 · Persia · 2019 [cited by examiner]
US 20200143560A1 · Lu et al. · 2020 [cited by applicant]
US 20200320320A1 · Lynam · 2020 [cited by applicant]
US 20200327345A1 · Schumacher · 2020 [cited by examiner]
US 20210122404A1 · Lisseman et al. · 2021 [cited by applicant]
US 20210245662A1 · Blank et al. · 2021 [cited by applicant]
US 20210394775A1 · Julian · 2021 [cited by examiner]
US 20220204035A1 · Mackenzie · 2022 [cited by examiner]
US 20220229309A1 · Laskin et al. · 2022 [cited by applicant]
US 20220242438A1 · Sobecki et al. · 2022 [cited by applicant]
US 20230036776A1 · Mussa · 2023 [cited by examiner]
US 20230353670A1 · Nieri · 2023 [cited by applicant]
US 20240064274A1 · Blank et al. · 2024 [cited by applicant]
US 20240168355A1 · Baur · 2024 [cited by applicant]
US 20240383406A1 · Sobecki · 2024 [cited by applicant]