IP Library Granted Patent US 9,682,622
Granted Patent B2
US 9,682,622 · App. 14/672,520 · Granted Jun 20, 2017

Driver monitoring system

Inventors: Sunghyun Kim (Seoul, KR); Sungwook Hong (Seoul, KR); Joomin Kim (Seoul, KR)
Assignee: LG Electronics Inc.
B60K28/066A61B5/18A61B5/746B60W40/08B60W50/14B60W50/16G08B21/06H04N5/23229A61B5/0261A61B5/0402A61B5/0488A61B5/0496A61B5/0533A61B5/681A61B5/6803B60W2040/0827B60W2050/0089B60W2050/143B60W2050/146B60W2420/42B60W2540/22B60W2540/28
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,682,622
App. No.
14/672,520
Granted
Jun 20, 2017
Kind
B2
Abstract

A driver state monitoring (DSM) system includes an image obtainment apparatus configured to obtain image information of a user driving a vehicle; a biological information obtainment unit configured to be worn on a specific portion of the user's body and to obtain biological information from the specific portion of the user's body; and a controller configured to detect a dangerous driving-state in which the user drives the vehicle, based on the image information and the biological information of the user.

Claims (23)

1. A driver state monitoring (DSM) system comprising:

an image obtainment apparatus configured to obtain image information of a user driving a vehicle;

a biological information obtainment unit configured to be worn on a specific portion of the user's body and to obtain biological information from the specific portion of the user's body; and

a controller configured to detect a dangerous driving-state in which the user drives the vehicle based on a weighted combination of the image information and the biological information of the user.

2. The system of claim 1 , wherein the controller is configured to, based on the image information and the biological information, determine whether the dangerous driving-state corresponds to a drowsy driving state, a distracted driving-state, or a stressful driving-state.

3. The system of claim 2 , wherein the controller is configured to, based on the image information and the biological information, generate information on a danger level indicating an extent of danger corresponding to the determined dangerous driving-state.

4. The system of claim 3 , wherein the controller is configured to generate the information on the determined danger level by applying a weighting factor to at least one of the image information or the biological information.

5. The system of claim 4 , wherein the applied weighting factor differs depending on whether the dangerous driving-state corresponds to the drowsy driving state, the distracted driving-state, or the stressful driving-state.

6. The system of claim 3 , wherein the controller is configured to output the generated information on the determined danger level through an output unit.

7. The system of claim 6 , wherein the controller is configured to adjust an output strength of the information on the danger level as the information on the danger level changes, and wherein the information on the danger level is output according to the adjusted output strength.

8. The system of claim 7 , wherein the output unit is provided in a mobile terminal and is configured to output the information on the danger level in the form of a vibration output or an audio output.

9. The system of claim 8 , wherein the controller is configured to adjust the output strength by changing at least one of a frequency of the vibration output, an amplitude of the vibration output, an output period of the vibration output, an amplitude of the audio output, contents of the audio output, or an output period of the audio output.

10. The system of claim 6 , wherein the output unit is provided in the vehicle, and a vehicle control apparatus provided in the vehicle is configured to control the output unit to output the information on the danger level in the form of an image output or an audio output, and

wherein the output unit is at least one of an emergency light, a light emitting diode (LED) installed in a dashboard of the vehicle, a vibration-enabled seat of the vehicle, or a vibration-enabled wheel steering apparatus of the vehicle.

11. The system of claim 10 , wherein the controller is configured to adjust the output strength by changing at least one of an output period of the emergency light, a light color of the LED, an output period of the LED, a vibration frequency of the vibration-enabled seat or of the vibration-enabled wheel steering apparatus, an amplitude of the vibration, or an output period of the vibration.

12. The system of claim 2 , wherein the biological information includes at least one of sleep-state information or biorhythm information of the user that is measured before the user drives the vehicle.

13. The system of claim 12 , wherein the dangerous driving-state corresponds to a drowsy driving-state, and

wherein the controller is configured to generate a drowsiness trend line over time for the user, based on at least one of the sleep-state information or the biorhythm information, and to detect the dangerous driving-state, based on the generated drowsiness trend line and the image information.

14. The system of claim 2 , wherein the controller is configured to generate a driving-state learning model for determining the user's dangerous driving-state based on past image information and past biological information of the user, and to detect the dangerous driving-state based on the image information, the biological information, and the generated driving-state learning model.

15. The system of claim 1 , further comprising a mobile terminal configured to be worn on the specific portion of the user's body, wherein the mobile terminal comprises:

the biological information obtainment unit, and

a communication unit that receives the image information from an image obtainment apparatus provided in the vehicle.

16. The system of claim 15 , wherein the mobile terminal further comprises the controller.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2015
From: KIM, SUNGHYUN; HONG, SUNGWOOK; KIM, JOOMIN
To: LG ELECTRONICS INC.
Reel/Frame 035287/0036 →
Priority Claims (1)
KR 10-2014-0058583 · May 15, 2014 · national
Continuity (1)
Related Publication 20150328985A1 · Nov 19, 2015