IP Library › Granted Patent US 11,847,840
Granted Patent B2
US 11,847,840 · App. 17/409,906 · Granted Dec 19, 2023

Visual notification of distracted driving

Inventors: Hiroshi Yasuda (San Francisco, CA); Manuel Ludwig Kuehner (Mountain View, CA)
Assignee: Toyota Research Institute, Inc.
G06V20/597B60Q9/00G06F3/14G06T7/70G06T2207/30196G06T2207/30268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,847,840
App. No.
17/409,906
Granted
Dec 19, 2023
Kind
B2
Abstract

A distracted driver can be informed of his or her distraction by a visual notification. It can be detected whether a driver of a vehicle is focused on a non-critical object located within the vehicle. In response to detecting that the driver of the vehicle is focused on a non-critical object located within the vehicle, an amount of time the driver is focused on the non-critical object can be determined. When the amount of time exceeds a threshold amount of time, a visual notification of distracted driving can be caused to be presented on or visually adjacent to the non-critical object.

Claims (41)

1. A distracted driver notification system comprising:

one or more sensors configured to acquire driver gaze data;

a timer;

one or more processors operatively connected to the one or more sensors and to the timer, the one or more processors being configured to:

detect, using driver gaze data, whether a driver of a vehicle is focused on a non-critical object located within the vehicle;

responsive to detecting that the driver of the vehicle is focused on a non-critical object located within the vehicle, determining an amount of time the driver is focused on the non-critical object by counting using the timer; and

when the amount of time exceeds a threshold amount of time, cause a visual notification of distracted driving to be presented on or visually adjacent to the non-critical object, the visual notification including the amount of time the driver is focused on the non-critical object, the amount of time being updated in real-time in the visual notification.

2. The distracted driver notification system of claim 1 , wherein the visual notification is presented on one of a display of the non-critical object, a display located visually adjacent to the non-critical object, and a surface located visually on or adjacent to the non-critical object.

3. The distracted driver notification system of claim 1 , wherein the one or more sensors include one or more cameras.

4. The distracted driver notification system of claim 1 , wherein the driver gaze data includes at least one of driver eye position data, driver eye orientation data, driver head position data, and driver head orientation data.

5. The distracted driver notification system of claim 1 , wherein the one or more processors are further configured to:

determine the threshold amount of time based on one or more real-time conditions of a current driving environment of the vehicle.

6. The distracted driver notification system of claim 5 , wherein the one or more real-time conditions include at least one of: speed data, location data, weather data, environment data, or traffic data.

7. The distracted driver notification system of claim 1 , wherein the threshold amount of time is a predetermined amount of time.

8. The distracted driver notification system of claim 1 , wherein the one or more processors are further configured to:

determine whether the non-critical object includes a display; and

responsive to determining that the non-critical object does not include a display, cause the visual notification to be presented on one of: a display located visually adjacent to the non-critical object or a surface located visually adjacent to the non-critical object.

9. The distracted driver notification system of claim 1 , wherein the one or more processors are further configured to:

responsive to detecting that the driver of the vehicle is no longer focused on the non-critical object located within the vehicle, causing the visual notification of distracted driving to be discontinued.

10. The distracted driver notification system of claim 1 , wherein detecting whether the driver of a vehicle is focused on the non-critical object located within the vehicle further includes:

detecting an object in the vehicle; and

determining whether the object is a non-critical object.

11. The distracted driver notification system of claim 1 , wherein cause a visual notification of distracted driving to be presented on or visually adjacent to the non-critical object includes send a command to the non-critical object to present the visual notification of distracted driving on a display of the non-critical object.

12. A distracted driver notification method comprising:

detecting whether a driver of a vehicle is focused on a non-critical object located within the vehicle;

responsive to detecting that the driver of the vehicle is focused on a non-critical object located within the vehicle, determining an amount of time the driver is focused on the non-critical object by counting using a timer; and

when the amount of time exceeds a threshold amount of time, cause a visual notification of distracted driving to be presented on or visually adjacent to the non-critical object, the visual notification including the amount of time the driver is focused on the non-critical object, the amount of time being updated in real-time in the visual notification.

13. The distracted driver notification method of claim 12 , wherein cause a visual notification of distracted driving to be presented on or visually adjacent to the non-critical object includes cause a visual notification of distracted driving to be presented on one of: a display of the non-critical object, a display located visually adjacent to the non-critical object, and a surface located on or visually adjacent to the non-critical object.

14. The distracted driver notification method of claim 12 , further including:

acquiring data at least one of driver eye position data, driver eye orientation data, driver head position data, and driver head orientation data, and

wherein detecting whether the driver of a vehicle is focused on the non-critical object located within the vehicle is based on the at least one of driver eye position data, driver eye orientation data, driver head position data, and driver head orientation data.

15. The distracted driver notification method of claim 12 , further including:

determining the threshold amount of time based on real-time conditions of a current driving environment of the vehicle.

16. The distracted driver notification method of claim 12 , further including:

determining whether the non-critical object includes a display; and

responsive to determining that the non-critical object does not include a display, causing the visual notification to be presented on one of a display located visually adjacent to the non-critical object or a surface located visually adjacent to the non-critical object.

17. The distracted driver notification method of claim 12 , further including:

responsive to detecting that the driver of the vehicle is no longer focused on the non-critical object located within the vehicle, causing the visual notification of distracted driving to be discontinued.

18. The distracted driver notification method of claim 12 , wherein detecting whether the driver of a vehicle is focused on the non-critical object located within the vehicle further includes:

detecting an object in the vehicle; and

determining whether the object is a non-critical object.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2024
From: TOYOTA RESEARCH INSTITUTE, INC.
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 066495/0688 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2021
From: YASUDA, HIROSHI; KUEHNER, MANUEL LUDWIG
To: TOYOTA RESEARCH INSTITUTE, INC.
Reel/Frame 057369/0788 →
Continuity (1)
Related Publication 20230066670A1 · Mar 2, 2023