IP Library › Granted Patent US 11,685,384
Granted Patent B2
US 11,685,384 · App. 17/226,551 · Granted Jun 27, 2023

Driver alertness detection method, device and system

Inventor: Andrew Ratcliff (Danderyd, SE)
Assignee: Tobii AB
B60W40/08B60W50/16G06F3/013G06V20/597G06V40/19H04N13/128B60W2040/0827B60W2050/143B60W2050/146B60W2540/225B60W2540/229
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,685,384
App. No.
17/226,551
Granted
Jun 27, 2023
Kind
B2
Abstract

The invention is related to a method for driver alertness detection, The method comprises the steps of determining a vanishing point of a vehicle in motion; determining over time, by an eye tracking device, a set of gaze points of the driver of the vehicle; determining a gaze movement from the set of gaze points; and identifying an alertness of the driver, based on a direction of the gaze movement relative to the vanishing point being outward. Further, the invention is related to an eye tracking device for driver alertness detection, an alertness detection system, a computer program, and a computer-readable medium.

Claims (42)

1. A method for driver alertness detection, comprising:

determining a vanishing point of a vehicle in motion, wherein the vanishing point is a point towards which the vehicle is moving;

determining over time, by an eye tracking device, a set of gaze points of the driver of the vehicle;

determining a direction of movement of gaze from the set of gaze points; and

identifying an increased level of alertness of the driver, based on the direction of movement of gaze being away and outward from the vanishing point, wherein the identifying of the alertness of the driver is further based on whether a distance between two gaze point pairs, in an outward direction from the vanishing point, is increasing.

2. The method for driver alertness detection according to claim 1 , wherein the identifying of the alertness of the driver is based on the direction of movement of gaze relative to the vanishing point being radially outward.

3. The method for driver alertness detection according to claim 1 , wherein the identifying of the alertness of the driver is based on determining if a convergence depth decreases.

4. The method for driver alertness detection according to claim 1 , wherein the identifying of the alertness of the driver is based on if the movement of gaze correlates to a travel direction and/or speed of the vehicle.

5. The method for driver alertness detection according to claim 1 , wherein a travel direction and/or speed of the vehicle is determined by use of a signal and/or data comprising vehicle travel information and/or exterior vehicle information.

6. The method for driver alertness detection according to claim 1 , wherein the vanishing point of the vehicle is determined by use of a signal and/or data comprising vehicle travel information and/or exterior vehicle information.

7. The method for driver alertness detection according to claim 1 , further comprising:

determining an alertness time, the alertness time being calculated as a time since the last identification of alertness of the driver; and

warning the driver if the alertness time exceeds an alertness time threshold.

8. The method for driver alertness detection according to claim 1 , wherein the identifying of the alertness is based on at least 3 gaze points.

9. The method for driver alertness detection according to claim 1 , further comprising:

determining if a gaze point deviates less than a predetermined degree of deviation from a deviation line based on at least two other gaze points.

10. The method for driver alertness detection according to claim 1 , further comprising:

determining if the movement of gaze follows a straight line.

11. The method for driver alertness detection according to claim 1 , further comprising:

determining if the movement of gaze correlates to a travel direction and/or a speed of the vehicle.

12. The method for driver alertness detection according to claim 1 , wherein the identifying of the alertness is based on at least 5 gaze points.

13. The method for driver alertness detection according to claim 1 , wherein the identifying of the alertness is based on at least 10 gaze points.

14. An eye tracking device for driver alertness detection, comprising:

a processor configured to:

determine a vanishing point of a vehicle in motion, wherein the vanishing point is a point towards which the vehicle is moving;

determine over time a set of gaze points of the driver of the vehicle;

determine a direction of movement of gaze from the set of gaze points; and

identify an increased level of alertness of the driver, based on the direction of movement of gaze being away and outward from the vanishing point, wherein the identifying of the alertness of the driver is further based on if a distance between two gaze point pairs, in an outward direction from the vanishing point, is increasing.

15. A driver alertness detection system, comprising:

a vehicle; and

an eye tracking device;

the eye tracking device comprising a processor configured to:

determine a vanishing point of the vehicle in motion, wherein the vanishing point is a point towards which the vehicle is moving;

determine over time a set of gaze points of the driver of the vehicle;

determine a direction of movement of gaze from the set of gaze points; and

identify an increased level of alertness of the driver, based on the direction movement of gaze being away and outward from the vanishing point, wherein the identifying of the alertness of the driver is further based on if a distance between two gaze point pairs, in an outward direction from the vanishing point, is increasing.

16. The driver alertness detection system according to claim 15 , wherein the eye tracking device is a remote eye tracker arranged in the vehicle or the eye tracking device is incorporated in a head-mounted device on the driver.

17. A non-transitory computer-readable medium having stored thereon a computer program for driver alertness detection, comprising:

determining a vanishing point of a vehicle in motion, wherein the vanishing point is a point towards which the vehicle is moving,

determining over time a set of gaze points of the driver of the vehicle,

determining a direction of movement of gaze from the set of gaze points, and

identifying an increased level of alertness of the driver, based on the direction of movement of gaze being away and outward from the vanishing point, wherein the identifying of the alertness of the driver is further based on if a distance between two gaze point pairs, in an outward direction from the vanishing point, is increasing.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE EXECUTION DATE PREVIOUSLY RECORDED AT REEL: 062463 FRAME: 0748. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Feb 24, 2023
From: RATCLIFF, ANDREW
To: TOBII AB
Reel/Frame 062850/0554 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2023
From: RATCLIFF, ANDREW
To: TOBII AB
Reel/Frame 062463/0748 →
Priority Claims (1)
SE 2030120-6 · Apr 9, 2020 · national
Continuity (1)
Related Publication 20210347364A1 · Nov 11, 2021
Cited By (2)
US 12,233,775 US 12,554,322