IP Library › Granted Patent US 12,509,093
Granted Patent B2
US 12,509,093 · App. 18/474,827 · Granted Dec 30, 2025

Eye tracking for detection of diminished driver control

Inventor: Maciej Piotr Książek (Cracow, PL)
Assignee: Aptiv Technologies AG
B60W40/08B60W50/0098G06V10/82G06V20/597G06V40/18B60W2040/0836B60W2420/403B60W2540/22B60W2540/223B60W2540/225B60W2540/229
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,509,093
App. No.
18/474,827
Granted
Dec 30, 2025
Kind
B2
Abstract

A system for monitoring a driver operating a vehicle includes an input configured to receive eye tracking data for the driver. The system includes a processing block configured to determine gaze movement characteristics for the driver from the eye tracking data. The system includes a determination block configured to determine characteristics indicative of diminished driver control from the determined gaze movement characteristics. The determination block determines diminished driver control from the determined gaze movement characteristics being outside predetermined baseline gaze movement characteristic ranges derived from prerecorded gaze movement characteristic data for the driver.

Claims (30)

1 . A system for monitoring a driving operation in a real vehicle on a road, the system comprising:

an input configured to receive eye tracking data and pose tracking data for a present driver operating the vehicle;

a processing block configured to determine both gaze movement characteristics for the present driver from the eye tracking data and pose characteristics for the present driver from the pose tracking data; and

a determination block configured to determine characteristics indicative of diminished driver control associated with a potential pathological condition from both the determined gaze movement characteristics and the determined pose characteristics,

wherein the determination block determines diminished driver control associated with the potential pathological condition from both the determined gaze movement characteristics and the determined pose characteristics being outside stored baseline characteristic ranges derived from prerecorded gaze movement and pose characteristic data for the present driver during their use of the vehicle on the road.

2 . The system of claim 1 , wherein the gaze movement characteristics include gaze movement vectors in a time domain.

3 . The system of claim 2 , wherein the processing block is configured to generate the gaze movement vectors from changes in eye tracking data over time.

4 . The system of claim 1 , wherein the determination block includes a trained neural network for identifying characteristics outside of the stored baseline characteristic ranges.

5 . The system of claim 1 , wherein the determination block is configured to determine diminished driver control by identifying intoxication of the present driver from the determined gaze movement characteristics.

6 . The system of claim 1 , wherein:

the pose tracking data is based on deviations from stored baseline pose characteristics; and

the deviations include at least one of uncharacteristic head positions, uncharacteristic head rotation, oscillating head movements, slumped chest positions, slumped shoulder positions, unusual hand positions, unusual hand movements, and hands being held in a given zone for an extended duration.

7 . The system of claim 1 , wherein the gaze movement characteristics include a gaze of the present driver on another vehicle.

8 . The system of claim 1 , wherein the determination block is configured to generate a control signal for controlling the vehicle to trigger a safety response.

9 . A method for monitoring a driving operation of a real vehicle on a road, the method comprising:

receiving eye tracking data for a present driver operating the vehicle;

receiving pose tracking data for the present driver;

prerecording and storing baseline gaze movement characteristic ranges for the present driver derived from prerecorded gaze movement characteristic data from the eye tracking data for the present driver during their use of the vehicle;

prerecording and storing baseline pose characteristic ranges for the present driver derived from prerecorded pose characteristic data from the pose tracking data for the present driver during their use of the vehicle;

determining instant gaze movement characteristics for the present driver from instant eye tracking data;

determining instant pose characteristics for the present driver from instant pose tracking data; and

determining characteristics indicative of diminished driver control associated with a potential pathological condition from the respective instant determined gaze movement characteristics and instant determined pose characteristics being outside the respective stored baseline gaze movement and pose characteristic ranges.

10 . A non-transitory computer-readable medium comprising instructions that, when executed by a processor, implement:

receiving eye tracking data for a present driver presently operating a real vehicle on a road;

receiving pose tracking data for the present driver;

prerecording and storing baseline gaze movement characteristic ranges for the present driver derived from prerecorded gaze movement characteristic data from the eye tracking data for the present driver during their use of the vehicle;

prerecording and storing baseline pose characteristic ranges for the present driver derived from prerecorded pose characteristic data from the pose tracking data for the present driver during their use of the vehicle;

determining instant gaze movement characteristics for the present driver from instant eye tracking data;

determining instant pose characteristics for the present driver from instant pose tracking data; and

determining characteristics indicative of diminished driver control associated with a potential pathological condition from the respective instant determined gaze movement characteristics and instant determined pose characteristics being outside the respective baseline gaze movement and pose characteristic ranges.

Assignments (3)
MERGER Recorded Feb 11, 2024
From: APTIV TECHNOLOGIES (2) S.À R.L.
To: APTIV MANUFACTURING MANAGEMENT SERVICES S.À R.L.
Reel/Frame 066551/0468 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2024
From: APTIV MANUFACTURING MANAGEMENT SERVICES S.À R.L.
To: APTIV TECHNOLOGIES AG
Reel/Frame 066551/0486 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2024
From: KSIAZEK, MACIEJ PIOTR
To: APTIV TECHNOLOGIES (2) S.À R.L.
Reel/Frame 066231/0086 →
Priority Claims (1)
EP 22197925 · Sep 27, 2022 · regional
Continuity (1)
Related Publication 20240101123A1 · Mar 28, 2024
References Cited (25)
US 11657263B2 · Arar · 2023 [cited by examiner]
US 11807090B2 · Minjeur · 2023 [cited by examiner]
US 20040233061A1 · Johns · 2004 [cited by examiner]
US 20060203197A1 · Marshall · 2006 [cited by examiner]
US 20100033333A1 · Victor · 2010 [cited by examiner]
US 20180126901A1 · Levkova · 2018 [cited by examiner]
US 20210181837A1 · Jiang · 2021 [cited by examiner]
US 20210347364A1 · Ratcliff · 2021 [cited by examiner]
US 20220073079A1 · Nilsson · 2022 [cited by applicant]
US 20220203996A1 · Katz · 2022 [cited by examiner]
Extended European Search Report for EP22197925.5, 9 pages Jan. 30, 2023. [cited by applicant]
Ji et al., “Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance,” Real-Time Imaging, 8, pp. 357-377 (2002). [cited by applicant]
J.L. Booker, “End-position nystagmus as an indicator of ethanol intoxication” Science & Justice, vol. 41, Issue 2, Apr. 2001, pp. 113-116. [cited by applicant]
Ikuyo Akiyama, “The effect of alcohol on the control of the vestibulo-ocular reflex and gaze” 1989, vol. 92, Issue 2, pp. 239-245. [cited by applicant]
Masayo Takahaski, “The effect of alcohol on the vestibulo-ocular reflex and gaze regulation” Arch Otorhinolaryngol vol. 246, pp. 195-199 (1989). [cited by applicant]
Shiferaw et al., “Gaze Entropy Measures Reveal Alcohol-Induced Visual Scanning Impairment During Ascending and Descending Phases of Intoxication,” Journal of Studies on Alcohol and Drugs, 80(2), 236-244 (2019). [cited by applicant]
Shiferaw et al., “Gaze entropy measures detect alcohol-induced driver impairment” Drug and Alcohol Dependence vol. 204, Nov. 1, 2019, 107519, 6 pages. [cited by applicant]
J. Esser, “Pharmacologically-caused eye movement disorders—differential diagnosis and mechanisms of action” Fortschr Neurol Psychiatr 1983; 51(2): 41-56 (Abstract). [cited by applicant]
Hayley et al., “Amphetamine-induced alteration to gaze parameters: A novel conceptual pathway and implications for naturalistic behavior” Progress in Neurobiology, vol. 199, Apr. 2021, 101929. [cited by applicant]
We Collins, “Effects of D-amphetamine and of secobarbital on optokinetic and rotation-induced nystagmus” Aviation, Space, and Environmental Medicine, Apr. 1, 1975, 46(4 Sec 1):357-364 (Abstract). [cited by applicant]
Slattery et al., “Common ocular effects reported to a poison control center after systemic absorption of drugs in therapeutic and toxic doses,” Current Opinion in Ophthalmology 25(6): p. 519-523, Nov. 2014. [cited by applicant]
Romano et al., “Gaze-evoked nystagmus induced by alcohol intoxication” J Physiol 595.6 (2017) pp. 2161-2173. [cited by applicant]
Jessica Bruna Santana Silva, “Effects of acute alcohol ingestion on eye movements and cognition: A double-blind, placebo-controlled study” PLoS One, vol. 12, Oct. 12, 2017, pp. 1-16. [cited by applicant]
Maple-Horvat et al., “Alcohol Badly Affects Eye Movements Linked to Steering, Providing for Automatic in-Car Detection of Drink Driving” Neuropsychopharmacology, vol. 33, pp. 849-858, May 2007. [cited by applicant]
1999 Traffic Techs, “Standardized Field Sobriety Test (SFST) Validated at BACS Below 1.10 Percent,” 7 pages. [cited by applicant]