IP Library Granted Patent US 12686391
Granted Patent B2
US 12686391 · App. 18/622,695 · Granted Jul 21, 2026

Driver psychophysiological state detection

Inventors: Anastasiya Vladimirovna Bakhchina (Nizhniy Novgorod, RU); Ivan Sergeevich Shishalov (Nizhniy Novgorod, RU); Mariya Yurievna Nevaykina (Nizhny Novgorod, RU); Anton Konstantinovich Yakimov (Nizhny Novgorod, RU); Anton Sergeevich Devyatkin (Nizhny Novgorod, RU); Mikhail Sergeevich Sotnikov (Nizhny Novgorod, RU); Andrey Viktorovich Filimonov (Nizhegorodskaya oblast, RU); Vladimir Vladimirovich Borzikov (Yerevan, AM)
Assignee: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
B60W40/09G06V20/597G06V40/161G06V40/18B60W2040/0827B60W2040/0872B60W2420/403B60W2540/22B60W2540/221B60W2540/229
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12686391
App. No.
18/622,695
Filed
Mar 29, 2024
Granted
Jul 21, 2026
Kind
B2
Art Unit
2688
USPC
340/439
Abstract

It is herein disclosed a method of collecting data for determining a psychophysiological state of a human driver, comprising collecting data throughout a driving session, wherein the driving session comprises a predetermined time period of non-stop driving by a driver in a monotonous driving environment and a plurality of detection response tasks (DRTs) performed by the driver in the predetermined time period, wherein each DRT comprises the driver reacting to at least one visual stimulus; wherein said collecting data comprises: collecting, by a plurality of detection means, physiological data on the driver throughout the predetermined time period; wherein the physiological data collected comprises at least one of: heart rate data, electroencephalogram data, eye movement data, and respiration data; and collecting driver behaviour data, comprising recording steer wheel activity of the driver and recording a manner in which the driver reacts to the visual stimulus during the plurality of DRTs.

Claims (33)

1 . A method of collecting data for determining a psychophysiological state of a human driver, comprising:

collecting data throughout a driving session, wherein the driving session comprises a predetermined time period of non-stop driving by a driver in a monotonous driving environment and a plurality of detection response tasks (DRTs) performed by the driver in the predetermined time period, wherein each DRT comprises the driver reacting to at least one visual stimulus; wherein the driving session takes place after a first period of rest by the driver for a first predetermined duration, and a second period of rest by the driver for a second predetermined duration takes place after the driving session, and wherein said collecting data comprises:

collecting, by a plurality of detection means, physiological data on the driver throughout the predetermined time period; wherein the physiological data collected comprises at least one heart rate data, at least one electroencephalogram (EEG) data, at least one eye movement data, and at least one respiration data;

collecting driver behaviour data, comprising:

recording steer wheel activity of the driver; and

recording the driver's reaction to the at least one visual stimulus during the plurality of DRTs; and

collecting self-reported data from the driver before and after the driving session, the self-reported data comprising data on at least one of: the driver's psychological state, physical state or prior sleep conditions, wherein collecting self-reported data comprises:

collecting first self-reported data before the first period of rest;

collecting second self-reported data after the first period of rest and before the driving session;

collecting third self-reported data after the driving session and before the second period of rest; and

collecting fourth self-reported data after the second period of rest.

2 . The method in accordance with claim 1 , wherein said non-stop driving by the driver takes place in a simulated road environment using a car simulator.

3 . The method in accordance with claim 1 , wherein the each DRT comprises the driver reacting to the at least one visual stimulus, and wherein said recording the driver's reaction comprises at least one recording a response time of the user in reaction to the visual stimulus, at least one number of correct responses, and at least one number of incorrect responses.

4 . The method in accordance with claim 3 , wherein in each DRT the driver reacts to the at least one visual stimulus by physically pressing a button.

5 . The method in accordance with claim 1 , wherein in at least one of the plurality of DRTs, at least one false stimulus is provided to the driver that the driver is instructed to ignore; wherein the visual stimulus comprises a visual indication in a first colour, and the false stimulus comprises a visual indication in a second colour different from the first colour.

6 . The method in accordance with claim 1 , wherein the predetermined time period of the non-stop driving is under 130 minutes.

7 . The method in accordance with claim 1 , wherein each of the plurality of DRTs during the predetermined time period has a duration of between 2 and 4 minutes, and wherein a time interval between successive DRTs is between 25 and 30 minutes, and preferably 26 to 28 minutes.

8 . The method in accordance with claim 1 , wherein the plurality of detection means comprises at least one ECG (electrocardiogram) apparatus for obtaining heart rate data, at least one eye-tracking camera for obtaining eye movement data, at least one camera for obtaining video data of the driver's face, and at least one photoplethysmography sensor to collect blood circulation data.

9 . The method in accordance with claim 1 , further comprising:

analysing the physiological data and the driver behaviour data to determine a level of drowsiness of the driver during the driving session.

10 . The method in accordance with claim 9 , wherein analysing the physiological data and driver behaviour data comprises storing the collected data in a memory and/or sending the collected data to a processor for analysis.

11 . The method in accordance with claim 10 , further comprising storing results of the analysis and the collected physiological data and the collected driving behaviour data in a database, and using the database as training data for a machine-learning algorithm to predict or estimate the psychological state of a driver when driving.

12 . A system for collecting data for determining a psychophysiological state of a human driver, comprising:

means for collecting data throughout a driving session, wherein the driving session comprises a predetermined time period of non-stop driving by a driver in a monotonous driving environment and a plurality of detection response tasks (DRTs) performed by the driver in the predetermined time period, wherein each DRT comprises the driver reacting to at least one visual stimulus; wherein the driving session takes place after a first period of rest by the driver for a first predetermined duration, and a second period of rest by the driver for a second predetermined duration takes place after the driving session, and wherein the means for collecting data comprises:

a plurality of detection means for collecting physiological data on the driver throughout the predetermined time period; wherein the physiological data collected comprises at least one heart rate data, at least one electroencephalogram (EEG) data, at least one eye movement data, and at least one respiration data; and

means for collecting driver behaviour data, comprising:

means for recording steer wheel activity of the driver;

means for recording the driver's reaction to the at least one visual stimulus during the plurality of DRTs; and

means for collecting self-reported data from the driver before and after the driving session, the self-reported data comprising data on at least one of: the driver's psychological state, physical state or prior sleep conditions, wherein said self-reported data comprises:

first self-reported data before the first period of rest;

second self-reported data after the first period of rest and before the driving session;

third self-reported data after the driving session and before the second period of rest; and

fourth self-reported data after the second period of rest.