IP Library Granted Patent US 12,094,224
Granted Patent B2
US 12,094,224 · App. 16/314,675 · Granted Sep 17, 2024

System and method for driver monitoring

Inventors: Itay Katz (Tel Aviv, IL); Yonatan Samet (Givataim, IL); Tamir Anavi (Kfar Yona, IL)
Assignee: eyeSight Mobile Technologies Ltd.
G06V20/597B60K28/02B60W40/09G06F3/012G06F3/013G06V40/193B60W2040/0818
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,094,224
App. No.
16/314,675
Filed
Jan 1, 2019
Granted
Sep 17, 2024
Kind
B2
Art Unit
2665
USPC
382/103
Abstract

Systems and methods are disclosed for driver monitoring. In one implementation, one or more images are received, e.g., from an image sensor. Such image(s) can reflect a at least a portion of a face of a driver. Using the images, a direction of a gaze of the driver is determined. A set of determined driver gaze directions is identified using at least one predefined direction. One or more features of one or more eyes of the driver are extracted using information associated with the identified set.

Claims (41)

1. A system comprising:

at least one image sensor; and

at least one processor, configured to:

receive one or more images from the image sensor, the one or more images reflecting at least a portion of a face of a driver;

determine, using the images, a direction of a gaze of the driver;

identify a set of determined driver gaze directions comprising a first location at which the driver is looking at a first point in time and a second location at which the driver is looking at a second point in time;

correlate the determined driver gaze directions with at least one predefined direction; and

extract one or more features of one or more eyes of the driver using information associated with the identified set of determined driver gaze directions.

2. The system of claim 1 , wherein the direction of the gaze of the driver reflects a location at which the driver is looking.

3. The system of claim 2 , wherein the location reflects a location outside a vehicle within which the driver is present.

4. The system of claim 2 , wherein the location further reflects a location inside a vehicle within which the driver is present.

5. The system of claim 1 , wherein to identify the set of determined driver gaze directions, the at least one processor is further configured to correlate one or more of the determined driver gaze directions with the at least one predefined direction.

6. The system of claim 1 , wherein the set of determined driver gaze directions is identified using information associated with a distribution of the driver gaze during driving.

7. The system of claim 6 , wherein the set of determined driver gaze directions is identified using at least one of: information associated with a distribution of the driver gaze outside during driving; information associated with a distribution of the driver gaze inside a vehicle while driving; information associated with a distribution of the driver gaze based on driving behavior; information associated with a distribution of the driver gaze based on one or more actions of the driver occurring within a vehicle; information associated with a distribution of the driver gaze based on one or more actions of the driver occurring in relation to a component of a vehicle; or additional information associated with at least one of: a motion direction of a vehicle, a vehicle speed, or a geographic location of a vehicle.

8. The system of claim 1 , wherein to extract the one or more features, the at least one processor is further configured to extract respective features from each of the determined driver gaze directions within the set.

9. The system of claim 1 ,

wherein to identify a set of determined driver gaze directions the processor is further configured to identify at least a first set of driver gaze directions and a second set of driver gaze directions; and

wherein to extract the one or more features, the at least one processor is further configured to extract at least a first feature using information associated with the first set of determined driver gaze directions and a second feature from the second set of determined driver gaze directions.

10. The system of claim 1 ,

wherein to identify a set of determined driver gaze directions the processor is further configured to identify at least a first set of driver gaze directions and a second set of driver gaze directions; and

wherein to extract the one or more features, the at least one processor is further configured to extract the one or more features using information associated with at least the first set of determined driver gaze directions and the second set of determined driver gaze directions.

11. The system of claim 1 , wherein the at least one processor is further configured to determine a position of a head of the driver.

12. The system of claim 11 , wherein to identify the set of determined driver gaze directions, the at least one processor is further configured to identify the set of determined driver gaze directions using at least one of: the position of the head of the driver or information associated with a position of the head of the driver.

13. The system of claim 1 , further comprising a light emitting device.

14. The system of claim 13 , wherein the light emitting device comprises an infrared (IR) light emitting device.

15. The system of claim 1 , wherein to identify the set of determined driver gaze directions, the at least one processor is further configured to identify the set of determined driver gaze directions using a position of one or more objects inside a vehicle within which the driver is present.

16. The system of claim 15 , wherein the one or more objects include one or more mirrors of the vehicle.

17. The system of claim 1 , wherein the at least one predefined direction reflects a direction aligned with the direction of the motion of the vehicle within which the driver is present is traveling.

18. The system of claim 1 , wherein the one or more features comprises at least one of: a kappa angle of the one or more eyes of the driver, a radius of curvature of a cornea of the driver, or a distance between (a) a pupil plane of the one or more eyes of the driver and (b) a center of curvature of a cornea of the driver.

19. A method comprising:

receiving one or more images from an image sensor, the one or more images reflecting a at least a portion of a face of a driver;

determining, using the images, a direction of a gaze of the driver;

identifying a set of determined driver gaze directions comprising a first location at which the driver is looking at a first point in time and a second location at which the driver is looking at a second point in time;

correlating the determined driver gaze directions with at least one predefined direction; and

extracting one or more features of one or more eyes of the driver using information associated with the identified set of determined driver gaze directions.

20. A non-transitory computer readable medium having instructions stored thereon that, when executed by a processing device, cause the processing device to perform operations comprising:

receiving one or more images from an image sensor, the one or more images reflecting a at least a portion of a face of a user;

determining, using the images, a direction of a gaze of the user;

identifying a set of determined user gaze directions comprising a first location at which the driver is looking at a first point in time and a second location at which the driver is looking at a second point in time;

correlating the determined driver gaze directions with at least one predefined direction; and

extracting one or more features of one or more eyes of the user using information associated with the identified set of determined driver gaze directions.

Assignments (1)
CONFIRMATORY ASSIGNMENT Recorded Aug 29, 2025
From: CIPIA VISION LTD.
To: RED BEND LTD.
Reel/Frame 073587/0375 →
Continuity (3)
Provisional Application 62357902 · Jul 1, 2016
Provisional Application 62358480 · Jul 5, 2016
Related Publication 20190318181A1 · Oct 17, 2019