IP Library Granted Patent US 11,922,706
Granted Patent B2
US 11,922,706 · App. 17/577,136 · Granted Mar 5, 2024

Systems and methods for dynamic attention area

Inventors: Thomas James Herbert (Fenton, MI); Tom Toma (Commerce Township, MI); Hans Herbertsson (Borås, SE)
Assignee: VEONEER US, LLC
G06V20/597
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,922,706
App. No.
17/577,136
Granted
Mar 5, 2024
Kind
B2
Abstract

A driver monitoring system of a vehicle includes: a camera configured to capture an image of a driver on a driver's seat within a passenger cabin of the vehicle; a gaze module configured to determine a gaze vector based on a direction of pupils of the driver in the image; an area module configured to determine an area on a vertical plane in front of the driver based on a road in front of the vehicle; a location module configured to determine a location on the vertical plane where the gaze vector intersects the vertical plane; and a monitor module that determines whether the location on the vertical plane where the gaze vector intersects the vertical plane is within the area on the vertical plane.

Claims (39)

1. A driver monitoring system of a vehicle, comprising:

a camera configured to capture an image of a driver on a driver's seat within a passenger cabin of the vehicle;

a gaze module configured to determine a gaze vector based on a direction of pupils of the driver in the image;

an area module configured to determine an area on a vertical plane in front of the driver based on a road in front of the vehicle and to increase a size of the area by moving a vertical edge of the area when the road in front of the vehicle curves from the perspective of the driver;

a location module configured to determine a location on the vertical plane where the gaze vector intersects the vertical plane; and

a monitor module that determines whether the location on the vertical plane where the gaze vector intersects the vertical plane is within the area on the vertical plane,

wherein the area module is further configured to:

when a present lane of the vehicle is to merge with a first one or more lanes to the left of the vehicle, move a right vertical edge of the vehicle to the left to a right boundary of the right most one of the first one or more lanes; and

when the present lane of the vehicle is to merge with a second one or more lanes to the right of the vehicle, move a left vertical edge of the vehicle to the right to a left boundary of the left most one of the first one or more lanes.

2. The driver monitoring system of claim 1 wherein the area module is configured to move the area on the vertical plane based on the road in front of the vehicle.

3. The driver monitoring system of claim 1 wherein the area module is configured to selectively move the left vertical edge of the area based on the road in front of the vehicle.

4. The driver monitoring system of claim 3 wherein the area module is configured to selectively move the left vertical edge of the area in response to one or more lanes joining with a present lane of the vehicle to the left of the present lane of the vehicle.

5. The driver monitoring system of claim 3 wherein the area module is configured to selectively move the left vertical edge of the area when the road in front of the vehicle curves to the left from the perspective of the driver.

6. The driver monitoring system of claim 1 wherein the area module is configured to selectively move the right vertical edge of the area based on the road in front of the vehicle.

7. The driver monitoring system of claim 6 wherein the area module is configured to selectively move the right vertical edge of the area in response to one or more lanes joining with a present lane of the vehicle to the right of the present lane of the vehicle.

8. The driver monitoring system of claim 6 wherein the area module is configured to selectively move the right vertical edge of the area when the road in front of the vehicle curves to the right from the perspective of the driver.

9. The driver monitoring system of claim 1 further comprising a boundary module configured to determine boundaries of the road in front of the vehicle,

wherein the area module is configured to determine the area on the vertical plane in front of the driver based on at least one of the boundaries of the road in front of the vehicle.

10. The driver monitoring system of claim 9 wherein the boundary module is configured to determine the boundaries of the road in front of the vehicle from an image of the road in front of the vehicle captured using a camera of the vehicle.

11. The driver monitoring system of claim 9 wherein the area module is configured to move the area on the vertical plane based on at least one of the boundaries of the road in front of the vehicle.

12. The driver monitoring system of claim 9 wherein the area module is configured to adjust the size of the area based on at least one of the boundaries of the road in front of the vehicle.

13. The driver monitoring system of claim 1 further comprising a road module configured to determine a curvature of the road in front of the vehicle based on a present location and a present heading of the vehicle,

wherein the area module is configured to set the area on the vertical plane in front of the driver based on the curvature of the road in front of the vehicle.

14. The driver monitoring system of claim 13 wherein the area module is configured to move the area on the vertical plane based on the curvature of the road in front of the vehicle.

15. A driver monitoring method for a vehicle, comprising:

using a camera, capturing an image of a driver on a driver's seat within a passenger cabin of the vehicle;

determining a gaze vector based on a direction of pupils of the driver in the image;

determining an area on a vertical plane in front of the driver based on a road in front of the vehicle including increasing a size of the area by moving a vertical edge of the area when the road in front of the vehicle curves from the perspective of the driver;

determining a location on the vertical plane where the gaze vector intersects the vertical plane; and

determining whether the location on the vertical plane where the gaze vector intersects the vertical plane is within the area on the vertical plane,

wherein determining the area includes:

when a present lane of the vehicle is to merge with a first one or more lanes to the left of the vehicle, moving a right vertical edge of the vehicle to the left to a right boundary of the right most one of the first one or more lanes; and

when the present lane of the vehicle is to merge with a second one or more lanes to the right of the vehicle, moving a left vertical edge of the vehicle to the right to a left boundary of the left most one of the first one or more lanes.

16. The driver monitoring method of claim 15 wherein determining the area includes moving the area on the vertical plane based on the road in front of the vehicle.

17. The driver monitoring method of claim 15 wherein determining the area includes, based on the road in front of the vehicle, at least one of (a) moving the left vertical edge of the area, (b) moving the right vertical edge of the area, (c) moving an upper edge of the area, and (d) moving a lower edge of the area.

18. The driver monitoring method of claim 15 wherein determining the area includes selectively moving the left vertical edge of the area when the road in front of the vehicle curves to the left from the perspective of the driver.

19. The driver monitoring method of claim 15 wherein determining the area includes selectively moving the right vertical edge of the area when the road in front of the vehicle curves to the right from the perspective of the driver.

20. The driver monitoring method of claim 15 further comprising determining boundaries of the road in front of the vehicle,

wherein determining the area includes determining the area on the vertical plane in front of the driver based on at least one of the boundaries of the road in front of the vehicle.

Assignments (3)
CHANGE OF NAME Recorded Feb 22, 2024
From: VEONEER US, LLC
To: MAGNA ELECTRONICS, LLC
Reel/Frame 066660/0953 →
CHANGE OF NAME Recorded Jun 9, 2022
From: VEONEER US, INC.
To: VEONEER US, LLC
Reel/Frame 060315/0886 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 17, 2022
From: HERBERT, THOMAS JAMES; TOMA, TOM; HERBERTSSON, HANS
To: VEONEER US, INC.
Reel/Frame 058670/0721 →