IP Library › Granted Patent US 11,654,922
Granted Patent B2
US 11,654,922 · App. 17/397,737 · Granted May 23, 2023

Driver attention and hand placement systems and methods

Inventors: Keith Weston (Canton, MI); Michael Alan Mcnees (Flat Rock, MI); Andrew Denis Lewandowski (Sterling Heights, MI); Brendan Diamond (Grosse Pointe, MI); Jordan Barrett (Milford, MI)
Assignee: Ford Global Technologies, LLC
B60W40/08B60W50/14G06T7/13G06V20/597G06V40/107G06V40/28B60W2040/0818B60W2050/146B60W2510/202B60W2540/223B60W2540/225B60W2540/229G06T2207/30268
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,654,922
App. No.
17/397,737
Granted
May 23, 2023
Kind
B2
Abstract

Driver attention and hand placement systems and methods are disclosed herein. An example method includes providing warning messages to a driver of a vehicle based on steering wheel input or hand-wheel contact by the driver. The warning messages are provided according to a first scheme when the steering wheel input is above a threshold value and according to a second scheme when the steering wheel input is below a threshold value and images obtained by a camera in the vehicle indicate that at least one hand of the driver is on the steering wheel.

Claims (39)

1. A method, comprising:

determining a lack of input by a hand of a driver with respect to a steering wheel of a vehicle;

determining a hand position of the hand of the driver relative to the steering wheel of the vehicle using images obtained for an area around the steering wheel, the hand position indicating whether the hand of the driver is or is not contacting the steering wheel; and

selectively reducing a number or periodicity of warning messages when the hand of the driver is determined to be on the steering wheel as compared to the number or periodicity of warning messages that would be presented based only on the lack of input.

2. The method according to claim 1 , wherein determining the lack of input comprises determining a hand-torque value being below a hand-torque threshold.

3. The method according to claim 1 , further comprising evaluating electronic horizon data and position data for the vehicle to determine when the vehicle has maintained a constant heading for a period of time.

4. The method according to claim 1 , further comprising:

determining when the hand of the driver is obscured with a covering; and

compensating for errors in image recognition used to process the images when the covering is determined.

5. The method according to claim 4 , wherein determining when the hand of the driver is obscured with the covering comprises predicting the covering based on contextual information.

6. A method, comprising:

determining warning messages to a driver of a vehicle based on a steering wheel input or hand-wheel contact by the driver on a steering wheel,

wherein the warning messages are presented at (i) a first frequency when the steering wheel input is above a threshold value and (ii) a second frequency when the steering wheel input is below the threshold value and images obtained by a camera in the vehicle indicate that a hand of the driver is on the steering wheel, wherein the second frequency is less than the first frequency.

7. The method according to claim 6 , wherein the steering wheel input comprises a hand-torque value.

8. The method according to claim 6 , further comprising evaluating electronic horizon data and position data for the vehicle to determine when the vehicle has maintained a constant heading for a period of time, wherein the second frequency is used when the vehicle has maintained the constant heading for the period of time.

9. The method according to claim 6 , further comprising:

determining when the hand of the driver is obscured with a covering based on contextual information; and

compensating for errors in image recognition used to process the images when the covering is determined.

10. The method according to claim 6 , further comprising determining from the images the driver is looking straight ahead.

11. The method according to claim 10 , further comprising isolating features and properties of the steering wheel and the hand from the images, along with relative positions of the steering wheel and the hand.

12. The method according to claim 11 , further comprising:

determining dissimilar pixels in the images using edge-detection; and

processing the dissimilar pixels using adaptive thresholding to account for various lighting conditions.

13. The method according to claim 12 , further comprising reapplying the edge-detection to further remove unwanted and unnecessary image information.

14. The method according to claim 13 , further comprising comparing the images to an array of known registered images for hand positions and angles on a control surface to determine when the hand is on the steering wheel.

15. A vehicle, comprising:

a steering wheel input sensor;

a camera;

an advanced driver assistance system comprising a processor and memory, the processor executing instructions to:

determine a lack of input by a hand of a driver with respect to a steering wheel of the vehicle based on signals received from the steering wheel input sensor, wherein a warning message is presented to the driver when the lack of input occurs for a period of time;

determine a hand position of the hand of the driver relative to the steering wheel of the vehicle using images obtained for an area around the steering wheel and from the camera, the hand position indicating whether the hand of the driver is or is not contacting the steering wheel; and

selectively reducing a number or periodicity of warning messages when the hand of the driver is determined to be on the steering wheel as compared to the number or periodicity of warning messages that would be presented based only on the lack of input.

16. The vehicle according to claim 15 , wherein the processor is configured to alter the presentation of the warning message by selectively reducing a number or periodicity of the warning message.

17. The vehicle according to claim 15 , wherein the processor is configured to evaluate electronic horizon data and position data for the vehicle to determine when the vehicle has maintained a constant heading for a period of time.

18. The vehicle according to claim 15 , wherein the processor is configured to:

determining when the hand of the driver is obscured with a covering; and

compensating for errors in image recognition used to process the images when the covering is present.

19. The vehicle according to claim 18 , wherein the processor is configured to predict the covering based on contextual information.

20. The vehicle according to claim 15 , wherein the processor is configured to cause the camera to obtain images of an area around the steering wheel.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2021
From: WESTON, KEITH; MCNEES, MICHAEL ALAN; LEWANDOWSKI, ANDREW DENIS; DIAMOND, BRENDAN; BARRETT, JORDAN
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 057402/0559 →
Continuity (1)
Related Publication 20230041371A1 · Feb 9, 2023
Cited By (1)
US 12,546,896