IP Library Granted Patent US 9,841,813
Granted Patent B2
US 9,841,813 · App. 14/977,874 · Granted Dec 12, 2017

Automated vehicle human-machine interface system based on glance-direction

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,841,813
App. No.
14/977,874
Granted
Dec 12, 2017
Kind
B2
Abstract

A human-machine interface (HMI) system used to indicate a vehicle-feature based on glance-direction of an occupant of the vehicle includes a camera and a controller. The camera is used to capture a sequence-of-images of an occupant of a vehicle. The controller is configured to determine a plurality of glance-directions from the sequence-of-images, define a plurality of glance-zones based on the plurality of glance-directions, one glance-zone for each glance-direction, define an intersection-zone based on an intersection of two or more of the glance-zones, determine an outlier-count based on how many of the plurality of glance-zones do not intersect with the intersection-zone, and select a vehicle-feature in the vehicle indicated by the occupant, said vehicle-feature located at a location inside the vehicle that corresponds to the intersection-zone, said vehicle-feature indicated by the operator when the outlier-count during the pause-interval is less than a paused-threshold.

Claims (14)

1. A human-machine interface system suitable for use in an automated vehicle, said system used to indicate a vehicle-feature based on glance-direction, said system comprising:

a camera used to capture a sequence-of-images of an occupant of a vehicle; and a controller in communication with the camera, said controller configured to determine a plurality of glance-directions from the sequence-of-images received by the controller during a pause-interval, one glance-direction for each image, define a plurality of glance-zones based on the plurality of glance-directions, one glance-zone for each glance-direction,

define an intersection-zone based on where two or more of the plurality of glance-zones intersect,

determine an outlier-count based on how many of the plurality of glance-zones do not intersect with the intersection-zone, and

select a vehicle-feature in the vehicle indicated by the occupant, said vehicle-feature located at a location inside the vehicle that corresponds to the intersection-zone, said vehicle-feature indicated by the operator when the outlier-count during the pause-interval is less than how many of the plurality of glance-zones do intersect with the intersection-zone.

2. The system in accordance with claim 1 , wherein the controller is configured to maintain the vehicle-feature indicated by the occupant at a selected-status when subsequent-images indicate the glance-direction is characterized as outside the vehicle.

3. The system in accordance with claim 1 , wherein the controller is configured to maintain the vehicle-feature indicated by the occupant at a selected-status until subsequent-images indicate the another vehicle-feature has been selected.

4. The system in accordance with claim 1 , wherein the controller is configured to release the vehicle-feature indicated by the occupant when the outlier-count during the pause-interval is greater than a moved-threshold.

5. The system in accordance with claim 1 , wherein the controller is configured to determine an average-velocity of the plurality of glance-directions from the sequence-of-images received by the controller during a movement-interval, and release the vehicle-feature indicated by the occupant when the average-velocity during the movement-interval is greater than a velocity-threshold.

6. The system in accordance with claim 5 , wherein the controller is configured to determine an instantaneous-velocity for each of the plurality of glance-directions during the movement-interval, and exclude any instantaneous-velocity greater than a maximum-velocity from the average-velocity.

7. The system in accordance with claim 5 , wherein the movement-interval is less than the pause-interval.

8. The system in accordance with claim 1 , wherein the system includes

a display positioned to be viewable by the occupant, the vehicle-feature is an icon displayed by the display, and the controller is configured to determine that the icon is indicated by the occupant when the location corresponds to the icon.

9. The system in accordance with claim 8 , wherein the controller is configured to highlight the icon indicated by the occupant.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2024
From: APTIV MANUFACTURING MANAGEMENT SERVICES S.À R.L.
To: APTIV TECHNOLOGIES AG
Reel/Frame 066551/0219 →
MERGER Recorded Feb 11, 2024
From: APTIV TECHNOLOGIES (2) S.À R.L.
To: APTIV MANUFACTURING MANAGEMENT SERVICES S.À R.L.
Reel/Frame 066566/0173 →
ENTITY CONVERSION Recorded Feb 11, 2024
From: APTIV TECHNOLOGIES LIMITED
To: APTIV TECHNOLOGIES (2) S.À R.L.
Reel/Frame 066746/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2018
From: DELPHI TECHNOLOGIES INC.
To: APTIV TECHNOLOGIES LIMITED
Reel/Frame 047143/0874 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2015
From: SRAIL, DOUGLAS A.
To: DELPHI TECHNOLOGIES, INC.
Reel/Frame 037347/0729 →