IP Library › Granted Patent US 11,752,974
Granted Patent B2
US 11,752,974 · App. 17/118,977 · Granted Sep 12, 2023

Systems and methods for head position interpolation for user tracking

Inventors: Ali Hassani (Ann Arbor, MI); Ryan Hanson (Livonia, MI); Lawrence Chikeziri Amadi (Chicago, IL)
Assignee: Ford Global Technologies, LLC
B60R25/25G06V40/169G06V40/172G07C9/00563
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,752,974
App. No.
17/118,977
Granted
Sep 12, 2023
Kind
B2
Abstract

A method for maintaining tracking using non-identifiable biometrics includes determining, via a computer vision system, an identity of a user using a set of facial features, associating the set of facial features with a head and a secondary human landmark that does not include the set of facial features, and determining that the set of facial features is unlocatable by a computer vision system. The method includes tracking the user, via the computer vision system, using the head and the secondary human landmark.

Claims (77)

1. A method for maintaining user movement tracking using non-identifiable biometrics, comprising:

determining, via a computer vision system, an identity of a user using a set of facial features, wherein determining the identity of the user comprises:

storing, in a computer memory, a last sampled image comprising the set of facial features; and

updating, with the last sampled image, a human landmark tracking index comprising:

a user identification (ID) indicative of the identity of the user;

a frame location for the set of facial features in the last sampled image; and

a frame location for a secondary human landmark;

associating the set of facial features with a head and the secondary human landmark that does not include the set of facial features;

determining that the set of facial features is unlocatable by the computer vision system; and

tracking the user, via the computer vision system, using the head and the secondary human landmark that does not include the set of facial features.

2. The method according to claim 1 , further comprising:

activating a vehicle welcome message based on a location of the secondary human landmark in an image frame.

3. The method according to claim 1 , further comprising:

determining that the set of facial features is locatable by the computer vision system;

reauthenticating the identity of the user using the set of facial features; and

providing entry to a vehicle responsive to the reauthentication.

4. The method according to claim 1 , further comprising:

determining a gait of the user; and

triggering a vehicle lock disposed on a vehicle to actuate to a locked state or an unlocked state based on the gait.

5. The method according to claim 4 , further comprising:

determining, based on the gait, that the user is walking away from the vehicle; and

responsive to determining that the user is walking away from the vehicle based on the gait, triggering the vehicle lock to actuate to the locked state.

6. The method according to claim 1 , wherein determining the identity of the user using the set of facial features further comprises face tracking by searching only a local region of interest by downsampling.

7. The method according to claim 1 , wherein the secondary human landmark comprises at least one of:

a visible body part other than the head;

an item of clothing;

a mark on the item of clothing; or

a package carried by the user.

8. A biometric recognition module, comprising:

a computer vision system;

a processor disposed in communication with the computer vision system; and

a memory for storing executable instructions, the processor programmed to execute the instructions to:

determine an identity of a user using a set of facial features, wherein the determination of the identity of the user using the set of facial features comprises:

storing, in a computer memory, a last sampled image comprising the set of facial features; and

update, with the last sampled image, a human landmark tracking index comprising:

a user identification (ID) indicative of the identity of the user;

a frame location for the set of facial features in the last sampled image; and

a frame location for a secondary human landmark;

associate the set of facial features with a head and the secondary human landmark that does not include the set of facial features;

determine that the set of facial features is unlocatable by the computer vision system; and

track the user, via the computer vision system, using the head and the secondary human landmark that does not include the set of facial features.

9. The biometric recognition module according to claim 8 , wherein the processor is further programmed to execute the instructions to:

activate a vehicle welcome message based on a location of the secondary human landmark in an image frame.

10. The biometric recognition module according to claim 8 , wherein the processor is further programmed to execute the instructions to:

determine that the set of facial features is locatable by the computer vision system;

reauthenticate the identity of the user using the set of facial features; and

provide entry to a vehicle responsive to the reauthentication.

11. The biometric recognition module according to claim 8 , wherein the processor is further programmed to execute the instructions to:

determine a gait of the user; and

trigger a vehicle lock disposed on a vehicle to actuate to a locked state or an unlocked state based on the gait.

12. The biometric recognition module according to claim 11 , wherein the processor is further programmed to execute the instructions to:

determine, based on the gait, that the user is walking away from the vehicle; and

responsive to determining that the user is walking away from the vehicle based on the gait, trigger the vehicle lock to actuate to the locked state.

13. The biometric recognition module according to claim 8 , wherein the secondary human landmark comprises at least one of:

a visible body part other than the head;

an item of clothing;

a mark on the item of clothing; or

a package carried by the user.

14. A non-transitory computer-readable storage medium in a vehicle controller, the computer-readable storage medium having instructions stored thereupon which, when executed by a processor, cause the processor to:

determine an identity of a user using a set of facial features;

store, in a computer memory, a last sampled image comprising the set of facial features; and

update, with the last sampled image, a human landmark tracking index comprising:

a user identification (ID) indicative of the identity of the user;

a frame location for the set of facial features in the last sampled image; and

a frame location for a secondary human landmark;

associate the set of facial features with a head and a secondary human landmark that does not include the set of facial features;

determine that the set of facial features is unlocatable by a computer vision system; and

track the user, via the computer vision system, using the head and the secondary human landmark that does not include the set of facial features.

15. The non-transitory computer-readable storage medium according to claim 14 , having further instructions stored thereupon to:

activate a vehicle welcome message based on a location of the secondary human landmark in an image frame.

16. The non-transitory computer-readable storage medium according to claim 14 , having further instructions stored thereupon to:

determine the set of facial features is locatable by the computer vision system;

reauthenticate the identity of the user using the set of facial features; and

provide entry to a vehicle responsive to the reauthentication.

17. The non-transitory computer-readable storage medium according to claim 14 , having further instructions stored thereupon to:

determine a gait of the user; and

trigger a vehicle lock to actuate to a locked state or an unlocked state based on the gait.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 11, 2020
From: HASSANI, ALI; HANSON, RYAN; AMADI, LAWRENCE CHIKEZIRI
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 054616/0961 →
Continuity (1)
Related Publication 20220185233A1 · Jun 16, 2022
Cited By (1)
US 12,686,361