IP Library › Granted Patent US 12,741,609
Granted Patent B2
US 12,741,609 · App. 19/225,176 · Granted Sep 22, 2026

Gesture-based vehicle entry system with virtual keypad

Inventors: Keith Weston (Canton, MI); Andrew Brown (Royal Oak, MI); Stuart C. Salter (White Lake, MI); John R. Van Wiemeersch (Novi, MI)
B60R25/2045B60K35/28G06F3/017
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,741,609
App. No.
19/225,176
Granted
Sep 22, 2026
Kind
B2
Abstract

Access to a vehicle is controlled by detecting gestures pointing to a virtual keypad. A setup mode preconfigures a sequence of touchpoints as a security key, wherein an administrant performs a timed series of distinct gestures according to a chosen number and location of touchpoints which are detected by the vehicle using captured real-time images. Touchpoints during a plurality of repetition trials provide respective sets of datapoints for each one of the distinct gestures in the series. A respective deviation contour is determined for each respective set and then expanded to represent regions of validity for respective touchpoints corresponding to the sequence of touchpoints. The expanded deviation contours are accepted as defining the sequence of touchpoints for the security key if there is no overlap between any expanded deviation contours to complete the setup mode.

Claims (40)

1 . A vehicle entry system for a vehicle, comprising:

an image sensor configured to capture real-time images according to a predetermined field of view from the vehicle;

a lockout device configured to selectably provide access to the vehicle; and

a controller configured to track a plurality of touching gestures of a user outside the vehicle to identify a sequence of touchpoints which encode a security key and to operate the lockout device to provide the access when the user validly performs the sequence of touchpoints which encode the security key, wherein the controller is adapted to preconfigure the sequence of touchpoints in a setup mode in which the controller:

(A) detects an initial performance by an administrant of a timed series of distinct gestures according to touchpoints on a surface on or near the vehicle;

(B) prompts the administrant for a plurality of repetition trials of the series of distinct gestures;

(C) detects respective touchpoints during the repetition trials to provide a population of data to identify a contour of distinct gestures in the series to encode the security key;

(D) triggers an unlock operation when the user performs touching gestures outside the vehicle; and

(E) operates the lockout device to provide the access when the user validly performs the sequence of touchpoints according to the contour which encodes the security key.

2 . The vehicle entry system of claim 1 wherein the controller in the setup mode determines a respective deviation contour for each respective set according to a respective expected value for each respective set.

3 . The vehicle entry system of claim 2 wherein each respective expected value is comprised of a respective arithmetic mean value for each respective set.

4 . The vehicle entry system of claim 3 wherein each respective deviation contour is comprised of a standard deviation contour around the respective arithmetic mean value.

5 . The vehicle entry system of claim 4 wherein the controller in the setup mode expands the respective standard deviation contours by multiplying respective standard deviations by a predetermined factor in a range from 1.5 to 3.5.

6 . The vehicle entry system of claim 4 wherein the controller in the setup mode expands the respective standard deviation contours by multiplying respective standard deviations by a predetermined factor in a range from 2 to 3.

7 . The vehicle entry system of claim 3 wherein each respective deviation contour is comprised of a respective region around the respective arithmetic mean value with a diameter according to a maximum deviation in each respective set of datapoints from the respective arithmetic mean value.

8 . The vehicle entry system of claim 1 further comprising a decal applied to the surface of the vehicle within the predetermined field of view, wherein the decal includes visible features which the user associates with the sequence of touchpoints.

9 . The vehicle entry system of claim 1 wherein during the initial performance, the controller (1) recognizes one or more nonfinal held gestures which each lasts for a first predetermined detection time at a respective touchpoint, and (2) recognizes a final held gesture which lasts for a second predetermined detection time at a respective touchpoint, wherein the second predetermined detection time is longer than the first predetermined detection time.

10 . The vehicle entry system of claim 1 further comprising a display panel visible in an interior of the vehicle, wherein the controller is configured to activate the display panel in response to a user request after the setup mode to show images depicting the surface and the sequence of touchpoints.

11 . The vehicle entry system of claim 1 further comprising a display panel visible in an interior of the vehicle, wherein the controller is further configured in the setup mode to (i) reject the expanded deviation contours as defining the security key if there is an overlap between any expanded deviation contours, (ii) activate the display panel to show images depicting the overlapping expanded deviation contours, and (iii) prompt the administrant to perform a revised series of distinct gestures to avoid the overlap.

12 . A method for controlling access to a vehicle, wherein the vehicle includes an image sensor configured to capture real-time images according to a predetermined field of view from the vehicle and a lockout device configured to selectably provide access to the vehicle, the method comprising the steps of:

entering a setup mode for preconfiguring a sequence of touchpoints as a security key;

an administrant performing an initial performance of a timed series of distinct gestures according to touchpoints on a surface on or near the vehicle;

identifying the locations of the touchpoints using the captured real-time images;

the administrant performing a plurality of repetition trials of the series of distinct gestures;

identifying the locations of the touchpoints during the repetition trials using the captured real-time images to provide sets with a population of data to identify a contour of distinct gestures in the series;

exiting the setup mode;

triggering an unlock operation when the user performs touching gestures outside the vehicle; and

operating the lockout device to provide the access when the user validly performs the sequence of touchpoints according to the contour which encodes the security key.

13 . The method of claim 12 further comprising the step of determining a respective deviation contour for each respective set by finding a respective expected value for each respective set.

14 . The method of claim 13 wherein each respective expected value is comprised of a respective arithmetic mean value for each respective set.

15 . The method of claim 14 wherein the step of determining each respective deviation contour is comprised of determining a standard deviation contour around the respective arithmetic mean value.

16 . The method of claim 15 wherein the step of expanding the respective standard deviation contours is comprised of multiplying the respective standard deviations by a predetermined factor in a range from 1.5 to 3.5.

17 . The method of claim 15 wherein the step of expanding the respective standard deviation contours is comprised of multiplying the respective standard deviations by a predetermined factor in a range from 2 to 3.

18 . The method of claim 12 wherein the initial performance is comprised of one or more nonfinal held gestures which each lasts for a first predetermined detection time at a respective touchpoint, and a final held gesture which lasts for a second predetermined detection time at a respective touchpoint, wherein the second predetermined detection time is longer than the first predetermined detection time.

19 . The method of claim 12 wherein the vehicle includes a display panel visible in an interior of the vehicle, wherein the method further comprises the step of:

activating the display panel in response to a user request after the setup mode to show images depicting the surface and the sequence of touchpoints.

20 . The method of claim 12 wherein the vehicle includes a display panel visible in an interior of the vehicle, wherein the method further comprises the steps of:

rejecting the expanded deviation contours as defining the security key if there is an overlap between any expanded deviation contours;

activating the display panel to show images depicting the overlapping expanded deviation contours;

prompting the administrant to perform a revised series of distinct gestures to avoid the overlap.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2025
From: WESTON, KEITH; BROWN, ANDREW; SALTER, STUART C.; VAN WIEMEERSCH, JOHN R.
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 071298/0024 →
Continuity (2)
Continuation 18623317 · Apr 1, 2024
Related Publication 20250304004A1 · Oct 2, 2025
References Cited (38)
US 7248151B2 · McCall · 2007 [cited by applicant]
US 8994495B2 · Dassanayake et al. · 2015 [cited by applicant]
US 10421435B2 · Pophale et al. · 2019 [cited by applicant]
US 11661032B2 · Tang · 2023 [cited by applicant]
US 12017612B2 · Tang · 2024 [cited by applicant]
US 12337792B1 · Weston · 2025 [cited by examiner]
US 20060145825A1 · McCall · 2006 [cited by applicant]
US 20110181387A1 · Popelard · 2011 [cited by applicant]
US 20140015637A1 · Dassanayake · 2014 [cited by applicant]
US 20150161836A1 · Park · 2015 [cited by applicant]
US 20150360646A1 · Pribisic · 2015 [cited by applicant]
US 20150363986A1 · Hoyos · 2015 [cited by applicant]
US 20160148487A1 · Thomas · 2016 [cited by applicant]
US 20170018129A1 · Huebner · 2017 [cited by applicant]
US 20170057357A1 · Borghi · 2017 [cited by applicant]
US 20170072908A1 · Liubakka · 2017 [cited by applicant]
US 20170101076A1 · Krishnan · 2017 [cited by applicant]
US 20170139506A1 · Rodriguez · 2017 [cited by applicant]
US 20170349142A1 · Krishnan · 2017 [cited by applicant]
US 20180215345A1 · Elangovan · 2018 [cited by applicant]
US 20180244239A1 · Van Wiemeersch · 2018 [cited by applicant]
US 20180367139A1 · Pribisic · 2018 [cited by applicant]
US 20190005755A1 · Snider · 2019 [cited by applicant]
US 20190126889A1 · Oman · 2019 [cited by applicant]
US 20190143936A1 · Abel Rayan · 2019 [cited by applicant]
US 20190152433A1 · Cumbo · 2019 [cited by applicant]
US 20200070777A1 · Chen · 2020 [cited by applicant]
US 20200219338A1 · Chen · 2020 [cited by applicant]
US 20200233540A1 · Salter · 2020 [cited by applicant]
US 20200234030A1 · Baheti · 2020 [cited by applicant]
US 20200291676A1 · Shah · 2020 [cited by applicant]
US 20220024415A1 · Wu et al. · 2022 [cited by applicant]
US 20220186533A1 · Prince · 2022 [cited by applicant]
US 20230120250A1 · Tang · 2023 [cited by applicant]
US 20230339431A1 · Kuehner · 2023 [cited by applicant]
US 20240166165A1 · Van Wiemeersch · 2024 [cited by applicant]
US 20240345718A1 · Dalla Rosa · 2024 [cited by applicant]
EP 3032502A1 · 2016 [cited by applicant]