IP Library Granted Patent US 9,323,985
Granted Patent B2
US 9,323,985 · App. 13/967,314 · Granted Apr 26, 2016

Automatic gesture recognition for a sensor system

Inventors: Axel Heim (Munich, DE); Eugen Roth (Munich, DE); Roland Aubauer (Wessling, DE)
Assignee: MICROCHIP TECHNOLOGY INCORPORATED
G06K9/00335G06F3/017G06F3/04883
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,323,985
App. No.
13/967,314
Granted
Apr 26, 2016
Kind
B2
Abstract

A method for gesture recognition including detecting one or more gesture-related signals using the associated plurality of detection sensors; and evaluating a gesture detected from the one or more gesture-related signals using an automatic recognition technique to determine if the gesture corresponds to one of a predetermined set of gestures.

Claims (31)

1. A method for touchless gesture recognition comprising:

detecting one or more gesture-related signals using an associated plurality of detection sensors; and

evaluating the touchless gesture detected from the one or more gesture-related signals using an automatic recognition technique to determine if the touchless gesture corresponds to one of a predetermined set of gestures, wherein in determining a start of the gesture, a start is determined if the distance between the target object and at least one sensor decreases and the distance between the target object and at least another sensor increases, and a short term variance or an equivalent measure over a predetermined plurality of signal samples is less than a threshold.

2. A method in accordance with claim 1 , wherein evaluating the gesture includes determining a stop of a gesture.

3. A method in accordance with claim 1 , wherein a stop of a the gesture is determined if at a given time the distances between the target object and all sensors decrease, and/or a short term variance or an equivalent measure over a predetermined plurality of signal samples is less than a threshold, and/or the signal changes are less than a predetermined threshold for a predetermined plurality of signal samples after the given time.

4. A method in accordance with claim 1 , wherein each gesture is represented by one or more Hidden Markov Models (HMM).

5. A method in accordance with claim 4 , wherein evaluating a gesture includes evaluating probability measures for one or more HMMs.

6. A method in accordance with claim 4 , wherein features to which observation matrices of the one or more HMMs are associated are non-quantized or quantized sensor signal levels, x/y/z position, distances, direction, orientation, angles and/or 1 st , 2 nd or higher order derivatives of these with respect to time, or any combination thereof.

7. A method in accordance with claim 4 , wherein features to which observation matrices of the one or more HMMs are associated are the 1 st derivatives of sensor signal levels quantized to two quantization levels.

8. A method in accordance with claim 5 , wherein for each new signal sample or feature, the probability of each Hidden Markov Model is updated.

9. A method in accordance with claim 8 , wherein if the probability of a Hidden Markov Model exceeds a pre-defined threshold, the recognition is stopped.

10. A system for gesture recognition using an alternating electric field generated by a sensor arrangement and associated detection electrodes, wherein a gesture is performed without touching a surface, wherein electrode signals are evaluated using Hidden Markov Models, wherein start and stop criteria for determination of a gesture are determined, and wherein feature sequences used to evaluate the Hidden Markov Models' probabilities are the 1 st derivatives of sensor signal levels quantized to two quantization levels.

11. A system for gesture recognition comprising: a sensor arrangement for detecting one or more gesture-related signals using an associated plurality of detection sensors; and a module for evaluating a touchless gesture detected from the one or more gesture-related signals using an automatic recognition technique to determine if the gesture corresponds to one of a predetermined set of gestures, wherein a start of the gesture is determined if the distance between the target object and at least one sensor decreases and the distance between the target object and at least one sensor increases and a short term variance or an equivalent measure over a predetermined plurality of signal samples is less than a threshold.

12. A system in accordance with claim 11 , wherein a stop of the gesture is determined if at a given time, the distances between the target object and all sensors decrease and/or a short term variance or an equivalent measure over a predetermined plurality of signal samples is less than a threshold, and/or the signal changes are less than a predetermined threshold for a predetermined plurality of signal samples after the given time.

13. A system in accordance with claim 11 , wherein each gesture is represented by one or more Hidden Markov Models.

14. A system in accordance with claim 13 , wherein evaluating a gesture includes evaluating probability measures for one or more Hidden Markov Models.

15. A system in accordance with claim 13 , wherein the features to which observation matrices of the one or more HMMs are associated are non-quantized or quantized sensor signal levels, x/y/z position, distances, direction, orientation, angles and/or 1 st , 2 nd or higher order derivatives of these with respect to time, or any combination thereof.

16. A system in accordance with claim 13 , wherein the features are the 1 st derivatives of the sensor signal levels quantized to two quantization levels.

17. A system in accordance with claim 14 , wherein for each new signal sample or feature, the probability of each Hidden Markov Model is updated.

18. A system in accordance with claim 17 , wherein if the probability of a Hidden Markov Model exceeds a pre-defined threshold, the recognition is stopped.

19. A computer readable medium including one or more non-transitory machine readable program instructions for receiving one or more gesture-related signals using a plurality of detection sensors; and evaluating a touchless gesture detected from the one or more gesture-related signals using an automatic recognition technique to determine if the gesture corresponds to one of a predetermined set of gestures, wherein a start of a gesture is determined if the distance between the target object and at least one sensor decreases and the distance between the target object and at least one other sensor increases, and a short term variance or an equivalent measure over a predetermined plurality of signal samples is less than a threshold.

20. A computer readable medium in accordance with claim 19 , wherein a stop of the gesture is determined if at a given time, the distances between the target object and all sensors decrease and/or a short term variance or an equivalent measure over a predetermined plurality of signal samples is less than a threshold, and/or the signal changes are less than a predetermined threshold for a predetermined plurality of signal samples after the given time.

21. A computer readable medium in accordance with claim 19 , wherein each gesture is represented by one or more Hidden Markov Models (HMM).

22. A computer readable medium in accordance with claim 21 , wherein evaluating a gesture includes evaluating a probability measure for one or more HMMs.

23. A computer readable medium in accordance with claim 21 , wherein features to which observation matrices of the one or more HMMs are associated are non-quantized or quantized sensor signal levels, x/y/z position, distances, direction, orientation, angles and/or 1 st , 2 nd or higher order derivatives of these with respect to time, or any combination thereof.

24. A computer readable medium in accordance with claim 21 , wherein the features are the 1 st derivatives of the sensor signal levels quantized to two quantization levels.

25. A computer readable medium in accordance with claim 22 , wherein for each new signal sample or feature, the probability of each Hidden Markov Model is updated.

26. A computer readable medium in accordance with claim 25 , wherein if the probability of Hidden Markov Model exceeds a pre-defined threshold, the recognition is stopped.

27. A system for gesture recognition comprising:

a sensor arrangement for detecting one or more gesture-related signals using an associated plurality of detection sensors; and

a module for evaluating a touchless gesture detected from the one or more gesture-related signals using an automatic recognition technique to determine if the gesture corresponds to one of a predetermined set of gestures, wherein each gesture is represented by one or more Hidden Markov Models, and wherein features to which observation matrices of the one or more HMMs are associated are the 1 st derivatives of sensor signal levels quantized to two quantization levels.

Assignments (17)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2026
From: MICROCHIP TECHNOLOGY INCORPORATED; MICROCHIP TECHNOLOGY IRELAND LIMITED; MICROSEMI SOC CORPORATION; ATMEL CORPORATION; SILICON STORAGE TECHNOLOGY, INC.; MICROCHIP TECHNOLOGY GERMANY GMBH
To: CRESTONE IP MANAGEMENT, LLC
Reel/Frame 075979/0008 →
RELEASE OF SECURITY INTEREST Recorded Mar 14, 2022
From: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: MICROCHIP TECHNOLOGY INCORPORATED; SILICON STORAGE TECHNOLOGY, INC.; ATMEL CORPORATION; MICROSEMI CORPORATION; MICROSEMI STORAGE SOLUTIONS, INC.
Reel/Frame 060894/0437 →
RELEASE OF SECURITY INTEREST Recorded Mar 11, 2022
From: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: MICROCHIP TECHNOLOGY INCORPORATED; SILICON STORAGE TECHNOLOGY, INC.; ATMEL CORPORATION; MICROSEMI CORPORATION; MICROSEMI STORAGE SOLUTIONS, INC.
Reel/Frame 059363/0001 →
RELEASE OF SECURITY INTEREST Recorded Mar 10, 2022
From: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: MICROCHIP TECHNOLOGY INCORPORATED; SILICON STORAGE TECHNOLOGY, INC.; ATMEL CORPORATION; MICROSEMI CORPORATION; MICROSEMI STORAGE SOLUTIONS, INC.
Reel/Frame 059863/0400 →
RELEASE OF SECURITY INTEREST Recorded Mar 9, 2022
From: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: MICROCHIP TECHNOLOGY INCORPORATED; SILICON STORAGE TECHNOLOGY, INC.; ATMEL CORPORATION; MICROSEMI CORPORATION; MICROSEMI STORAGE SOLUTIONS, INC.
Reel/Frame 059358/0001 →
RELEASE OF SECURITY INTEREST Recorded Feb 28, 2022
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: MICROCHIP TECHNOLOGY INCORPORATED
Reel/Frame 059666/0545 →
RELEASE OF SECURITY INTEREST Recorded Feb 25, 2022
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: MICROCHIP TECHNOLOGY INCORPORATED; SILICON STORAGE TECHNOLOGY, INC.; ATMEL CORPORATION; MICROSEMI CORPORATION; MICROSEMI STORAGE SOLUTIONS, INC.
Reel/Frame 059333/0222 →
SECURITY INTEREST Recorded Jun 4, 2021
From: MICROCHIP TECHNOLOGY INCORPORATED; SILICON STORAGE TECHNOLOGY, INC.; ATMEL CORPORATION; MICROSEMI CORPORATION; MICROSEMI STORAGE SOLUTIONS, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 057935/0474 →
SECURITY INTEREST Recorded Dec 24, 2020
From: MICROCHIP TECHNOLOGY INCORPORATED; SILICON STORAGE TECHNOLOGY, INC.; ATMEL CORPORATION; MICROSEMI CORPORATION; MICROSEMI STORAGE SOLUTIONS, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 055671/0612 →
SECURITY INTEREST Recorded Jun 5, 2020
From: MICROCHIP TECHNOLOGY INC.; SILICON STORAGE TECHNOLOGY, INC.; ATMEL CORPORATION; MICROSEMI CORPORATION; MICROSEMI STORAGE SOLUTIONS, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 053468/0705 →
RELEASE OF SECURITY INTEREST Recorded May 30, 2020
From: JPMORGAN CHASE BANK, N.A, AS ADMINISTRATIVE AGENT
To: MICROCHIP TECHNOLOGY INC.; SILICON STORAGE TECHNOLOGY, INC.; ATMEL CORPORATION; MICROSEMI CORPORATION; MICROSEMI STORAGE SOLUTIONS, INC.
Reel/Frame 053466/0011 →
SECURITY INTEREST Recorded Apr 24, 2020
From: MICROCHIP TECHNOLOGY INC.; SILICON STORAGE TECHNOLOGY, INC.; ATMEL CORPORATION; MICROSEMI CORPORATION; MICROSEMI STORAGE SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 053311/0305 →
SECURITY INTEREST Recorded Sep 18, 2018
From: MICROCHIP TECHNOLOGY INCORPORATED; SILICON STORAGE TECHNOLOGY, INC.; ATMEL CORPORATION; MICROSEMI CORPORATION; MICROSEMI STORAGE SOLUTIONS, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 047103/0206 →
SECURITY INTEREST Recorded Jun 25, 2018
From: MICROCHIP TECHNOLOGY INCORPORATED; SILICON STORAGE TECHNOLOGY, INC.; ATMEL CORPORATION; MICROSEMI CORPORATION; MICROSEMI STORAGE SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 046426/0001 →
SECURITY INTEREST Recorded Feb 10, 2017
From: MICROCHIP TECHNOLOGY INCORPORATED
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 041675/0617 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2016
From: HEIM, AXEL; ROTH, EUGEN; AUBAUER, ROLAND
To: MICROCHIP TECHNOLOGY GERMANY GMBH
Reel/Frame 039559/0926 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2016
From: HEIM, AXEL; ROTH, EUGEN; AUBAUER, ROLAND
To: MICROCHIP TECHNOLOGY INCORPORATED
Reel/Frame 038617/0793 →
Continuity (2)
Provisional Application 61684039 · Aug 16, 2012
Related Publication 20140050354A1 · Feb 20, 2014