IP Library Granted Patent US 9,552,069
Granted Patent B2
US 9,552,069 · App. 14/329,875 · Granted Jan 24, 2017

3D gesture recognition

Inventors: Ran Gilad-Bachrach (Bellevue, WA); Dimitrios Lymberopoulos (Redmond, WA); Gerald Reuben DeJean, II (Houston, TX); Eden Alejandro Alanis Reyes (Monterrey, MX); Trang T. Thai (Albany, NY)
Assignee: Microsoft Technology Licensing, LLC
G06F3/017G06F3/041G06F3/046G06F3/0416G06K9/00201G06K9/00335G06F2203/04101
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,552,069
App. No.
14/329,875
Granted
Jan 24, 2017
Kind
B2
Abstract

The description relates to 3D gesture recognition. One example gesture recognition system can include a gesture detection assembly. The gesture detection assembly can include a sensor cell array and a controller that can send signals at different frequencies to individual sensor cells of the sensor cell array. The example gesture recognition system can also include a gesture recognition component that can determine parameters of an object proximate the sensor cell array from responses of the individual sensor cells to the signals at the different frequencies, and can identify a gesture performed by the object using the parameters.

Claims (39)

1. A system, comprising:

a gesture detection assembly including:

a sensor cell array,

a switching network configured to send signals independently to individual sensor cells of the sensor cell array, and

a controller configured to control the switching network to send the signals at different frequencies to the individual sensor cells of the sensor cell array; and

a gesture recognition component configured to:

determine parameters of an object proximate the sensor cell array from responses of the individual sensor cells to the signals sent at the different frequencies, and

identify a gesture performed by the object using the parameters.

2. The system of claim 1 , wherein the individual sensor cells are near-field proximity sensors.

3. The system of claim 1 , wherein the object is a human body part and the parameters include measurements of a position and a distance of the human body part relative to the sensor cell array over a duration of time.

4. The system of claim 1 , wherein the switching network comprises switches for directing the signals from a single source to any of multiple individual sensors of the sensor cell array.

5. The system of claim 4 , wherein the switching network is a multilayer switching network.

6. The system of claim 1 , wherein the controller is further configured to multiplex the sensor cell array using the switching network.

7. The system of claim 6 , wherein the controller is further configured to multiplex the sensor cell array by sequentially sending a first signal at a first frequency to multiple individual sensor cells before sending a second signal at a second frequency to the sensor cell array.

8. The system of claim 7 , wherein the second signal at the second frequency is sent to the multiple individual sensor cells or sent to a different subset of individual sensor cells than the first signal.

9. The system of claim 1 , wherein the responses to the signals are created in part due to a water content of the object.

10. A computer readable memory device or storage device storing computer readable instructions that, when executed by one or more processing devices, cause the one or more processing devices to perform acts comprising:

driving first individual sensor cells of a sensor cell array with first signals at a first frequency from a set of available frequencies;

receiving, from the first individual sensor cells, first responses to the first signals sent at the first frequency;

driving second individual sensor cells of the sensor cell array with second signals at a second frequency from the set of available frequencies;

receiving, from the second individual sensor cells, second responses to the second signals sent at the second frequency; and

identifying a gesture from the first and second responses.

11. The computer readable memory device or storage device of claim 10 , wherein the first frequency and the second frequency are selected based at least on training data from a device that includes the sensor cell array or from a different device that includes a different sensor cell array, and wherein the acts further comprise repeating the driving and receiving for additional frequencies from the set of available frequencies.

12. The computer readable memory device or storage device of claim 11 , wherein the training data are collected for an object at multiple positions relative to the sensor cell array or the different sensor cell array, or wherein at least a portion of the training data is obtained from a user performing the gesture.

13. The computer readable memory device or storage device of claim 10 , wherein the identifying the gesture comprises detecting an object that is performing the gesture.

14. The computer readable memory device or storage device of claim 13 , wherein the detecting the object comprises determining a distance and a position of the object relative to the sensor cell array.

15. The computer readable memory device or storage device of claim 14 , wherein the identifying the gesture further comprises detecting the object multiple times over a duration of time.

16. A system, comprising:

a sensor cell array;

a switching network configured to send signals independently to sensor cells of the sensor cell array; and

a controller configured to:

select a first frequency for a first signal,

identify an individual sensor cell of the sensor cell array to send the first signal at the first frequency,

control the switching network to send the first signal at the first frequency to the individual sensor cell before controlling the switching network to send a second signal at a second frequency to the individual sensor cell or another individual sensor cell of the sensor cell array, and

receive, from the individual sensor cell, a response to the first signal sent at the first frequency.

17. The system of claim 16 , further comprising a gesture recognition component configured to identify a gesture using the response and additional responses received from additional sensor cells of the sensor cell array.

18. The system of claim 17 , wherein the gesture recognition component is further configured to identify the gesture using the additional responses from the second signal sent at the second frequency to the individual sensor cell and the another individual sensor cell.

19. The system of claim 17 , wherein the gesture recognition component is further configured to identify the gesture using a frequency response mapping table.

20. The system of claim 16 , wherein the controller is further configured to select the second frequency based at least in part on the response to the first signal sent at the first frequency.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2015
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 039025/0454 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2014
From: GILAD-BACHRACH, RAN; LYMBEROPOULOS, DIMITRIOS; DEJEAN, GERALD REUBEN; ALANIS REYES, EDEN ALEJANDRO; THAI, TRANG T.
To: MICROSOFT CORPORATION
Reel/Frame 033300/0748 →
Continuity (1)
Related Publication 20160011668A1 · Jan 14, 2016