IP Library Granted Patent US 9,704,027
Granted Patent B1
US 9,704,027 · App. 13/405,621 · Granted Jul 11, 2017

Gesture recognition

Inventors: Samuel Henry Chang (San Jose, CA); Sowmya Gopalan (Cupertino, CA); Ning Yao (Cupertino, CA); Yuhua Zhu (Fremont, CA)
Assignee: Amazon Technologies, Inc.
G06K9/00355G06T7/20G06K2209/21G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,704,027
App. No.
13/405,621
Granted
Jul 11, 2017
Kind
B1
Abstract

A hand gesture may be characterized mathematically as a set of motion parameters applied to a dynamic motion model. Training may be conducted to compile a library of motion parameter sets corresponding to various gestures. Motion parameters corresponding to observed gestures may than be compared to the library of motion parameter sets to classify the observed gestures.

Claims (44)

1. A system comprising:

one or more processors; and

one or more computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform acts comprising:

analyzing a sequence of motions represented by images, the analyzing based at least in part on Gaussian distribution of positional coordinates associated with the sequence of motions;

determining one or more training sequences based at least in part on the sequence of motions;

determining one or more reference gestures based at least in part on the one or more training sequences;

determining, from an observed gesture made by a hand of a user, a first angular orientation of the hand associated with a first pose of the hand;

determining a second angular orientation of the hand associated with a second pose of the hand;

based at least in part on the first angular orientation of the first pose and the second angular orientation of the second pose of the hand, determining motion parameters of the observed gesture, wherein the motion parameters apply to a dynamic motion model;

analyzing the motion parameters based at least in part on the one or more reference gestures; and

classifying the observed gesture as one of the one or more reference gestures.

2. The system of claim 1 , wherein the dynamic motion model comprises one or more dynamic state equations.

3. The system of claim 1 , wherein determining the motion parameters comprises recursive least squares parameter identification.

4. The system of claim 1 , wherein determining the first pose of the hand and the second pose of the hand are based at least in part on analyzing a reflection of a pattern projected onto the hand.

5. The system of claim 1 , wherein determining the first pose of the hand and the second pose of the hand are based at least in part on a structured pattern reflected from the hand.

6. One or more non-transitory computer-readable media storing computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform acts comprising:

analyzing a sequence of motions represented by images, the analyzing based at least in part on Gaussian distribution of positional coordinates associated with the sequence of motions;

determining one or more training sequences based at least in part on the sequence of motions;

determining one or more reference gestures based at least in part on the one or more training sequences;

observing a hand gesture of a user;

determining motion parameters of the hand gesture of the user, the motion parameters based on at least a change from a first angular orientation of a hand of the user to a second angular orientation of the hand;

analyzing the motion parameters of the hand gesture of the user with reference to the one or more reference gestures; and

associating an action with the hand gesture based at least in part on the one or more reference gestures.

7. The one or more non-transitory computer-readable media of claim 6 , wherein the motion parameters of the hand gesture comprise a dynamic motion model including one or more state equations.

8. The one or more non-transitory computer-readable media of claim 6 , wherein determining the motion parameters comprises recursive least squares parameter identification.

9. The one or more non-transitory computer-readable media of claim 6 , wherein determining the motion parameters of the hand gesture of the user is based at least in part on structured light analysis of a physical environment of the user.

10. A method comprising:

analyzing a sequence of motions represented by images, the analyzing based at least in part on Gaussian distribution of positional coordinates associated with the sequence of motions;

determining one or more training sequences based at least in part on the sequence of motions;

determining one or more reference gestures based at least in part on the one or more training sequences;

determining motion parameters of an observed hand gesture, wherein the motion parameters of the observed hand gesture are based on a change from a first angular orientation of a hand of a user to a second angular orientation of the hand;

analyzing the motion parameters with the one or more reference gestures; and

classifying the observed hand gesture.

11. The method of claim 10 , wherein the motion parameters apply to a dynamic motion model including one or more state equations.

12. The method of claim 10 , wherein determining the motion parameters comprises recursive least squares parameter identification.

13. The method of claim 10 , wherein determining the motion parameters is based at least in part on structured light analysis of a sequence of images.

14. The method of claim 10 , wherein the determining the motion parameters comprises determining the motion parameters using sequential images captured from different perspectives relative to the user.

15. The method of claim 10 , further comprising:

receiving, from one or more microphones, an audio signal representing speech from the user; and

characterizing the speech as a command from the user to perform an action or to initiate attention on the user.

16. The method of claim 10 , further comprising:

receiving, from a portable signaling device, ultrasonic signals from the user; and

characterizing the ultrasonic signals as a command from the user to perform an action or to initiate attention on the user.

17. The method of claim 10 , wherein analyzing the sequence of motions comprises averaging parameters corresponding to the sequence of motions.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2015
From: RAWLES LLC
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 037103/0084 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 18, 2012
From: CHANG, SAMUEL HENRY; GOPALAN, SOWMYA; YAO, NING; ZHU, YUHUA
To: RAWLES LLC
Reel/Frame 028394/0173 →