IP Library Granted Patent US 8,631,355
Granted Patent B2
US 8,631,355 · App. 12/684,518 · Granted Jan 14, 2014

Assigning gesture dictionaries

Inventors: Oscar E. Murillo (Redmond, WA); Andy Wilson (Seattle, WA); Alex A. Kipman (Duvall, WA); Janet Galore (Seattle, WA)
Assignee: Microsoft Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,631,355
App. No.
12/684,518
Granted
Jan 14, 2014
Kind
B2
Abstract

Techniques for assigning a gesture dictionary in a gesture-based system to a user comprise capturing data representative of a user in a physical space. In a gesture-based system, gestures may control aspects of a computing environment or application, where the gestures may be derived from a user's position or movement in a physical space. In an example embodiment, the system may monitor a user's gestures and select a particular gesture dictionary in response to the manner in which the user performs the gestures. The gesture dictionary may be assigned in real time with respect to the capture of the data representative of a user's gesture. The system may generate calibration tests for assigning a gesture dictionary. The system may track the user during a set of short gesture calibration tests and assign the gesture dictionary based on a compilation of the data captured that represents the user's gestures.

Claims (55)

1. A method for assigning a gesture dictionary, the method comprising:

receiving data representative of a user in a physical space;

processing the received data to identify a first motion or pose by the user that invokes an input command to a computer;

correlating the first motion or pose to a first gesture dictionary of a plurality of gesture dictionaries, each gesture dictionary of the plurality of gesture dictionaries comprising a set of input commands to the computer that may be invoked by motions or poses of the user reflected in the received data; and

assigning the first gesture dictionary to the user, the first gesture dictionary corresponding to the first motion or pose; and

processing additional captured data with the first gesture dictionary to identify whether a second motion or pose by the user in the additional captured data invokes an input command to the computer.

2. The method of claim 1 , further comprising requesting explicit gesture feedback from the user via instructions to the user to perform a gesture.

3. The method of claim 2 , wherein the instructions comprise a display of a command and a request to the user to perform the gesture that corresponds to the command.

4. The method of claim 1 , further comprising passively tracking the user and compiling captured data for processing to identify additional motions or poses by the user.

5. The method of claim 4 , further comprising manipulating circumstances of an output to the user to elicit particular input gesture data.

6. The method of claim 1 , wherein correlating the first motion or pose to at least one of the plurality of gesture dictionaries comprises correlating the first motion or pose to a cluster of gesture dictionaries.

7. The method of claim 1 , wherein the user is a first user and correlating the first motion or pose to the at least one of the plurality of gesture dictionaries comprises:

correlating the first motion or pose of the first user to an input gesture data of a second user, and assigning a gesture dictionary assigned to the second user to the first user.

8. The method of claim 1 , wherein the at least one of the plurality of gesture dictionaries is associated an identifier, wherein the identifier identifies when to implement the at least one of the plurality of gesture dictionaries.

9. The method of claim 8 , wherein the identifier is at least one of an operating system, an application, a user, a feature of a user, a location, a type of application, a hardware configuration, a software configuration, a culture, current user, geography, demography, linguistic, culture, or a style.

10. The method of claim 1 , wherein the gesture dictionary is assigned to the user in real time upon capturing the data representative of the user.

11. The method of claim 1 , the method further comprising:

compiling captured data representative of the user;

identifying at least one identifier associated with the user;

correlating the at least one identifier to the plurality of gesture dictionaries;

assigning a portion of each of the plurality of gesture dictionaries correlating to the identifier to the user, such that a combination of data from each of the plurality of gesture dictionaries is assigned to the user.

12. The method of claim 1 , further comprising:

identifying a level of failure of the first motion or pose to correspond to data in the gesture dictionary, and

providing instructional feedback to the user.

13. A system for assigning a gesture dictionary, the system comprising:

a memory communicatively coupled to a processor when the system is operational, the memory bearing processor-executable instructions that, when executed on the processor, cause the system: at least to:

receive data representative of a user in a physical space;

process the received data to identify a first motion or pose by the user that invokes an input command to a computer;

correlate the first motion or pose to a first gesture dictionary of a plurality of gesture dictionaries, each gesture dictionary of the plurality of gesture dictionaries comprising a set of input commands to the computer that may be invoked by motions or poses of the user reflected in the received data; and

assign the at least one of the plurality of gesture dictionaries to the user, the gesture dictionary corresponding to the first motion or pose; and

process additional captured data with the first gesture dictionary to identify whether a second motion or pose by the user in the additional captured data invokes an input command to the computer.

14. The system of claim 13 , wherein the memory further bears processor-executable instructions that, when executed on the processor, cause the system: at least to:

request explicit gesture feedback from the user via instructions to the user to perform a gesture.

15. The system of claim 14 , wherein the memory further bears processor-executable instructions that, when executed on the processor, cause the system: at least to:

display a command on a display device and a request to the user to perform the gesture that corresponds to the command.

16. The system of claim 13 , wherein the memory further bears processor-executable instructions that, when executed on the processor, cause the system at least to:

passively tracking the user and compiling captured data for processing to identify additional motions or poses by the user.

17. A computer-readable storage device bearing computer-executable instructions that, when executed on a computer, cause the computer to perform operations comprising:

receiving data representative of a user in a physical space;

processing the received data to identify a first motion or pose by the user that invokes an input command to the computer;

correlating the first motion or pose to a first gesture dictionary of a plurality of gesture dictionaries, each gesture dictionary of the plurality of gesture dictionaries comprising a set of input commands to the computer that may be invoked by motions or poses of the user reflected in the received data; and

assigning the first gesture dictionary to the user, the first gesture dictionary corresponding to the first motion or pose; and

processing additional captured data with the first gesture dictionary to identify whether a second motion or pose by the user in the additional captured data invokes an input command to the computer.

18. The computer-readable storage device of claim 17 , wherein correlating the first motion or pose to the first gesture dictionary comprises:

determining whether the user is left-handed or right-handed; and

wherein assigning the first gesture dictionary to the user comprises: assigning the first gesture dictionary to the user based on whether the user is left-handed or right-handed.

19. The computer-readable storage device of claim 17 , wherein capturing data representative of the user in the physical space comprises:

powering down a component of the computer or a component communicatively coupled to the computer; and

capturing data representative of the user performing a motion or pose to power up the component of the computer or the component communicatively coupled to the computer.

20. The computer-readable storage device of claim 17 , wherein correlating the first motion or pose to the first gesture dictionary comprises:

determining a physical location or Internet Protocol (IP) address of the user; and

correlating the first motion or pose and the physical location or IP address of the user to the first gesture dictionary of a plurality of gesture dictionaries.

21. The computer-readable storage device of claim 17 , wherein correlating the first motion or pose to the first gesture dictionary comprises:

determining a skill level of the user; and

correlating the first motion or pose and the skill level of the user to the first gesture dictionary of a plurality of gesture dictionaries.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2014
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 034564/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2010
From: MURILLO, OSCAR E.; WILSON, ANDY; KIPMAN, ALEX A.; GALORE, JANET
To: MICROSOFT CORPORATION
Reel/Frame 024039/0584 →
Continuity (1)
Related Publication 20110173204A1 · Jul 14, 2011