Gesture recognition devices and methods
View Patent ↗Devices and related methods are disclosed herein that generally involve detecting and interpreting gestures made by a user to generate user input information for use by a digital data processing system. In one embodiment, a device includes first and second sensors that observe a workspace in which user gestures are performed. The device can be set to a keyboard input mode, a number pad input mode, or a mouse input mode based on the positioning of the user's hands. Subsequent gestures made by the user can be interpreted as keyboard inputs, mouse inputs, etc., using observed characteristics of the user's hands and various motion properties of the user's hands. These observed characteristics can also be used to implement a security protocol, for example by identifying authorized users by the anatomical properties of their hands or the behavioral properties exhibited by the user while gesturing.
1 . An input device for a digital data processing system, comprising:
at least one sensor that observes a workspace and generates data indicative of one or more parameters of an input agent within the workspace; and
a processor that identifies gestures made by the input agent from the data generated by the at least one sensor and that generates user input information based on the gestures, wherein the processor further comprises:
a user profile module configured to identify a plurality of anatomical landmarks of at least one hand of the input agent and to determine locations of the plurality of anatomical landmarks within the workspace over time based on the data generated by the at least one sensor;
a classification module configured to identify a gesture based on positioning of the plurality of anatomical landmarks over time by assessing movement of at least one anatomical landmark of the plurality of anatomical landmarks relative to another anatomical landmark and by assigning the gesture to detected changes in the plurality of anatomical landmarks;
an adaptability module that is configured to identify a location or an environment where the input device is located, wherein functioning of the input device is adjusted based on the location or the environment where the input device is located; and
a security module configured to monitor the movement of the at least one anatomical landmark or the positioning of the at least one anatomical landmark of the input agent to ensure that the input agent is an authorized user, wherein monitoring of the movement or the positioning of the at least one anatomical landmark by the security module is adjusted based on the location or the environment where the input device is located, the security module is configured to continually monitor the movement of the at least one anatomical landmark or the positioning of the at least one anatomical landmark of the input agent to ensure that the input agent remains authorized.
2 . The input device of claim 1 , wherein the adaptability module is configured to assign a customized meaning to the gesture and to store the customized meaning to a gesture library.
3 . The input device of claim 2 , wherein the classification module uses the location or the environment to determine the gesture.
4 . The input device of claim 1 , wherein the adaptability module is configured to define a custom mode.
5 . The input device of claim 1 , wherein, upon identification of the input device being located in a public space, the security module is configured to increase an amount of monitoring relative to when the input device is located in a private space.
6 . The input device of claim 1 , wherein the processor further comprises:
a strength rating module configured to monitor quality of the data generated by the at least one sensor.
7 . The input device of claim 6 , wherein the strength rating module is configured to:
determine that a detecting strength is low; and
issue a warning to adjust a position of a hand of the input agent.
8 . The input device of claim 6 , wherein the strength rating module is configured to compare the gesture to a stored gesture to ensure that the gesture is capable of being distinguished from the stored gesture, and the gesture is a custom gesture.
9 . The input device of claim 6 , wherein the strength rating module is configured to generate a calculated strength rating for the gesture.
10 . The input device of claim 1 , wherein the processor further comprises:
an orientation module that establishes a core value for a hand of the input agent, the core value indicating a position of a core of the hand within the workspace; and
a motion calculation module that analyzes the data generated by the at least one sensor and the core value over time to generate a set of values indicative of changes in the plurality of anatomical landmarks over time.
11 . The input device of claim 10 , wherein the orientation module establishes the core value based on at least one of an observed position or orientation of one or more anatomical landmarks on the hand of the input agent.
12 . The input device of claim 10 , wherein the core is a center of a dorsum of the hand of the input agent.
13 . The input device of claim 10 , wherein the core value is adjusted during use of the input device by the input agent.
14 . The input device of claim 10 , wherein the classification module is configured to use values for the core value over time to determine the gesture.
15 . The input device of claim 10 , wherein the processor further comprises:
a mode selection module configured to switch the input device between a plurality of operating modes,
wherein the motion calculation module is configured to identify a change in the core value, and the mode selection module is configured to switch the input device to another operating mode based on identification of the change in the core value.
16 . The input device of claim 1 , wherein the security module is configured to continually monitor the movement of the at least one anatomical landmark or the positioning of the at least one anatomical landmark of the input agent after an initial user authentication.
17 . An input device for a digital data processing system, comprising:
at least one sensor that observes a workspace and generates data indicative of one or more parameters of an input agent within the workspace; and
a processor that identifies gestures made by the input agent from the data generated by the at least one sensor and that generates user input information based on the gestures, wherein the processor further comprises:
a user profile module configured to identify a plurality of anatomical landmarks of at least one hand of the input agent and to determine locations of the plurality of anatomical landmarks within the workspace over time based on the data generated by the at least one sensor;
a classification module configured to identify a gesture based on positioning of the plurality of anatomical landmarks over time by assessing movement of at least one anatomical landmark of the plurality of anatomical landmarks relative to another anatomical landmark and by assigning the gesture to detected changes in the plurality of anatomical landmarks;
an adaptability module that is configured to identify a location or an environment where the input device is located, wherein functioning of the input device is adjusted based on the location or the environment where the input device is located;
a security module configured to monitor the movement of the at least one anatomical landmark or the positioning of the at least one anatomical landmark of the input agent to ensure that the input agent is an authorized user, wherein monitoring of the movement or the positioning of the at least one anatomical landmark by the security module is adjusted based on the location or the environment where the input device is located;
an orientation module that establishes a core value for a hand of the input agent, wherein the core value indicates a position of a core of the hand within the workspace, and the core is a center of a dorsum of the hand of the input agent; and
a motion calculation module that analyzes the data generated by the at least one sensor and the core value over time to generate a set of values indicative of changes in the plurality of anatomical landmarks over time.
18 . An input device for a digital data processing system, comprising:
at least one sensor that observes a workspace and generates data indicative of one or more parameters of an input agent within the workspace; and
a processor that identifies gestures made by the input agent from the data generated by the at least one sensor and that generates user input information based on the gestures, wherein the processor further comprises:
a user profile module configured to identify a plurality of anatomical landmarks of at least one hand of the input agent and to determine locations of the plurality of anatomical landmarks within the workspace over time based on the data generated by the at least one sensor;
a classification module configured to identify a gesture based on positioning of the plurality of anatomical landmarks over time by assessing movement of at least one anatomical landmark of the plurality of anatomical landmarks relative to another anatomical landmark and by assigning the gesture to detected changes in the plurality of anatomical landmarks;
an adaptability module that is configured to identify a location or an environment where the input device is located, wherein functioning of the input device is adjusted based on the location or the environment where the input device is located;
a security module configured to monitor the movement of the at least one anatomical landmark or the positioning of the at least one anatomical landmark of the input agent to ensure that the input agent is an authorized user, wherein monitoring of the movement or the positioning of the at least one anatomical landmark by the security module is adjusted based on the location or the environment where the input device is located;
an orientation module that establishes a core value for a hand of the input agent, wherein the core value indicates a position of a core of the hand within the workspace;
a motion calculation module that analyzes the data generated by the at least one sensor and the core value over time to generate a set of values indicative of changes in the plurality of anatomical landmarks over time; and
a mode selection module configured to switch the input device between a plurality of operating modes,
wherein the motion calculation module is configured to identify a change in the core value, and the mode selection module is configured to switch the input device to another operating mode based on identification of the change in the core value.