Assessment and augmentation system for open motor skills
A system adapted to augment movement behavior of participants in an open motor task or activity includes one or more movement sensors configured to generate output characterizing movements of participants, including relevant interactions with elements and features of the environment and task or activity objects within the environment. A processor is configured to extract and segment a sequence of movement behavior elements from the output, register the movement elements with respect to operating environment, including the task or activity objects, recognize activity state, and determine cues to enhance performance and/or learning. Augmentations include verbal, visual, or haptic or audible signal-based cues that are designed to target critical aspects of movement skills in open motor tasks, including planning sequence of movements toward task goals; coordinating and executing movement elements in the sequence in relationship to relevant task activity events and elements.
1 . A system comprising:
one or more movement sensors adapted to capture and model movement behavior of a subject engaged in an open motor task or activity performed in an environment, wherein the one or more movement sensors are configured to generate output characterizing body segment and end effector movements of the subject, and interactions of the subject with features of the environment and one or more task or activity objects within the environment;
an augmentation processor comprising computer processor and memory components configured to:
extract and segment movement behavior elements from the output, characterizing a sequence of the movement behavior elements performed by the subject in the task or activity, within the environment;
identify a hierarchical relationship among the movement behavior elements;
generate a register of the movement behavior elements and associated outcomes with respect to the features of the environment based on the hierarchical relationship, including the sequence of movement behavior elements and motions of said task or activity objects responsive to the end effector movements; and
characterize the movement behavior elements and associated outcomes relative to the task or activity objects and the features of the environment based on the register of movement behavior elements, including the outcomes associated with the movement behavior elements; and
a user interface configured to generate augmentation feedback responsive to the sequence of movement behavior elements and associated outcomes, as characterized by the augmentation processor;
wherein the augmentation feedback is selected to specify one or more of the movement behavior elements for the subject to perform the task or activity via one or more of the end effector movements; and
wherein the computer processor and memory components are further configured to determine a participant setup for the subject, the participant setup including a stance of one or more of the body segment movements with respect to the subject, and a point of contact or strike zone information for one or more of the end effector movements relative to one or more of the task or activity objects.
2 . The system of claim 1 , wherein the register of movement behavior elements comprises positioning movement elements, preparatory or setup movement elements, and recovery movement elements, and wherein the outcomes represent changes in the features of the environment associated with said movement behavior elements.
3 . The system of claim 1 , wherein one or more of the task or activity objects comprises a ball, one or more of the end effector movements relate to a racket, and the features of the environment comprise one or more court subdivisions or boundaries and a position of a net relative to the subject.
4 . The system of claim 1 , wherein the computer processor and memory components are further configured to determine one or more of the features of the environment from the register of movement behavior elements, the register characterizing a pose of the subject based on the respective body segment and end effector movements, with respect to the one or more features or one or more of the task or activity objects, or both.
5 . The system of claim 1 , wherein the movement behavior elements define a turn maneuver of the subject in performance of the task or activity and the features of the environment define a local terrain proximate the subject, and:
wherein one or more of the associated outcomes defines a change in the local terrain proximate the subject, responsive to the turn maneuver, or
wherein the end effector movements are responsive to a velocity or direction of the participant with respect to the local terrain, proximate the subject; and
wherein the augmentation feedback is selected to prompt the subject to achieve or improve upon one of the associated outcomes, based on the local terrain.
6 . The system of claim 1 , wherein the features of the environment comprise one or more terrain elements selected from moguls, gates or natural obstacles, and wherein the registry defines a local plane of the subject with respect to the one or more terrain elements.
7 . The system of claim 1 , wherein the one or more movement sensors comprise a video sensor configured to generate the output as adapted for measurements of a gaze vector of the subject with respect to one or more of the features of the environment, or with respect to one or more of the task or activity objects.
8 . A method for operating a system according to claim 1 , the method comprising:
estimating an activity state of the subject;
identifying the movement behavior elements and interactions of the subject with the features of the environment, and the respective associated outcomes;
using a reference model describing desired behavior of the subject, synthesizing a cueing law defining one or more aspects of the augmentation feedback comprising a cue selected to:
prompt the subject to coordinate the movement behavior elements in the sequence within the environment, selected for execution of the sequence of movement behavior elements to achieve one or more of the associated outcomes in the task or activity;
prompt the subject in positioning the movement behavior elements for synchronization with one or more of the task or activity objects or features of the environment;
prompt the subject in preparation or setup of the movement behavior elements element for synchronization with one or more of the task or activity objects or features of the environment; and/or
prompt the subject in execution of the movement behavior elements for synchronization with one or more of the task or activity objects or features of the environment, and to achieve or improve upon a selected outcome of the respective associated outcomes.
9 . The method of claim 8 , wherein the augmentation feedback is selected for one or more of prompting the subject for positioning of the body segment movements within the environment, timing of the body segment movements in the sequence of movement behavior elements, or highlighting relevant cues from one or more of the features of the environment or the task or activity objects within the environment.
10 . The method of claim 8 , wherein the augmentation feedback includes one or more real-time cues comprising a visual, audio, or verbal signal selected to assist the subject in positioning of the body segment movements, for planning the sequence of movement behavior elements during performance of the task or activity, or both.
11 . The method of claim 8 , wherein the one or more movement sensors include one or more motion sensors mounted on one or more of the task or activity objects, or worn by the subject.