Frameworks and methodologies configured to enable real-time adaptive delivery of skills training data based on monitoring of user performance via performance monitoring hardware
Described herein are to frameworks and methodologies configured to enable real-time adaptive delivery of skills training data based on monitoring of user performance data. Embodiments of the invention have been particularly to enable real-time control over a performance instruction user interface (for example in terms of rate), and/or control over delivery of media data (for example in terms of rate and/or pan/zoom position).
1. A computer implemented method for adaptive delivery of skills training data, the method including:
(i) receiving at a computing device performance data derived from one or more performance sensor units;
(ii) processing, with the computing device, the performance data derived from the one or more performance sensor units;
(iii) based on the processing of the data derived from the one or more performance sensor units, making a determination to vary a delivery attribute of one or more user interface components and determining a determined variation; and
(iv) applying the determined variation in the delivery attribute of the one or more user interface components, wherein:
processing the performance data derived from the one or more performance sensor units includes determining a performance rate;
a given one of the user interface components includes a rendered progression object that progresses at a rate, wherein the rendered progression object progresses along a pathway that includes a plurality of performance event identification objects; and
the performance rate is adjusted such that the rendered progression object is prevented from progressing along the pathway beyond a given one of the performance event identification objects in absence of performance data that is (i) reconciled temporally with the performance event identification object or (ii) reconciled accurately with the performance event identification object.
2. The method according to claim 1 wherein the performance rate is adjusted based upon a prediction of an anticipated time for receipt of performance data reconcilable with an upcoming performance event identification object.
3. The method according to claim 1 wherein, in response to predefined conditions, the predefined conditions including identification of performance data that is (i) reconciled temporally with the performance event identification object; and (ii) not reconciled accurately with the performance event identification object, a defined action is performed.
4. The method according to claim 3 wherein the defined action includes:
providing a signal thereby to variation in delivery attributes of a further user interface component;
providing feedback;
adjusting the position of the progression object; or
causing the progression object to enter a predefined loop, or initiating a defined sub-tutorial.
5. The method according to claim 4 wherein:
the variation includes a view-port variation for a media object; and
the adjusting the position of the progression object includes regressing the progression object to a defined point.
6. The method according to claim 1 , wherein the received performance data includes performance data derived from one or more audio sensor units.
7. The method according to claim 1 , wherein the received performance data includes performance data derived from one or more sensors configured to monitor user operation of a piece of equipment.
8. The method according to claim 7 , wherein the piece of equipment includes a musical instrument.
9. The method according to claim 1 , wherein the received performance data includes performance data derived from one or more motion sensor units.
10. The method according to claim 9 , wherein the one or more motion sensor units are provided by a motion sensor enabled garment.
11. The method according to claim 9 , wherein processing the performance data derived from the one or more motion sensor units includes identifying characteristics of simultaneous motions of individual motion sensors.
12. The method according to claim 1 , wherein processing the performance data derived from the one or more performance sensor units includes identifying presence of one or more predefined observable data conditions and one of the predefined observable data conditions is associated with a symptom.
13. The method according to claim 12 , wherein the processing further includes determining a cause associated with the symptom by analysis of the data derived from the one or more performance sensor units thereby to identify presence of one or more further observable data conditions.
14. The method according to claim 1 , wherein one or more of the user interface components includes a rate attribute, and wherein making a determination to vary a delivery attribute of one or more user interface components includes setting the rate attribute based on the determined performance rate.
15. The method according to claim 1 , wherein the performance rate is a predictive performance rate, wherein the predictive performance is continuously varied responsive to validation of predictions.
16. A computer implemented method for adaptive delivery of skills training data, the method including:
(i) receiving at a computing device performance data derived from one or more performance sensor units;
(ii) processing, with the computing device, the performance data derived from the one or more performance sensor units;
(iii) based on the processing of the data derived from the one or more performance sensor units, making a determination to vary a delivery attribute of one or more user interface components and determining a determined variation; and
(iv) applying the determined variation in the delivery attribute of the one or more user interface components, wherein:
a given one of the user interface components includes a rendered progression object that progresses at a rate, wherein the rendered progression object progresses along a pathway that includes a plurality of performance event identification objects; and
making a determination to vary a delivery attribute of one or more of the user interface components includes adjusting the rate such that the rendered progression object is prevented from progressing along the pathway beyond a given one of the performance event identification objects in absence of performance data that is (i) reconciled temporally with the performance event identification object; or (ii) reconciled accurately with the performance event identification object.
17. The method according to claim 16 wherein the performance rate is adjusted based upon a prediction of an anticipated time for receipt of performance data reconcilable with an upcoming performance event identification object.
18. The method according to claim 16 wherein, in response to predefined conditions, the predefined conditions including identification of performance data that is (i) reconciled temporally with the performance event identification object; and (ii) not reconciled accurately with the performance event identification object, a defined action is performed.
19. The method according to claim 18 wherein the defined action includes:
providing a signal thereby to variation in delivery attributes of a further user interface component;
providing feedback;
adjusting the position of the progression object;
causing the progression object to enter a predefined loop; or
initiating a defined sub-tutorial.
20. The method according to claim 19 wherein:
the variation includes a view-port variation for a media object; and
adjusting the position of the progression object includes regressing the progression object to a defined point.
21. The method according to claim 16 , wherein:
a given one of the user interface components includes a media object that has a viewport definition; and
making a determination to vary a delivery attribute of one or more user interface components further includes making a determination to adjust the viewport definition.
22. A computer implemented method for adaptive delivery of skills training data, the method including:
(i) receiving at a computing device performance data derived from one or more performance sensor units;
(ii) processing, with the computing device, the performance data derived from the one or more performance sensor units;
(iii) based on the processing of the data derived from the one or more performance sensor units, making a determination to vary a delivery attribute of one or more user interface components and determining a determined variation; and
(iv) applying the determined variation in the delivery attribute of the one or more user interface components, wherein:
a given one of the user interface components includes a media object that has a viewport definition;
making a determination to vary the delivery attribute of one or more user interface components includes making a determination to adjust the viewport definition;
the viewport definition is adjusted in response to a determination of accuracy derived from processing of the performance data or identification of one or more observable data conditions in the performance data; and
a viewport definition adjustment includes a digital pan, zoom operation, or angle adjustment.
23. The computer implemented method according to claim 22 wherein a set of rules are defined, the rules associating observable data conditions and viewport definition adjustments.