SYSTEMS AND METHODS FOR INTERACTIVE DYNAMIC LEARNING DIAGNOSTICS AND FEEDBACK
Systems and methods for dynamically assessing and providing feedback to a learner include displaying a set of assessment questions on a graphical user interface, obtaining a set of responses corresponding to the assessment questions, obtaining a set of diagnostic scoring rules including a set of diagnostic parameters corresponding to each assessment question and a response key, obtaining a set of learner-specific behavioral parameters, applying the set of diagnostic scoring rules to the set of responses to generate a learner response matrix, generating a learner attribute profile by applying as a set of probabilities of mastering each learning category to the learner response matrix, and estimating a learner response to a subsequent assessment question by applying a cognitive diagnostic model (CDM) or a Bayesian knowledge tracing (BKT) process to the learner attribute profile to the learner attribute profile.
1 . A computer implemented method of dynamically assessing and providing feedback to a learner, the method comprising:
displaying, on a learner interface, a set of assessment questions;
obtaining, from the learner interface, a set of responses corresponding to the assessment questions;
obtaining a set of diagnostic scoring rules, each scoring rule comprising a set of diagnostic parameters corresponding to each assessment question and a response key;
obtaining a set of learner-specific behavioral parameters;
applying the set of diagnostic scoring rules to the set of responses to generate a learner response matrix;
generating a learner attribute profile by applying as a set of probabilities of mastering each learning category to the learner response matrix; and
estimating a learner response to a subsequent assessment question by applying a cognitive diagnostic model (CDM) or a Bayesian knowledge tracing (BKT) process to the learner attribute profile.
2 . The computer implemented method of claim 1 wherein the learner attribute profile further comprises the set of learner-specific behavioral parameters.
3 . The computer implemented method of claim 1 , wherein the learner response matrix comprises a list of categories and a level of skill accrued by the learner with respect to each category.
4 . The computer implemented method of claim 2 , wherein the BKT process comprises:
displaying, with the learner interface, a subset of assessment questions wherein each question in the subset is selected from a common category;
determining a skill-specific mastery value and updated learner attribute profile by tracing an accuracy of each sequential response to each question of the subset of assessment questions; and
predicting a learner response to a subsequent assessment question from the subset of assessment questions as a function of the skill-specific mastery value and the updated learner attribute profile.
5 . The computer implemented method of claim 4 , wherein the BKT process further comprises generating a multi-state Bayesian knowledge vector corresponding to the common category, the multi-state Bayesian knowledge vector comprising a first parameter indicating whether the category is presently mastered and a second parameter indicating the probability that the category will be mastered within a threshold timeframe as a function the skill-specific mastery value and updated learner attribute profile.
6 . The computer implemented method of claim 4 , further comprising determining if any of the learner-specific behavioral parameters correlate to at-risk behavior.
7 . The computer implemented method of claim 5 , further comprising correlating the set of learner-specific behavioral parameters to the learning rate and the learner attribute profile.
8 . The computer implemented method of claim 5 , further comprising presenting, to the learner-interface, a set of behavioral improvement recommendations to correct at-risk behavior.
9 . The computer implemented method of claim 5 , further comprising presenting, to the learner interface, a set of behavioral improvement recommendations to increase a learning rate.
10 . The computer implemented method of claim 5 , further comprising presenting, to the learner interface, a set of behavioral improvement recommendations to increase the skill-specific mastery value.
11 . The computer implemented method of claim 1 , wherein the learner-specific behavioral parameters comprise a type of learning resource accessed by the learner, a time spent by the learner on a task, a participation level of the learner with an interactive interface, or a persistence ratio of a number of times retaking an assessment compared with the probability that one or more skills from the category will be mastered.
12 . The computer implemented method of claim 1 , wherein obtaining the learner-specific behavioral parameters comprises receiving behavioral indications from a learner input device.
13 . The computer implemented method of claim 12 , wherein the learner input device comprises a mouse, a microphone, a keyboard, or a touchscreen.
14 . The computer implemented method of claim 4 , wherein determining if any of the learner-specific behavioral parameters correlate to at-risk behavior comprises obtaining historical behavioral data from a historical assessment database.
15 . A system for dynamically assessing and providing feedback to a learner, the system comprising:
a learner interface, a data store, and an assessment analytics logical circuit;
wherein the assessment analytics logical circuit comprises a processor and a non-transitory medium with computer executable instructions embedded thereon, the computer executable instructions to cause the processor to:
display a set of assessment questions on the learner interface;
obtain, from the learner interface, a set of responses corresponding to the assessment questions;
obtain a set of diagnostic scoring rules, each scoring rule comprising a set of diagnostic parameters corresponding to each assessment question and a response key;
obtain a set of learner-specific behavioral parameters;
apply the set of diagnostic scoring rules to the set of responses to generate a learner response matrix;
generate a learner attribute profile by applying as a set of probabilities of mastering each learning category to the learner response matrix; and
estimate a learner response to a subsequent assessment question by applying a CDM or a Bayesian knowledge tracing (BKT) process to the learner attribute profile.
16 . The system of claim 15 wherein the learner attribute profile further comprises the set of learner-specific behavioral parameters.
17 . The system of claim 15 , wherein the learner response matrix comprises a list of categories and a level of skill accrued by the learner with respect to each category.
18 . The system of claim 16 , wherein the computer executable instructions further cause the processor to:
display a subset of assessment questions on the learner interface, wherein each question in the subset is selected from a common category;
determine a skill-specific mastery value and updated learner attribute profile by tracing an accuracy of each sequential response to each question of the subset of assessment questions; and
predict a learner response to a subsequent assessment question from the subset of assessment questions as a function of the skill-specific mastery value and the updated learner attribute profile.
19 . The system of claim 18 , wherein the computer executable instructions further cause the processor to generate a multi-state Bayesian knowledge vector corresponding to the common category, the multi-state Bayesian knowledge vector comprising a first parameter indicating whether the category is presently mastered and a second parameter indicating the probability that the category will be mastered within a threshold timeframe as a function the skill-specific mastery value and updated learner attribute profile.
20 . The system of claim 18 , wherein the computer executable instructions further cause the processor to determine if any of the learner-specific behavioral parameters correlate to at-risk behavior.
21 . The system of claim 20 , wherein the computer executable instructions further cause the processor to correlate the set of learner-specific behavioral parameters to the learning rate and the learner attribute profile.
22 . The system of claim 20 , wherein the computer executable instructions further cause the processor to present a set of behavioral improvement recommendations to the learner-interface to correct at-risk behavior.
23 . The system of claim 20 , wherein the computer executable instructions further cause the processor to present a set of behavioral improvement recommendations, on the learner interface to increase a learning rate.
24 . The system of claim 20 , wherein the computer executable instructions further cause the processor to present a set of behavioral improvement recommendations on the learner interface to increase the skill-specific mastery value.
25 . The system claim 15 , wherein the learner-specific behavioral parameters comprise a type of learning resource accessed by the learner, a time spent by the learner on a task, a participation level of the learner with an interactive interface, or a persistence ratio of a number of times retaking an assessment compared with the probability that one or more skills from the category will be mastered.
26 . The system of claim 15 , wherein the computer executable instructions further cause the processor to receive behavioral indications from a learner input device.
27 . The system of claim 26 , wherein the learner input device comprises a mouse, a microphone, a keyboard, or a touchscreen.
28 . The system of claim 18 , wherein the computer executable instructions cause the processor to determine if any of the learner-specific behavioral parameters correlate to at-risk behavior by obtaining historical behavioral data from a historical assessment database.