Systems and methods for micro-credential accreditation
Systems and methods provide micro-credential accreditation. The systems and methods analyze, using one or more prediction models, received text submissions received from applicants via interaction with an applicant device. The prediction model(s) fit one or more micro-credentials to the received text submission, which may collectively or independently qualify the applicant for one or more accreditation credits. By processing the received text submission, the systems and methods allow for consistent and standard output of micro-credentials by the prediction model(s). Furthermore, the systems and methods provide for monitoring the prediction model output(s) to ensure ethical fairness across varying demographic groups of applicants.
1. A method for micro-credential accreditation, comprising:
receiving a text submission from an applicant device describing an event the applicant experienced, the text submission including (a) a selected response to one or more selectable prompts and (b) input text;
generating a compiled submission, the compiled submission including a text string, a first portion of the text string corresponding to the selected response and a second portion of the text string including the input text;
processing the compiled submission with a predictive model to fit at least one micro-credential to the compiled submission, the micro-credential at least partially qualifying the applicant for credit from an accreditor, the processing the compiled submission including applying the compiled submission to a plurality of different prediction models each generating a list of fit micro-credentials, and implementing a consensus algorithm to develop a subset list of one or more micro-credential from each list of fit micro-credentials;
outputting the at least one micro-credential from the subset list.
2. The method of claim 1 , wherein outputting the at least one micro-credential includes providing school credit to the applicant.
3. The method of claim 1 , wherein outputting the at least one micro-credential includes displaying, on the applicant device, a chart indicating required micro-credentials to receive an accreditation credit.
4. The method of claim 1 , the receiving a text submission comprising providing one or more prompts to the applicant device, and receiving responses to said one or more prompts from the applicant device.
5. The method of claim 4 , the prompts including the one or more selectable prompts including a plurality of selectable options, and Tillable prompts including an input box for receiving text input.
6. The method of claim 1 , wherein generating the compiled submission further comprises generating a processed submission by:
removing gibberish text within the text submission;
standardizing text within the text submission;
removing white space within the text submission;
removing stop-words within the text submission;
stemming individual words or phrases within the text submission; and,
performing lemmatization on the words or phrases within the text submission;
wherein said processing the compiled submission includes processing the processed submission.
7. The method of claim 1 , wherein generating the compiled submission further comprises generating a processed submission by identifying a term frequency inverse document frequency (TD-IDF) matrix from the received text submission; wherein said processing the compiled submission includes processing the TD-IDF matrix.
8. The method of claim 1 , the processing the compiled submission comprising applying the text submission, or a processed version thereof, to a Pachinko Allocation Model to fit the at least one micro-credential.
9. The method of claim 1 , the processing the compiled submission comprising applying the text submission, or a processed version thereof, to a plurality of different prediction models each generating a list of fit micro-credentials, and implementing a consensus algorithm to develop a final list of one or more micro-credential from each least of fit micro-credentials.
10. The method of claim 9 , the consensus algorithm including one or both of Boosting and stacked generalization.
11. The method of claim 1 , further comprising monitoring previously output micro-credentials by demographic groups of applicants to identify whether the predictive model consistent between each demographic group; and updating the predictive model when the predictive model is not consistent within a fairness metric based on conditional statistical parity (CSP).
12. The method of claim 11 , wherein said monitoring comprises calculating a plurality of conditional statistical parity values, each CSP value defining probability of a target micro-credential being issued to each demographic group; and comparing differences between CSP values to a CSP threshold.