METHODS FOR IMPROVING TEST EFFICIENCY AND ACCURACY IN A COMPUTER ADAPTIVE TEST (CAT)
A method for use of pretest items in a test to calculate interim scores is provided. The method includes, for example, a computer implemented test having a plurality of test items that include, for example, a plurality of operational items and one or more pretest items having one or more pretest item parameters. An interim latent construct estimate is calculated using both operational and pretest items. The error for the latent construct estimation is controlled by weighting the contribution of the one or more pretest items.
1 . A method for use of pretest items in a test to calculate interim scores comprising:
providing a computer implemented test having a plurality of test items comprising
a) a plurality of operational items; and
b) one or more pretest items having one or more pretest item parameters;
calculating latent construct estimates using both operational and pretest items;
controlling error for the latent construct estimates by weighting the contributions of the one or more pretest items.
2 . The method of claim 1 further comprising:
temporarily estimating the one or more pretest item parameters for use with a set of calibrated parameters for the plurality of operational items.
3 . The method of claim 1 further comprising:
updating the one or more pretest item parameters during administration of the computer implemented test.
4 . The method of claim 1 wherein the one or more pretest item parameters are:
a. equal to their true value(s); and
b. not updated during administration of the computer implemented test.
5 . The method of claim 1 further comprising:
initially setting the one or more pretest item parameters to an average of a set of calibrated parameters for the plurality of operational items.
6 . The method of claim 5 further comprising:
updating the one or more pretest item parameters after exposure to a specified number of examinees.
7 . The method of claim 1 wherein the pretest item parameters equal the maximum likelihood estimators based on examinee responses.
8 . A method for use of pretest items in a test to calculate interim scores comprising:
providing a computer implemented test having a plurality of test items comprising
a) a plurality of operational items; and
b) one or more pretest items having one or more pretest item parameters;
calculating latent construct estimates using both operational and pretest items;
estimating the one or more pretest item parameters for use with a set of calibrated parameters for the plurality of operational items.
9 . The method of claim 8 further comprising:
controlling error for the latent construct estimates by weighting the contributions of the one or more pretest items.
10 . The method of claim 8 further comprising:
randomly selecting and administering the one or more pretest items.
11 . The method of claim 8 further comprising:
updating an interim score for the computer implemented test based on examinee responses to the one or more pretest items.
12 . The method of claim 11 further comprising:
affecting the selection of a next item in the computer implemented test using the updated interim score.
13 . A method for use of pretest items in a test to calculate interim scores comprising:
providing a computer implemented test having a plurality of test items comprising
a) a plurality of operational items; and
b) one or more pretest items having one or more pretest item parameters;
calculating latent construct estimates using both operational and pretest items;
controlling error for the latent construct estimates by weighting the contributions of the one or more pretest items;
estimating the one or more pretest item parameters for use with a set of calibrated parameters for the plurality of operational items; and
updating an interim score for the computer implemented test based on examinee responses to the one or more pretest items.
14 . The method of claim 13 further comprising:
temporarily estimating the one or more pretest item parameters for use with a set of calibrated parameters for the plurality of operational items.
15 . The method of claim 13 further comprising:
updating the one or more pretest item parameters during administration of the computer implemented test.
16 . The method of claim 13 wherein the one or more pretest item parameters are:
a. equal to their true value(s); and
b. not updated during administration of the computer implemented test.
17 . The method of claim 13 further comprising:
initially setting the one or more pretest item parameters to an average of the set of calibrated parameters for the plurality of operational items.
18 . The method of claim 17 further comprising:
updating the one or more pretest item parameters after exposure to a specified number of examinees.
19 . The method of claim 13 wherein the pretest item parameters equal the maximum likelihood estimators based on examinee responses.
20 . The method of claim 19 further comprising:
affecting the selection of a next item in the computer implemented test using the updated interim score.