New Horizon Testing (eBook)

Front Cover 
1 
New Horizons in Testing: Latent Trait Test Theory and Computerized Adaptive Testing 4
Copyright Page 5
Table of Contents 6
Contributors 12
Preface 14
Acknowledgments 18
Introduction 22
LATENT TRAIT THEORY 22
ADAPTIVE TESTING 26
REFERENCES 28
PART I. ESTIMATING ITEM PARAMETERS AND ABILITY 30
Chapter 1. Estimation of Parameters in the Three-Parameter Latent Trait Model 34
PURPOSE 35
DESIGN OF THE STUDY 35
RESULTS 36
DISCUSSION 49
REFERENCES 51
Chapter 2. Robustness of Item Response Models and Effects of Test Length and Sample Size on the Precision of Ability Estimates 52
STUDY 1 54
STUDY 2 61
REFERENCES 69
Chapter 3. Small N Justifies Rasch Model 72
METHOD 73
TEST STUDIED 75
RESULTS 77
CONCLUSIONS 79
APPENDIX: ASYMPTOTIC SAMPLING VARIANCE OF . 79
REFERENCE 82
Chapter 4. Are We Correcting for Guessing in the Wrong Direction? 84
THE START OF AN ALTERNATIVE 86
A MORE SPECIFIC PLAN 89
AN AMJACK EXAMPLE 90
CONCLUSIONS 95
AFTERTHOUGHT 97
APPENDIX A 98
APPENDIX B 99
REFERENCES 100
PART II: BEYOND THE ABILITY ESTIMATE 102
Chapter 5. The Person Response Curve: Fit of Individuals to Item Response Theory Models 104
RELATED RESEARCH 106
THE PERSON RESPONSE CURVE 112
METHOD 116
RESULTS 119
CONCLUSIONS AND DIRECTIONS FOR FUTURE RESEARCH 125
REFERENCES 127
Chapter 6. Appropriateness Measurement: Validating Studies and Variable Ability Models 130
OBJECTIVES AND LIMITATIONS OF APPROPRIATENESS MEASUREMENT 131
REVIEW OF TEST THEORIES AND BASIC APPROPRIATENESS MEASUREMENT 133
SIMULATION PROCEDURES AND EARLIER RESULTS 139
EMPIRICAL STUDIES 140
SUMMARY AND CONCLUDING REMARKS 149
REFERENCES 151
PART III: APPLICATIONS TO TESTING PROBLEMS 154
Chapter 7. Effects of Sample Size on Linear Equating of Item Characteristic Curve Parameters 156
ITEM CHARACTERISTIC CURVE PARAMETERS 157
LINKING PARADIGMS 158
METHOD 159
RESULTS 161
DISCUSSION 165
CONCLUSIONS 166
REFERENCES 167
Chapter 8. A Test of the Adequacy of Curvilinear Score Equating Models 168
EQUATING MODELS 169
STUDY DESIGN 173
RESULTS AND DISCUSSION 183
CONCLUSIONS 196
REFERENCES 197
Chapter 9. Timed Testing: An Approach Using Item Response Theory 200
THE MODEL 201
ESTIMATION 203
APPLICATIONS: I. SPATIAL TEST DATA 206
APPLICATIONS: II. THREE TESTS 208
CONCLUSIONS 221
REFERENCES 223
Chapter 10. The Mental Growth Curve Reexamined 226
A SCALING PROCEDURE FULLY INDEPENDENT OF CHRONOLOGICAL AGE UNITS 228
SCALING THE BINET TEST 230
ADVANTAGES OF THE PRESENT SCALING PROCEDURE 232
APPENDIX 234
REFERENCES 239
PART IV: APPLICATION TO ADAPTIVE TESTING 242
Chapter 11. Reliability and Validity of Adaptive Ability Tests in a Military Setting 244
BACKGROUND AND PURPOSE 245
METHOD 247
RESULTS 250
CONCLUSIONS 256
REFERENCES 256
Chapter 12. A Procedure for Decision Making Using Tailored Testing 258
TAILORED TESTING PROCEDURES 259
SEQUENTIAL DECISION PROCEDURES 259
THE SEQUENTIAL PROBABILITY RATIO TEST 260
RESEARCH DESIGN 265
RESULTS 267
SUMMARY AND CONCLUSIONS 274
REFERENCES 276
Chapter 13. A Comparison of IRT-Based Adaptive Mastery Testing and a Sequential Mastery Testing Procedure 278
ALTERNATIVES TO CONVENTIONAL MASTERY TESTS 279
METHOD 287
RESULTS 291
DISCUSSION AND CONCLUSIONS 301
REFERENCES 303
PART V. MODELS FOR SPECIAL APPLICATIONS 306
Chapter 14. Constant Information Model on the Dichotomous Response Level 308
THE CONSTANT INFORMATION MODEL 310
USE OF THE CONSTANT INFORMATION MODEL IN THE ESTIMATION OF THE OPERATING CHARACTERISTICS OF ITEM RESPONSE CATEGORIES 316
DISCUSSION AND CONCLUSION 328
REFERENCES 328
Chapter 15. Some Latent Trait Models for Measuring Change in Qualitative Observations 330
A FAMILY OF LINEAR LOGISTIC MODELS FOR QUALITATIVE DATA 333
THE DICHOTOMOUS LINEAR LOGISTIC MODEL WITH RELAXED ASSUMPTIONS 334
THE EPISTEMOLOGICAL BACKGROUND OF THE LINEAR LOGISTIC MODEL WITH RELAXED ASSUMPTIONS 338
ESTIMATING MODEL PARAMETERS IN THE LINEAR LOGISTIC MODEL WITH RELAXED ASSUMPTIONS 340
TESTING HYPOTHESES WITH THE LINEAR LOGISTIC MODEL WITH RELAXED ASSUMPTIONS 341
THE POLYTOMOUS LINEAR LOGISTIC MODEL WITH RELAXED ASSUMPTIONS 345
REFERENCES 349
Author Index 352
Subject Index 356