Chapter 9: Applying Computer Based Assessment Using Diagnostic Modeling to Benchmark Tests

This chapter presents an in progress study of an application applying a lo- glinear diagnostic model to an Algebra II benchmark test with the ultimate goal of transforming the current pencil and paper format into a multistage computer adaptive assessment. Unlike previous applications of diagnostic models, which have been post hoc adaptations, in this project we worked with teachers purposively to create a test that matched a targeted Q-matrix format. Several different phases including pilot testing, standard setting, administration, and reporting of results, as well as next steps to convert this process to a multistage computerized test are described.