Chapter 7: Design and Management of Scientific Research in Applied School Settings^☆

Authors Note: This chapter is based on the content presented in Kauffman–Hallahan Distinguished Award Presentation Session, Issues and Strategies in Conducting School-based Research: Challenges and Lessons Learned, led by Hill Walker at the 2013 Council for Exceptional Children Conference in San Antonio, TX.

In this chapter, we examined issues related to research design and research management as applied to scientific research conducted in applied school settings. In terms of research design, randomized controlled trials (RCTs) have an important role to play in advancing a scientific agenda for school-based research. However, given their enormous cost and complexity, it is important to carefully time their implementation in the development cycle. We suggested that the use of RCTs is most appropriate in the later stages of the development cycle when the focus is on demonstrating the efficacy and/or effectiveness of an intervention and establishing its generalizability under the real world conditions of schooling. We also recommended establishing a hierarchy of evidence for an intervention that involves implementing a cost-efficient mix of single case, quasi-experimental, and true experimental designs where appropriate and feasible. In examining issues related to the management of research and the implementation of a knowledge development agenda for schools, it has become apparent that treatment integrity is a keystone variable. We discussed the importance of treatment integrity, with attention to the impact on internal and external validity. Finally, we offered practical considerations to support high-quality, respectful school-based inquiry.