Review of choice-based, matched, and other stratified sample studies in auditing research

The use of choice-based, matched, and other stratified sample designs is common in auditing research. However, it is not widely appreciated that the data analysis for these studies has to take into account the non-random nature of sample selection in these designs. A choice-based, matched or otherwise stratified sample is a nonrandom sample that must be analyzed using conditional analysis techniques. We review five research streams in the auditing area. These streams include work on determinants of audit litigation, audit fees, auditor reporting in financially distressed firms, audit quality and auditor switches. Cram, Karan, and Stuart (CKS) (2009) demonstrated the accuracy of conditional analysis, compared to unconditional analysis, of nonrandom samples through the use of simulations, replications, and mathematical proofs. Papers since published have continued to rely upon questionable research, however, and it is hard for researchers to identify what is the reliability of a given work. We complement and extend CKS (2009) by identifying audit papers in selected research streams whose results will likely differ if the data gathered are analyzed using conditional analysis techniques. Thus research can be advanced either by replication and reanalysis, or by refocus of new research upon issues that should no longer be viewed as settled.