Testing the Tool and not the Theory

Traditionally, the main goal of empirical research has been to test theories. Yet, theory-testing is problematical in the social sciences. Findings from empirical studies have proven hard to replicate and there is a lack of progress in creating a coherent and cumulative knowledge base. There are both practical and epistemological issues that prevent effective empirical tests. It is difficult to operationalize constructs and design decisive tests of theories. The laws and regularities posited in theories in the natural sciences are independent of human actors, while theories in the social sciences describe systems and structures that are created and maintained by human actors. Nonetheless, human actors are sometimes guided by theories. They may change their behavior or make different decisions based on academically produced knowledge. This relationship is usually mediated by the use of tools of various sorts (i.e., design principles, diagrams, or stories). I discuss why scholars should conduct empirical research to test the pragmatic validity of tools that are derived from theories rather than testing the scientific validity of the theories themselves.