Chapter 1: A Brief History and Overview

Data-driven. Evidence-based. Outcome-oriented. Common buzzwords abound today that show our propensity as a society for (generally) quantifiable, numerical information that will enable decision-making, allocation of resources, and viability of initiatives and projects. Traditionally, the measure of scientific achievement is based on where and when research output is subsequently cited in other scholarship, generally peer-reviewed journal articles (PRJAs). Citation-based metrics, known as bibliometrics, are now bolstered by other indicators such as alternative metrics, web analytics, journal usage metrics, and other measures of productivity, reach, impact, prestige, and so forth. The existence of these broader measures of research impact has been largely facilitated by electronic publishing and dissemination of scholarly thought and output electronically and on the World Wide Web. Use of metrics such as the Journal Impact Factor (JIF), citation counts, and more recently, the h-index have primarily been utilized in academic tenure and promotion dossiers to demonstrate the success or merit of the candidate’s scholarly pursuits. Evaluation of research through measures of impact extends beyond academe, and use of these indicators is manifesting in new places and in new ways. This work presents five case studies that show how a variety of research impact indicators are being used in specialized settings.