Quality, impact and quantification: Indicators and metrics use by social scientists

Abstract

The use of indicators and metrics for research evaluation purposes is well-documented, however less is known about their use by individual scholars. With a focus on the social sciences, this paper contributes to the existing literature on indicators and metrics use in fields with diverse publication practices. Scholars in Australia and Sweden were asked about their use and reasons for using metrics. A total of 581 completed surveys were analyzed to generate descriptive statistics, with textual analysis performed on comments provided to open questions. While just under half of the participant group had used metrics, the Australians reported use in twice the proportion of their Swedish peers. Institutional policies and processes were frequently associated with use, and the scholars’ comments suggest a high level of awareness of some metrics as well as strategic behavior in demonstrating research performance. There is also evidence of tensions between scholars’ research evaluation environment and their disciplinary values and publication practices.