– The purpose of this paper is to outline a method developed for analysis of narrative reporting by charities concerning the carrying out of their aims for public benefit (as required by charity law). It seeks to assess the effectiveness of the method as a means of measuring performance of third sector organisations (TSOs).
– The method presented was used for qualitative reviewing and scoring of 1,400 sets of charity reports and accounts from England and Wales on 22 variables, with most variables involving an assessment of narratives on a five-point quality score. Various methods of standardising the scoring between different reviewers and different types of charities are considered.
– The method was found to be largely effective in discriminating between charities which had a clear focus on the public benefit requirement and those which did not. However, other factors, such as lack of awareness of the requirements and levels of concern regarding charitable status, appear to have had a substantial impact on reporting practice.
– The limitations and uncertainties in converting a qualitative assessment of a narrative into a numerical score are discussed.
– The method is likely to be of value for other studies of narrative reporting in financial statements, especially in relation to fulfilment by TSOs of the purposes for which they were established.
– The paper contributes both to the understanding of narrative reporting by TSOs and to the development of methodological approaches for such analysis.
