Table 6 Data quality assessment... | Emerald Publishing

Table 6

Data quality assessment framework for the case study

DQC	Criterion and score
DQC	1	2	3	4	5
Relevance	Statistics/the indicator responds to a documented global development framework, service delivery standard or theoretical framework for the use case. The timing and frequency of production are annual	Statistics/the indicator partly responds to a documented national development framework or sectoral program. The timing and frequency of production are annual	Statistics/the Indicator is a proxy for measurement of a global, or national development framework or any service delivery standard or policy. The timing and frequency of production are not annual	Statistics/the Indicator does not respond to any of the accessed global, or national development framework or any service delivery standard or policy. The timing and frequency of production are not annual	Statistics/the Indicator are neither produced nor accessible
Interpretability	Statistics/the indicator is presented in a national report using tables/charts accompanied by narrations of its meta data. The indicator is conceptually clear and presented in a format that it is demanded	Statistics/the indicator is presented in a national report using tables/charts without narrations of its meta data. The indicator is conceptually clear and presented in a format that it is demanded	Statistics/the indicator is not presented in a national report; however, source data can facilitate its compilation. The indicator is conceptually clear	Statistics/the indicator is not presented in the national report and source data cannot facilitate its computation. The indicator is not conceptually clear	Statistics/the indicator is not accessed, and there is no source data at the country level that can facilitate its computation
Accuracy	All source data are adequately representative of the population, obtained from verified experiments in the country under study	Some parts of the source data do not adequately represent the population, are obtained from verified experiments in the country under study	Source data are representative of the population, are obtained from qualified estimates, or historical data or models	Source data are not obtained from the country under study and are based on expert judgements, guesses or international sources	Source data for the indicator and its scope cannot be traced
Methodological Soundness	All source data are collected from a single source and time and the indicator compiled based on international or national standards, and guidelines. The data are compiled by credible national authorities with the original intent being statistical	Some parts of the source data are collected from different sources and times; however, the indicator is compiled based on international or national standards, and guidelines	Data are compiled based on compiler's context from nonauthorized statistical sources, but the original intent is statistical	The original intent for compilation of data is not statistical and the data are compiled by nonauthorized national sources using compiler's own method	Compilation practices and scope for the data cannot be traced
Statistical Adequacy	Source of data is obtained for the whole country, generates adequate sample size to allow for the desired levels of disaggregation. The response rates, standard errors and design effects are reported	Source data obtained for the whole country generates inadequate sample size allowing limited disaggregation. Response rates, standard errors and design effects are reported	Source data are not obtained from and for the entire country with size not allowing the desired disaggregation. Response rates, standard errors and design effects are not reported	Source data are obtained from different area, other than the country of study, however allowing some form of disaggregation	The scope of source data is unknown and does not allow for any form of disaggregation

DQC	Criterion and score
DQC	1	2	3	4	5
Relevance	Statistics/the indicator responds to a documented global development framework, service delivery standard or theoretical framework for the use case. The timing and frequency of production are annual	Statistics/the indicator partly responds to a documented national development framework or sectoral program. The timing and frequency of production are annual	Statistics/the Indicator is a proxy for measurement of a global, or national development framework or any service delivery standard or policy. The timing and frequency of production are not annual	Statistics/the Indicator does not respond to any of the accessed global, or national development framework or any service delivery standard or policy. The timing and frequency of production are not annual	Statistics/the Indicator are neither produced nor accessible
Interpretability	Statistics/the indicator is presented in a national report using tables/charts accompanied by narrations of its meta data. The indicator is conceptually clear and presented in a format that it is demanded	Statistics/the indicator is presented in a national report using tables/charts without narrations of its meta data. The indicator is conceptually clear and presented in a format that it is demanded	Statistics/the indicator is not presented in a national report; however, source data can facilitate its compilation. The indicator is conceptually clear	Statistics/the indicator is not presented in the national report and source data cannot facilitate its computation. The indicator is not conceptually clear	Statistics/the indicator is not accessed, and there is no source data at the country level that can facilitate its computation
Accuracy	All source data are adequately representative of the population, obtained from verified experiments in the country under study	Some parts of the source data do not adequately represent the population, are obtained from verified experiments in the country under study	Source data are representative of the population, are obtained from qualified estimates, or historical data or models	Source data are not obtained from the country under study and are based on expert judgements, guesses or international sources	Source data for the indicator and its scope cannot be traced
Methodological Soundness	All source data are collected from a single source and time and the indicator compiled based on international or national standards, and guidelines. The data are compiled by credible national authorities with the original intent being statistical	Some parts of the source data are collected from different sources and times; however, the indicator is compiled based on international or national standards, and guidelines	Data are compiled based on compiler's context from nonauthorized statistical sources, but the original intent is statistical	The original intent for compilation of data is not statistical and the data are compiled by nonauthorized national sources using compiler's own method	Compilation practices and scope for the data cannot be traced
Statistical Adequacy	Source of data is obtained for the whole country, generates adequate sample size to allow for the desired levels of disaggregation. The response rates, standard errors and design effects are reported	Source data obtained for the whole country generates inadequate sample size allowing limited disaggregation. Response rates, standard errors and design effects are reported	Source data are not obtained from and for the entire country with size not allowing the desired disaggregation. Response rates, standard errors and design effects are not reported	Source data are obtained from different area, other than the country of study, however allowing some form of disaggregation	The scope of source data is unknown and does not allow for any form of disaggregation