Elaboration of the case study requirements by data quality components and criteria
| Data quality component | Key requirement for the case study | Quality criteria |
|---|---|---|
| Relevance: data serves to address the purposes for which they are sought by users, or which they are presented as addressing | It is envisaged that the CI will be produced on an annual basis, therefore availability of annual series is important. It is the desire that the CI will be replicated at the global level; therefore indicators responding to international service delivery standards and SDGs are a priority. The indicator is more useful if it responds to national development aspirations as well as the stages of the constructed theoretical framework for the CI | The indicator responds to a global (SDG), national development framework or sectoral program |
| The indicator responds to theoretical framework (service provider-user interaction) of the case study (CI for service delivery) | ||
| Statistics are produced for the reference year and published for the year 2021 | ||
| The frequency of production (data and indicator update) is annual | ||
| The indicator responds to a known global or national service delivery standard | ||
| Interpretability: data are easily understood and properly used by users | This CI prefers the use of already published data by national authorities in the form that it is required. An indicator published in a graph or table with accompanying information on how it was produced is important for enhancing interpretation and use. Additionally, an indicator published in the form that it is required is of priority to this case study | The indicator is published in the main national report using a table or graph or map |
| The indicator is published with some form of narrative text about the contents of the table | ||
| The indicator is published in the main national report in a table or graph with some form of explanation on compilation practices | ||
| The indicator is conceptually clear at face value | ||
| The indicator is not proxy (published in the format that it is demanded) | ||
| Accuracy: source data and statistical techniques are sound, and statistical outputs sufficiently portray reality | It is the desire that this CI is replicated across many countries; therefore, priority is accorded to data collected from and for the relevant country from tested traditional sources. Indicators that represent judgements (although they respond to the service delivery phenomena) are less prioritized over the indicators obtained using objective measurements. This reduces dynamism of the indicator figures | Data for compilation of the indicator are obtained from a representative population |
| Data are obtained using verifiable measurements (objective measurements and observations as compared to opinions and guesses) | ||
| Data are obtained from the country of reference | ||
| Data for the indicator are known, and their scope can be traced | ||
| The source of data is traditional statistical source-survey, census or administrative | ||
| Methodological soundness: the methodological basis for the statistics follows internationally accepted standards, guidelines or good practices | Data compiled and aggregated using known international standards are preferred. The credibility of the producer, the similarity of timeliness for the numerator and denominator is important. In addition, data compiled for statistical purposes is assumed to be more methodologically sound | All data for computation of the indicator are compiled using either national or international standards |
| Data and indicators are produced by credible national authorities | ||
| Numerator and denominator are obtained from a single source for the same reference period | ||
| The original intent for compiling data and producing the indicator is for statistical purposes | ||
| The methods of computation of the indicator are known or can be traced | ||
| Statistical adequacy: data selected represent valid and reliable measures | This CI is to be presented by statistical regions; therefore, for every indicator and source, adequate number of observations should be generated to allow for such disaggregation | The source of data yielded adequate number of observations to guarantee the desired disaggregation for the case study (statistical region) |
| The response rate for the study/module is reported and is above 70% | ||
| Source data are obtained from and for the entire country | ||
| For survey data, the standard errors and design effect for the data points are reported and tend to zero and 1, respectively |
| Data quality component | Key requirement for the case study | Quality criteria |
|---|---|---|
| It is envisaged that the CI will be produced on an annual basis, therefore availability of annual series is important. It is the desire that the CI will be replicated at the global level; therefore indicators responding to international service delivery standards and SDGs are a priority. The indicator is more useful if it responds to national development aspirations as well as the stages of the constructed theoretical framework for the CI | The indicator responds to a global (SDG), national development framework or sectoral program | |
| The indicator responds to theoretical framework (service provider-user interaction) of the case study (CI for service delivery) | ||
| Statistics are produced for the reference year and published for the year 2021 | ||
| The frequency of production (data and indicator update) is annual | ||
| The indicator responds to a known global or national service delivery standard | ||
| This CI prefers the use of already published data by national authorities in the form that it is required. An indicator published in a graph or table with accompanying information on how it was produced is important for enhancing interpretation and use. Additionally, an indicator published in the form that it is required is of priority to this case study | The indicator is published in the main national report using a table or graph or map | |
| The indicator is published with some form of narrative text about the contents of the table | ||
| The indicator is published in the main national report in a table or graph with some form of explanation on compilation practices | ||
| The indicator is conceptually clear at face value | ||
| The indicator is not proxy (published in the format that it is demanded) | ||
| It is the desire that this CI is replicated across many countries; therefore, priority is accorded to data collected from and for the relevant country from tested traditional sources. Indicators that represent judgements (although they respond to the service delivery phenomena) are less prioritized over the indicators obtained using objective measurements. This reduces dynamism of the indicator figures | Data for compilation of the indicator are obtained from a representative population | |
| Data are obtained using verifiable measurements (objective measurements and observations as compared to opinions and guesses) | ||
| Data are obtained from the country of reference | ||
| Data for the indicator are known, and their scope can be traced | ||
| The source of data is traditional statistical source-survey, census or administrative | ||
| Data compiled and aggregated using known international standards are preferred. The credibility of the producer, the similarity of timeliness for the numerator and denominator is important. In addition, data compiled for statistical purposes is assumed to be more methodologically sound | All data for computation of the indicator are compiled using either national or international standards | |
| Data and indicators are produced by credible national authorities | ||
| Numerator and denominator are obtained from a single source for the same reference period | ||
| The original intent for compiling data and producing the indicator is for statistical purposes | ||
| The methods of computation of the indicator are known or can be traced | ||
| This CI is to be presented by statistical regions; therefore, for every indicator and source, adequate number of observations should be generated to allow for such disaggregation | The source of data yielded adequate number of observations to guarantee the desired disaggregation for the case study (statistical region) | |
| The response rate for the study/module is reported and is above 70% | ||
| Source data are obtained from and for the entire country | ||
| For survey data, the standard errors and design effect for the data points are reported and tend to zero and 1, respectively |
Sharing content requires targeting cookies to be enabled. Please update your cookie preferences to use this feature.