Means of establishing high validity and reliability
| Validity criterion | Means by which was addressed in this study |
|---|---|
| Objectivity: Establishing reasonable freedom from unacknowledged researcher biases and relative neutrality | Transparent, detailed, and explicit data collection and analysis by developing and following a clear research design (see, e.g. Interview protocol) |
| Reliability: Demonstrating that the study process is consistent and stable over time as well as across researchers and methods | Data were collected from a broad set of carefully selected informants, which represented different parties in the alliance Development of interview protocol, including an interview guide, shared among all interviewers 16 out of 22 interviews and all workshops were conducted by several researchers; one led the interview and the other member(s) took notes Emergent findings and key insights from the interviews were discussed among researchers right after the interviews Recording and transcribing interviews (note: five interviews were not transcribed, but the audiotapes were listened many types as well as notes from these interviews read) Cross-checking analysis to ensure consistency and agreement among researchers Development of a database, facilitating data transparency and transparency of the analysis |
| Construct validity: Establishing appropriate operational measures for the concepts | Use of a theoretical framework as a guideline and subject to elaboration in the empirical study Interview data were analyzed and presented to a focused group for cross-checking and ensuring validity of the findings, provided for the interviewees for comments as well as presented for a large number of project participants in the execution phase kick-off in Case Tramway |
| Internal validity: Establishing causal relationships whereby certain conditions are shown to lead to other conditions, as distinguished from spurious relationships (not a concern in this study because the goal is to note associations, not to make causal inferences) | Data collection of the actual, current alliance projects and integration within the arrangement to avoid recall bias and enhance data accuracy Interviewees were offered anonymity to encourage open discussion and improve data accuracy |
| External validity: Establishing a domain in which the study’s findings can be generalized | Clear and detailed description of the research context Interview data were analyzed based on the interview themes and presented to a focused group for elaboration in Case Tramway, cross-checking and ensuring validity of the findings; participants concurred that their experiences were consistent with the findings Analysis results based on the interview themes were presented, elaborated and discussed with key members of the project organization (Case Railway) Analysis results were presented, elaborated and discussed with key members of the project organization in a workshop and in the kick-off meeting (Case Tramway) The final analysis results were sent for the case project organizations’ representatives for comments and for checking that the findings are consistent with their experiences |
| Validity criterion | Means by which was addressed in this study |
|---|---|
| Objectivity: Establishing reasonable freedom from unacknowledged researcher biases and relative neutrality | Transparent, detailed, and explicit data collection and analysis by developing and following a clear research design (see, e.g. Interview protocol) |
| Reliability: Demonstrating that the study process is consistent and stable over time as well as across researchers and methods | Data were collected from a broad set of carefully selected informants, which represented different parties in the alliance |
| Construct validity: Establishing appropriate operational measures for the concepts | Use of a theoretical framework as a guideline and subject to elaboration in the empirical study |
| Internal validity: Establishing causal relationships whereby certain conditions are shown to lead to other conditions, as distinguished from spurious relationships (not a concern in this study because the goal is to note associations, not to make causal inferences) | Data collection of the actual, current alliance projects and integration within the arrangement to avoid recall bias and enhance data accuracy |
| External validity: Establishing a domain in which the study’s findings can be generalized | Clear and detailed description of the research context |
Sharing content requires targeting cookies to be enabled. Please update your cookie preferences to use this feature.