Skip to Main Content
Purpose

The purpose of this study is to investigate the capabilities essential to vaccine supply chain (VSC) resilience given a mass vaccination endeavor during a pandemic.

Design/methodology/approach

An exploratory qualitative study was used to elicit the required capabilities pertinent to the design of resilient VSC flows. Data were extracted from white papers, reports, academic papers and the presentations of over 100 experts globally who convened at webinars, symposia and workshops to discuss the COVID-19 mass vaccination campaign and the VSC.

Findings

The results of this study indicated that 7 primary capabilities, 44 Level 1 sub-factor capabilities and 145 Level 2 sub-factor capabilities are essential to VSC resilience in a mass vaccination situation during a pandemic. Furthermore, through cluster analysis, associations of various degrees were identified between some pairs of resilience capabilities.

Research limitations/implications

To the best of the author’s knowledge, a comprehensive and holistic exploratory research study that identifies systemic resilience capabilities of mass vaccination supply chains and aligns these requirements to the seven critical flows in the VSC has not been previously undertaken. A cluster analysis that depicts the relationships between the resilience capabilities has also not yet been done.

Practical implications

The results have significant consequences as an informative reference for leaders managing herd immunity goals during pandemic situations. Stakeholders in the public sector, private sector and other entities, involved in planning and managing all or part of a mass VSC during a pandemic, should find the results valuable in providing a structured approach for building resilience at systemic and individual flow levels.

Originality/value

This study contributes to the literature on designing resilient mass vaccination supply chains during a pandemic. Using data from a wide spectrum of published and audiovisual sources, this study identifies seven resilience capabilities to reduce disturbances that lead to delays in mass vaccination supply chains. This study develops a structured approach to align these capabilities to the seven critical flows in the VSC. Through cluster analysis, associations between the resilience capabilities are identified, indicating where multiple strategies may be required to reinforce VSC resilience.

Mass vaccination is a commonly used strategy to quell the uncontrollable spread of a pandemic disease. The rationale is that if vaccines can be rapidly and ubiquitously delivered to potential recipients, then susceptible populations can be immunized quickly, and disease transmission can be stemmed, reducing potential negative consequences. During normal times, pharmaceutical supply chains make tradeoffs between speed, cost and service (Cafone, 2022). However, the success of a mass vaccination endeavor during a pandemic is premised almost entirely on speed (Cafone, 2022; Budish, 2021). Any delay in vaccine development, production, delivery or inoculation could prolong the toll on human life and escalate social and economic impacts. Consequently, the benefits of mass vaccination are highly dependent on a resilient vaccine supply chain (VSC) that is capable of withstanding and rapidly surmounting unanticipated disruptions that emerge while orchestrating an urgent campaign.

One of the deadliest pandemics in recent times, COVID-19, resulted in over 767 million cases and 6.9 million deaths globally during the period from March 11, 2020, to May 31, 2023 [World Health Organization (WHO), 2023]. Because of the threats posed by the pandemic, mass vaccination was used as a critical weapon against the disease. Yet, despite the unprecedented speed in developing a viable vaccine, loss of life and economic costs continued to escalate following disruptions in the VSC (Bown, 2022, p. 10; GlobalData Healthcare, 2022; Trump et al., 2022).

Furthermore, several studies conducted at the onset of the COVID-19 pandemic point to the inability of supply chains to handle large-scale disruptions of the magnitude of a global pandemic (El Korchi, 2022). In the case of pharmaceutical supply chains, and specifically VSCs, decades of efficiency strategies (e.g. implementation of lean principles), coupled with numerous interdependencies, have increased the fragility of the supply chain and reduced the ability to handle unexpected shocks. To minimize disruptions, resilience must, therefore, be intentionally designed in the supply chain (Christopher and Peck, 2004; Trump et al., 2022), and VSCs are no exception.

Despite the importance of VSC resilience, however, past research has focused narrowly on VSC efficiency to the exclusion of resilience (Sheffi, 2020; Simchi-Levi and Simchi-Levi, 2020; Golan et al., 2021a, 2021b; Trump et al., 2022). A few researchers have looked at some challenges in the VSC (Hartner et al., 2024; Ferranna, 2024; Feddema et al., 2023; Trump et al., 2022; Alam et al., 2021; Finkenstadt and Handfield, 2021) and in the pharmaceutical supply chain in general (Ganguly and Farr, 2024; Ferdous et al., 2023; Bastani et al., 2021; Bastani, 2021), but most studies have focused on optimizing or improving only a portion of the VSC. As a result, the literature lacks thematic content on building end-to-end resilience in VSCs during a pandemic.

Research on supply chain resilience before COVID-19 has also focused primarily on localized or contained risks, for example, natural disasters, manufacturing plant disruptions and supplier shortages (Golan et al., 2020; El Korchi, 2022). These risks were studied as isolated events; however, COVID-19 revealed that an unexpected catastrophic event could trigger further events that result in multiple simultaneous risks. Recognizing the limitation of supply chains to handle an exacerbated situation of compound risk events that result in a serious disruptive state, researchers have called for increased research to generate new insights into resilience and recovery (Chowdury et al., 2021; Sarkis, 2020). As global pandemics are infrequent events, the COVID-19 experience offers a valuable opportunity to investigate the capabilities essential to VSC resilience in pandemic situations. Consequently, this research aims to answer the following questions based on insights from the COVID-19 pandemic:

Q1.

What primary capabilities are essential to building resilience in vaccine supply chains supporting a mass vaccination operation during a pandemic?

Q2.

What sub-factor resilience capabilities underpin the primary resilience capabilities and how should these be categorized and prioritized?

Q3.

What similarities and associations are evident between the primary resilience capabilities and the sub-factor resilience capabilities?

To address these questions, this study undertakes an exploratory analysis using a diversity of data sources, such as white papers, reports, academic papers and audiovisual presentations of over 100 subject-matter experts in all areas of the COVID-19 VSC. A study of this scope, which reviews the collective opinions, insights and experiences of a large group of professionals globally, has not been previously undertaken. The results make several contributions that should be useful to researchers and practitioners interested in VSC resilience during pandemic situations. From an academic perspective, it advances the literature on resilience using the case of a massive pandemic that touched the entire world. This study also contributes to the growing body of literature on the resilience of complex supply chain systems and, in particular, mass vaccination supply chains. As an empirical study that used data from direct high-level discussions to reduce and prevent disturbances in the COVID-19 VSC, the findings may help advance a theory on VSC resilience. Researchers should also find it useful as an additional source of data in performing systematic reviews and triangulation of data pertaining to the COVID-19 VSC. From a practitioner perspective, the results serve as a comprehensive resource on the capabilities required to rapidly design, plan and manage resilience in all or part of a global mass vaccination supply chain during the urgency of a pandemic. As the case of a rare disaster, it also demonstrates how resilience can be built to augment traditional risk management practices.

The remainder of this paper is structured as follows: Section 2 provides some background on supply chain resilience. Section 3 reviews the literature on VSC resilience, and Section 4 details the methodology used for the study. Section 5 presents the results, which are further discussed in Section 6. Section 7 provides some concluding remarks on the study and opportunities for future research.

Interest in supply chain resilience has soared in the past decade (Tukahumabwa and Stevenson, 2015; Behzadi et al., 2020) particularly since the COVID-19 pandemic (Castillo, 2022). According to Datta (2017), the globalization of supply chains, implementation of lean inventory philosophies and lack of supply chain redundancies have increased susceptibility to disruption and triggered negative tailspin effects in production and delivery. Pharmaceutical supply chains, being no exception, have come under scrutiny for their increasing fragility and vulnerability to disturbances because of the implementation of these efficiencies. VSCs deployed during a pandemic are large complex ecosystems (Gunderson et al., 2010; Swann et al., 2020), with all the characteristics of a system of systems as shown in Table 1. Because of this complexity and the compound effect of their fragility, size, number of interactions and dependencies and exposure to unpredictable external events (Thacker et al., 2017; De Weck et al., 2011; de Bruijne and van Eeten, 2007), disturbances can quickly lead to a breakdown that delays achieving herd immunity goals.

Table 1

Characteristics of a system of systems

CharacteristicDescription
AutonomyEach sub-system makes independent choices and decisions per its overall mission and goals
BelongingIndividual sub-systems derive satisfaction from affiliating with other entities within the system boundaries to achieve a shared goal
ConnectivityIndividual sub-systems link with other sub-systems over geographical distances to achieve the desired goals
DiversitySub-system elements are heterogeneous and varied
EmergenceThe system is dynamic and constantly changing and displays new properties and behaviors
Source: Author’s own creation/work

Supply chains support multiple flows from one node to another across diverse links (Christopher and Peck, 2004). Both nodes and links are susceptible to disruption by events that may or may not be anticipated, are unknown or only partially understood. Unless capabilities to resist and overcome potential disruptions are built into the supply chains, disturbances can lead to a serious decline in performance.

As a complex system, the VSC has a defined boundary within which the component entities and systems interact. During a pandemic, these include supply chain participants (Sauser et al., 2008); the government; the public health sector; regulatory agencies; the private sector; multilateral organizations; community organizations; and other critical entities. Each subsystem seeks to achieve its mission, while also acting jointly with other systems to accomplish the shared mission of the system (Sauser et al., 2008).

The concept of resilience was first studied in ecological systems and defined as an intrinsic property that allows a system “to absorb a change in state variables, drive variables, and parameters, and continue to persist” (Holling, 1973). Since then, resilience has been explored in several academic disciplines, including psychology, sociology, disaster and emergency management, engineering and supply chain management (Ponomarov and Holcomb, 2009). However, because of the diversity of these fields and the vastly differing applications of the resilience concept, a comprehensive and universal definition is still lacking in academic literature (Ponomarov and Holcomb, 2009; Mensah and Merkuryev, 2014; Hosseini et al., 2016). In general, resilience is understood to be an intrinsic property achieved through the development of diverse capabilities that allow a system to absorb the impact of an unexpected shock, adapt to a disturbed state and restore performance to a desirable state.

Several scholars have since identified different phases of system resilience, from pre-disturbance to recovery, and have developed models and formulas to depict and quantify resilience. Bruneau’s (2003) resilience triangle is one of the classic models that graphically depicts the behavior of a system to a shock – an earth tremor. Upon the onset of the shock, the system immediately falls to its lowest performance level and then immediately commences a gradual recovery back to full performance (Figure 1).

Figure 1

Resilience loss of a system following a shock

Figure 1

Resilience loss of a system following a shock

Close modal

Bruneau et al. (2003) developed a deterministic equation, as shown in equation (1), to quantify the resilience loss over time:

(1)

Where:

t0 = time that the disruption takes place;

t1 = time that total recovery to pre-disruption performance levels is restored; and

Q = amount of restored performance as a function of time.

While Bruneau’s model applies to several systems, its assumptions may be limited in the case of supply chains where the buffering role of inventory prevents a precipitous and instantaneous drop in performance following a shock. An alternative model proposed by Baroud et al. (2014) may better explain a supply chain’s behavioral states following a disturbance (Figure 2).

Figure 2

Resilience model proposed by Baroud et al. (2014) 

Figure 2

Resilience model proposed by Baroud et al. (2014) 

Close modal

Baroud’s (2014) model identifies four states, beginning with a state of reliability (initial performance), followed by states of vulnerability, survivability and recoverability. System performance at any time t is denoted as Ф(t), with higher values indicating a preferred state [equation (2)]. Overall system resilience (ᴙ) at time (t) is observed if there is a disruptive event quantified on a scale from 0 to 1 as the ratio of recovery time to disruption time. A value of 1 denotes a perfectly resilient network.

Performance of a fully resilient system at time tr, given a disruptive event ej: i:

(2)

Where:

ᴙ Ф (tr|ej) = system resilience from initial performance to recovery, given a disruptive event, ej;

Ф (tr|ej) = performance of a fully resilient system at time tr given a disruptive event, ej;

Ф (td|ej) = performance of the system at time td given a disruptive event, ej;

Ф (t0) = performance of the system at time t0;

t0 = time at which the system is operating at its original state;

te = time at which disruption occurs;

td = time at which system reaches maximum disrupted state;

ts = time at which recovery begins;

tf = time at which full recovery is reached;

Ф(t0) = performance of the system at time t0;

Ф(td) = performance of the system at time td; and

Ф(tf) = performance of the system at time tf.

In the supply chain domain, resilience is still a relatively new concept (Christopher and Peck, 2004; Craighead et al., 2007; Falasca et al., 2008) under the general purview of, but distinct from, traditional risk management (Ponomarov and Holcomb, 2009; Pettit et al., 2010). Although several authors have attempted to describe and define the term, Castillo (2022) reports that an overarching theory on supply chain resilience remains to be developed.

Christopher and Peck (2004) characterized supply chain resilience as a system’s ability to shift back to an initial performance level or more desirable state following a disturbance. Sheffi and Rice (2005) proposed a similar definition but focused on the ability to return to normal performance following a disruption. Ponomarov and Holcomb (2009) concluded that supply chain resilience is the ability to adapt to unexpected events, react when disrupted and recover from disturbances by maintaining the required level of integration and control to continue operations. Datta (2017) described resilience as preventing and rapidly responding to disruptions to regain stability and ensure competitiveness. Falasca et al. (2008) viewed resilience as the ability to reduce disruption risk by decreasing the likelihood, impact and recovery time associated with disruptions. Kochan and Nowicki (2018) characterized supply chain resilience as the ability to shift performance toward a desirable state to avert supply chain failures. Implicit in all these definitions is maintaining the desired performance following an unexpected shock.

Researchers have also attempted to collate disparate views of supply chain resilience. Weiland and Durach (2021), for example, identified two divergent views that build on Holling’s (1996) work. One takes an engineering perspective, perceiving the supply chain as a configurable closed system detached from the external environment and capable of being optimized to improve efficiency. This view emphasizes the importance of maintaining an equilibrium state or bouncing back after a disruption. It is supported by Simchi-Levi et al. (2014), who suggest quantifying supply chain resilience in terms of time to recovery.

The second view takes an ecological perspective, perceiving the supply chain as an open or complex adaptive system interacting with its environment – a perspective supported by Choi et al. (2001). Gunderson and Holling (2001) also argue that viewing resilience as a single optimum state only works in systems with low uncertainty and not in dynamic, constantly evolving environments subject to high uncertainty. They emphasize that it is more important to maintain existence rather than efficiency. The ecological view underscores the difficulty of total control and optimization. Instead, it proposes building capabilities that allow appropriate responses to unexpected changes so that a system can cope with disruption. Wied et al. (2019) define two possible outcomes following a recovery that support the view of a different performance level:

  1. bounce-back resilience, in which the disturbed system returns to its pre-disturbance performance levels; and

  2. bounce-forward resilience, in which the system’s performance after a shock is either worse (fragile system) or better (anti-fragile system) than pre-disturbance levels.

Table 2 summarizes the various definitions of resilience.

Table 2

Summary of resilience definitions

AuthorDefinition
Holling (1973, p. 17)“The ability of these systems to absorb changes of state variables, driving variables, and parameters, and still persist”
Carpenter et al. (2001)“Recognized that dynamic systems do not tend toward a stable or equilibrium state and introduced the concept of adaptive cycle theory. Identified three properties of resilience: (1) The amount of change that a system can undergo while retaining the same controls on structure and function. (2) The degree to which the system is capable of organizing itself without disorganization or force from external factors. (3) The degree to which a system develops the capacity to learn and adapt in response to disturbances”
Rice and Caniato (2003)“The ability of a supply chain to react to unexpected disruptions and restore normal supply network operations”
Christopher and Peck (2004, p. 2)“The ability of a system to move to its original state or move to a new, desired state after being disturbed”
Sheffi and Rice (2005, p. 1)Supply chain resilience is “the ability to bounce back from a disruption”
Falasca et al. (2008, p. 1)“The ability of a supply chain system to reduce the probabilities of a disruption, to reduce the consequences of those disruptions once they occur, and to reduce the time to recover normal performance”
Ponomarov and Holcomb (2009, p. 8)“The adaptive capability of the supply chain to prepare for unexpected events, respond to disruptions, and recover from them by maintaining continuity of operations at the desired level of connectedness and control over structure and function”
Biringer et al. (2010, p. 6)“Resilience is a concept related to a system’s ability to perform the critical functions required for its mission efficiently, even in the event of disruptive actions (natural, accidental, or malevolent events)”
Zsidisin and Wagner (2010, p. 5)“Supply chain resilience consists of building flexibility and redundancy to offset supply disruptions
Ponis and Koronis (2012, p. 5)“The ability to proactively plan and design the supply chain network for anticipating unexpected disruptive (negative) events, respond adaptively to disruptions while maintaining control over structure and function and transcending to a post event robust state of operations, if possible, more favorable than the one prior to the event, thus gaining competitive advantage”
Tukahumabwa and Stevenson (2015, p. 8)“The adaptive capability of a supply chain to prepare for and/or respond to disruptions, to make a timely and cost-effective recovery, and therefore progress to a post-disruption state of operations – ideally, a better state than prior to disruption”
Datta (2017, p. 7)“Supply chain resilience is a dynamic process of steering the actions so that the organization always stays out of danger zone, and if the disruptive/uncertain event occurs, resilience implies initiating a very rapid and efficient response to minimise the consequences and maintaining or regaining a dynamically stable state, which allows it to adapt operations to the requirements of the changed environment before the competitors and succeed in the long run”
Source: Author’s own work compiled from the literature

The general idea behind resilience theory is to design systems that can handle unexpected events by minimizing the potential negative consequences (Wied et al., 2019). The authors (Wied et al., 2019) posit that a system’s performance following an unexpected shock is driven by the impact of the shock and the extent to which the system’s attributes can buffer the disturbances. This relationship is expressed as a function of two variables:

  1. a set of unexpected events or disruptors; and

  2. a set of resilience attributes that minimize the impact of the shock [equation (3)].

As shown in Figure 3, VSC performance is directly related to the resilience properties that counter a disruptive event: (Wied et al., 2019)

(3)

Where:

Figure 3

Factors impacting supply chain resilience based on empirical and theoretical evidence

Figure 3

Factors impacting supply chain resilience based on empirical and theoretical evidence

Close modal

p = set of variables that define system performance;

C = set of uncertain events or shocks;

R = set of variables that mediate the shock and determine the ultimate; and

f = relationship between P, C and R.

Considerable variation exists across disciplinary areas on how resilience is achieved. The three-pronged model emphasizing absorptive, adaptive and restorative properties (El Korchi, 2022; Biringer et al., 2010) offers a structural approach for aligning resilience capabilities to post-disruption phases. In the supply chain literature, frameworks incorporating resilience capabilities have been proposed – the most popular being that developed by Christopher and Peck (2004) which contains four vital capabilities:

  1. supply chain (re)engineering;

  2. collaborative risk identification and management;

  3. agile response to risk events; and

  4. development of a risk management culture.

Each is further supported by several essential capabilities. Other researchers have emphasized attributes such as knowledge of internal and external supply chain risks, sustainability, redundancy, flexibility, visibility, information technology (IT) capability, information sharing, robustness, awareness, security, velocity, adaptability, market position, risk control, revenue sharing, public-private partnerships and supply chain network design (MIT Technology Review, 2020; Singh et al., 2019; Christopher, 2011; Sheffi and Rice, 2005). Zsidisin and Wagner (2010) emphasize building flexibility and redundancy to offset supply disruptions. A useful structural approach for identifying resilience capabilities and potentially linking to the three-pronged model is offered by Wied et al. (2019) who suggest asking three questions: “Resilience of what?”, “Resilience to what?” and “How should resilience be designed?”

Given this general conceptualization of resilience, VSC resilience can be described as the ability to buffer a disruption following an unexpected disturbance of the VSC flows by cultivating a set of capabilities that facilitate recovery to a desired or planned performance level. During a mass vaccination campaign, the VSC goes through several phases. Initially, production is ramped up rapidly, after which a relatively steady state of alignment between supply and demand occurs, followed by a decline as the campaign comes to an end. While disturbances can occur at any point, the initial phase is typically the most vulnerable.

Research on mass vaccination supply chain resilience capabilities during a pandemic is sparse (Qrunfleh et al., 2023; Joshi and Sharma, 2022; Golan et al., 2021b) and generally reflective of early investigations into a new area. Interest in supply chain resilience, and more specifically VSC resilience, only sparked during the COVID-19 pandemic following disruptions in multiple global supply chains.

To evaluate the work already undertaken on VSC resilience capabilities and establish a gap in the literature, SCOPUS and PubMed databases were searched using the keywords “COVID-19” AND “vaccine* AND “supply chain” AND “resilien*.” The search retrieved 70 documents from SCOPUS and 22 from PubMed. In addition, 14 articles were selectively retrieved from Google Scholar. From a total of 106 articles, duplicate papers, books and publications not relevant to the topic were removed. The remaining 31 articles that were reviewed fell broadly into two groups: qualitative analysis and the development of mathematical models.

In the area of qualitative research, various authors have conducted exploratory studies to identify the challenges in different parts of the COVID-19 VSC and recommend solutions to cope with individual challenges using a risk management approach. Hartner et al. (2024) conducted a rapid review of factors impacting immunization in low- and middle-income countries. The analysis revealed that health-care staffing shortages and vaccine stockouts were key disruptive factors. To combat the challenges, the authors recommended strengthening community outreach and health-care provider support but did not describe how this should be done. Ferranna (2024) conducted a comprehensive review that identified vaccine nationalism, intellectual property rights, manufacturing capacity limitations, poor health-care systems and vaccine hesitancy as disruptors to equitable vaccine allocation in low-income countries. The authors recommended increasing local manufacturing capacity; investing in health-care systems, cold chain equipment and infrastructure; training health-care workers; collecting data; engaging in outreach activities; and negotiating international agreements to resist the disruptions. Maramba et al. (2023) investigated the performance of supply chains and developed a case study for the acquisition and distribution of COVID-19 resources in South Africa. The authors reported that material shortages, broken distribution systems, insufficient vaccines and poor allocation of vaccine administration staff were major issues. To solve these problems, they suggested bolstering transport and logistics capacity. Mekonen et al. (2024) conducted a systematic review of the difficulties, impacts and opportunities of the global health commodities supply chain, including the COVID-19 VSC. The authors reported that insufficient manufacturing capacity, poor transport and cold chain systems, difficulty in monitoring vaccine uptake, poorly organized local entities, lack of vaccine monitoring bodies, monetary constraints, forecast inaccuracy, vaccine hesitancy and a lack of volunteer interest were responsible for disruptions. They recommended that stakeholders define, map and prioritize the challenges associated with vaccine development, manufacturing, delivery and administration for developed and low- and middle-income countries. However, specific recommendations on resilience capabilities were not offered. Golan et al. (2021a) reviewed the resilience literature pertaining to nanotechnology-based product supply chains, including VSCs. They recommended that standardization, network science, stakeholder accountability and scalability principles be applied in designing resilience. Bown (2023) reported on the market failures that impacted the supply of COVID-19 vaccines and justified domestic subsidies to strengthen supply chain performance. Pennisi et al. (2024) identified cold chain logistics, infrastructure, partnerships, cultural competency, community engagement, social factors and health-care infrastructure as essential to implementing VSC resilience. Gress et al. (2021) undertook a systematic review of newspaper comments on the Mexican Government’s handling of COVID-19 vaccine distribution and based on their findings, proposed a new design for the humanitarian supply chain. Marceau and Parwani (2021) examined the role of the World Trade Organization in facilitating cross-border vaccine flows and equitable distribution, while Fahrni et al. (2022) identified opportunities to strengthen distribution equity, improve logistics and enhance vaccine stability.

Among the researchers focusing on the COVID-19 VSC, Feddema et al. (2023) and Forman et al. (2021) stand out for using a systematic approach to identify potential disruptive forces and propose corresponding risk mitigation strategies. Feddema et al. (2023) conducted a scoping review in addition to undertaking 80 interviews and roundtable discussions. Based on the results, the authors proposed increased focus on production, allocation, technology transfer and regulatory alignment. However, this study was limited to disruptions in manufacturing operations. On the other hand, Forman et al. (2021) addressed disruptions in the end-to-end value chain, highlighting disturbances at the research and development, production and allocation stages. Disruptors identified included shortages of materials, low production capacity, poor cold chain infrastructure, criminal activity, pricing differentials, vaccine nationalism, vaccine hoarding and vaccine hesitancy. Suggestions offered to improve performance emphasized inventory buffers, joint patent purchases, compulsory licensing, lifting of export bans, security and transparency, flexible appointment scheduling, inclusive vaccine campaigns, rapid response to side effects, data interoperability and legal risk mitigation. Despite having an extensive list, there are gaps in the recommendations.

Some authors have conducted bibliometric analyses to summarize the researchers, countries and topics contributing to the VSC disruption and resilience literature. Moosavi et al. (2022) performed a literature search, bibliometric analysis and citation analysis and summarized resilience strategies as production, supply chain redesign and government intervention. Qrunfleh et al. (2023) used Bibliometrix software to assess the importance of VSC resilience and mitigation strategies; and Joshi and Sharma (2022) used Bibliometrix and Biblioshiny packages to review articles from 2000 to 2020. However, because of the period selected, the analysis pertained mainly to the 2009 H1N1 virus and the polio epidemic of 2014, both of which were of a significantly smaller scale than COVID-19.

Other qualitative research studies fall more broadly under the pharmaceutical supply chain umbrella. For example, Ganguly and Farr (2024) applied Interpretive Structural Modelling to determine and rank the hurdles to resilience in pharmaceutical supply chains in India. Bastani et al. (2021a) applied a Grounded Theory Methodology to elucidate information on supply chain resilience models in the pharmaceutical industry during disasters. This study, however, was limited to the Iranian context without specific emphasis on VSCs or pandemic situations. In a closely related study, Bastani (2021) conducted a content analysis to identify approaches to improve pharmaceutical supply chain resilience under politico-economic sanctions. Although the study identified several important factors, it also focused on the Iranian sector and was not specific to VSCs.

The second strand of research on VSCs focuses on developing mathematical models to optimize, improve or enhance VSC performance. Bamakan et al. (2021) identified 18 factors that caused the bullwhip phenomenon in the COVID-19 VSC and had 13 of these factors ranked by 72 pharmaceutical industry experts using Analytical Hierarchy Process. A fuzzy cognitive map of the influential factors was developed from this analysis. Golan et al. (2021b) conducted a systematic review of modeling techniques applied to improve supply chain resilience. The authors recommended the use of emerging technologies to better quantify the tradeoffs between efficiency and resilience. They also suggested that modeling of VSCs should incorporate the impact of one vaccine network on another because of common nodes inserted in the supply chains (e.g. raw material suppliers, cold chain infrastructure and logistics providers). Other mathematical models that may be of interest to the reader include the works of Jahed et al. (2024), Mahmud et al. (2023)Rinaldi et al. (2023), Apoorva et al. (2022), Kazancoglu et al (2022), Shahparvari et al. (2022), Sinha et al. (2022), Verma et al. (2022) and Miguel et al. (2021).

After reviewing the current literature, one obvious limitation of the studies is that resilience is equated to traditional risk management, where each disruptor is viewed as being contained within a part of the VSC and matched to a corresponding solution using a linear cause-and-effect approach. The VSC, however, is a complex system (Trump et al., 2022) consisting of multiple interacting sub-systems. Because of these interconnections, a disruption in one part could quickly spiral out of control if the system lacks the capabilities to surmount the disturbance on its own and prevent performance loss. Christopher (2011) recognizes the vital capability of being able to shift back to a prior performance level and identifies key resilience characteristics to resist such disturbances. From a more systemic perspective, Trump et al. (2022) propose implementing VSC resilience capabilities through intentional design (e.g. qualification of multiple suppliers and use of interchangeable parts) and intentional intervention (e.g. government investment in multiple manufacturers) (Trump et al., 2022).

Given this analysis, there remain a few gaps in the literature to be filled. The core resilient capabilities of VSCs first need to be identified and then mapped to specific operational and policy solutions for each of the seven critical flows in the VSC as identified by Lawrence (2024). Another opportunity exists to break down the top-level capabilities into detailed supporting capabilities. Thirdly, among the studies reviewed, only one researcher (Joshi and Sharma, 2022) applied cluster analysis to bibliometric analysis. Because of the systemic nature of the VSC, an opportunity also exists to perform a cluster analysis to identify the associations and relationships between the resilience capabilities.

To extract data on the insights, opinions, experiences and recommendations from experts, content analysis was used as an exploratory technique. Content analysis is well regarded as a systematic, structured and replicable approach for analyzing written, oral and visual data (e.g. transcripts, focus group interviews, survey responses and books) and for describing, analyzing and synthesizing the data into meaningful categories to understand a phenomenon or event (Elo and Kyngäs, 2007; Cho and Lee, 2014). Content analysis is also used to extract and identify patterns and contextual meaning to better understand a situation for which little information is available or for which actions have been taken during a past event (Van Note Chism et al., 2008) While other qualitative methods develop theory through an open-ended coding process, content analysis is useful for extracting data to answer specific research questions that typically ask “what?”, “why?” and “how?” (Heikkilä and Ekman, 2003, p. 138 as cited in Cho and Lee, 2014).

To perform a content analysis, the researcher collects the data by studying the output of participants in a naturalistic setting where the problem is addressed or experienced (Creswell and Creswell, 2018). From the data gathered, only relevant data is coded and categorized. Content analysis is flexible in allowing inductive, deductive or combined inductive/deductive coding approaches (Creswell and Creswell, 2018; Cho and Lee, 2014). Inductive analysis derives themes from the bottom up by organizing data into increasingly broad and abstract categories through an intensive iterative process that analyzes, compares and aggregates the codes, while deductive analysis establishes code categories at the outset of the study or from theory or past research (Elo and Kyngäs, 2007). In either case, categorization is flexible and allows the researcher to code both explicit and implied meanings in the data (Hsieh and Shannon, 2005). Given these characteristics, we found content analysis to be the most suitable method to answer the research questions for the following reasons:

  • The research questions were specific rather than open-ended.

  • The approach could be applied to diverse data types, for example, audiovisual presentations and documents.

  • The method allowed for an appropriate sample size, given time constraints and the impracticability of convening high-level experts during the COVID-19 crisis.

  • Large volumes of data on VSC challenges and solutions to support mass vaccination campaigns were disseminated in near real-time in the public domain, providing a rich stream of information that would have otherwise been difficult to replicate at the end of the pandemic.

  • A significant amount of data in the public domain was produced in verbal form. Requiring experts to provide this information in written form via surveys or questionnaires would likely have resulted in data being filtered, condensed, diluted or omitted.

  • Obtaining the viewpoints and experiences of high-level subject matter experts globally would have been difficult without the intermediary role of organizations that hosted symposia, webinars and other meetings.

  • The intervening role of national governments and international organizations in mass vaccination endeavors required private sector companies, for example, pharmaceutical companies, to cooperate in providing information that might otherwise have been withheld.

  • Content analysis diversifies the research methodologies commonly used in supply chain management research (Williams et al.., 2017; Kauffman and Denk, 2011).

To achieve the goals of this study, diverse data sources were used. In all, 36 data sources comprising audiovisual presentations of symposia, workshops and webinars and documents consisting of reports, white papers, Web pages and academic publications were selected (Table 3).

Table 3

Organization type of participants in audiovisual presentations

Organization type# participantsOrganization type# participants
University19Regulatory agency3
International organization17Cargo airline3
Pharmaceutical developer/manufacturer14Intelligence/analytics company2
Consulting firm9Think tank2
Professional alliance/trade association9Health-care provider/mass vaccination site/hospital2
Government (federal, state and national)9Pharmaceutical supplier1
Logistics company8Distribution company1
IT/computer software company4Development bank1
  Other4
  Total108
Source: Author’s own creation/work

4.1.1 Audio-visual sources: Videos of symposia, workshops, meetings and webinars

To extract data on COVID-19 VSC resilience capabilities, YouTube was selected as the primary source for capturing data from the audio-visual presentations of senior professionals and subject matter experts. YouTube is frequently used as a data source for academic research in the medical, sociological and biological domains (Allgaier, 2020) and particularly for studies on emergency disasters (Rout et al., 2024; Jamil Uddin et al., 2023; Slick, 2019; Owens et al., 2013; Hussin et al., 2011; Ravitz et al., 2010).

Furthermore, YouTube is the most used streaming video platform globally (Restream, 2022) and the most popular in the USA after Google (Statista, 2022). Daily mobile views surpass 1 billion with an average viewing time exceeding 45 min (GMI, 2020). In a study conducted during the COVID-19 pandemic, over 81% of respondents claimed to have used YouTube (Suciu, 2021), demonstrating its worth as an important information-sharing platform. YouTube was used by many highly regarded organizations to rapidly share emerging information discussed at meetings to address the challenges and solutions of the COVID-19 VSC. The proceedings of high-level panel discussions organized by public and private entities, including intergovernmental organizations, academic groups and consulting companies studying, designing, leading, and managing the VSC, were posted on YouTube. Given the time constraints for this study, the resources available and the difficulty in reaching high-level professionals during a global emergency, YouTube offered reachability and accessibility to a critical source of data that might otherwise have been ignored.

For this study, a sample size of 20–30 was targeted per the recommendations for Grounded Theory (Marshall et al., 2013: Sandelowski, 1995), which can also be applied to content analysis. The search term “COVID vaccine supply chain” was used to select appropriate data sources on the COVID-19 VSC during the two years from March 2020, when the World Health Organization (WHO) declared the COVID-19 pandemic, to April 2022, when advanced countries began removing pandemic restrictions. The search term was intentionally kept broad to obtain all relevant YouTube presentations. The top 201 audiovisual recordings retrieved plus one additional recommended presentation were selected for further review and analysis.

The recordings were initially sorted based on title; duplicates were removed; and the remaining presentations were examined for compliance with the inclusion criteria. A salient requirement was the credibility of the organizations providing the data. International organizations, government agencies, universities, consulting companies, professional associations and trade associations deemed credible were considered acceptable. The content also needed to be delivered by subject-matter experts in an area pertinent to the COVID-19 VSC. Examples of acceptable individuals included senior officers from pharmaceutical, distribution, logistics, transportation and freight forwarding companies; international organizations; regulatory bodies; trade, customs and border protection; health-care administrators and practitioners; government employees appointed to lead and manage the VSC; and university professors in engineering, supply chain, logistics, management, international trade, economics and health care. Presentations by politicians, such as Congressional Hearings, were excluded. Other requirements were a minimum duration of 30 min for each event, which eliminated approximately 90% of YouTube presentations on short news stories, updates and advertisements. The final criterion was the delivery of the presentations in the English language.

From an initial number of 202 audiovisual presentations, 21 events consisting of 108 participants and representing 30 h of recorded time were selected. Transcripts accounting for 18.5 h were downloaded and reviewed for accuracy, spelling and punctuation against the audio recordings to ensure the correct capture of the transcribed data. This was a necessary, though time-consuming, step as the transcripts often lacked proper punctuation and the voice recognition software sometimes failed to transcribe correctly because of speaking style, pronunciation, enunciation, etc. The remaining presentations (10.5 h) were transcribed manually to text using MS Word over several weeks, and the transcribed data was cross-checked twice. The first check was concurrent with manual transcription and involved replaying the audio presentation multiple times to ensure correct transcription. The second review was a verification of each transcript against the original audiovisual presentation. The complete process of accessing, correcting, checking and rechecking the transcripts was performed over approximately four months. Table 3 and  Appendices 1 and  2 provide summary and detailed information on the titles and affiliated organizations of the 108 contributors/panelists in the study.

4.1.2 Written sources: Reports, white papers, websites and academic publications

Other important data sources were the documents authored by academics, companies and individuals and interviews published on websites. In all, 15 documents consisting of white papers, reports and academic papers were selected from targeted authors and reputable organizations. The documents varied in scope and impartiality, and following a review for relevance and appropriateness in the context of COVID-19 VSC resilience, 14 papers were selected for data extraction. Additionally, data was extracted from short interviews published on the website of an international organization. Table 4 summarizes the number and type of all data sources used in the study.

Table 4

Sources of data

Data sourceNo.
Audiovisual presentations21
Documents14
Websites1
Total # of sources selected for coding36
Source: Author’s own creation/work

The transcripts and other documents were imported into NVivo 12 software, and each document was read meticulously, line by line. Immersion was used to gain a full understanding of the contents to guide the development of categorical codes. A single coder was used throughout to ensure coding consistency. An inductive coding approach was initially applied to the data using an iterative process that required repeated review, query and reflection (Moretti et al., 2011). To reduce the number of nodes, the codes were condensed into increasingly broader categories, with the highest-level categories determined using a mixed inductive/deductive approach based on the researcher’s extensive supply chain management knowledge, experience and previous exploratory work (Lawrence, 2024). Deductive codes were developed to align with mass VSC flows prone to disruption during a pandemic. For this study, data collection, cleansing and coding were conducted over approximately nine months (Figure 4).

Figure 4

Methodology for study – qualitative content analysis

Figure 4

Methodology for study – qualitative content analysis

Close modal

To further identify similarities in the data, cluster analysis was used to analyze the sources, primary factors and sub-factor in a comparison matrix. The sources of data were clustered based on word similarity and evaluated using Pearson’s correlation coefficient (r), while the coded data was clustered based on coding frequency and evaluated using Jaccard’s coefficient. Pearson’s correlation coefficient (r) measures the extent of linear association by calculating the covariance between two variables of interest. As in quantitative analysis, values range from −1.0 to 1.0, with 1.0 indicating a perfect positive correlation between the two variables and −1.0 indicating perfect negative correlation. An r value of 0.7 or greater indicates a very strong relationship between two variables [equation (4)]:

(4)

Where:

  • r = Pearson correlation coefficient;

  • xi = value of x-variable in sample;

  • x¯=mean value of x variables;

  • yi = value of y-variable in sample; and

  • ȳ = mean value of y variables.

Jaccard’s similarity coefficient is used to measure the similarity between two finite sets of data by comparing the size of the intersection to that of the union of the data sets. Values range from 0 to 1, with 0 denoting an intersection of 0 and 1 an intersection equal to the union of the two sets [equation (5)]:

(5)

Where:

  • A = Data set 1 (Source A); and

  • B = Data set 2 (Source B).

Criteria to evaluate a content analysis for validity and reliability is lacking in the literature. However, the recommendation is to use the same criteria for general qualitative research (Elo and Kyngäs, 2007; Cho and Lee, 2014). In qualitative research, validity refers to the accuracy of inferences drawn from a study from the researchers’, participants’ or reviewers’ perspectives (Creswell and Miller, 2000). According to Creswell and Miller (2000), the validity method used should depend on the lens researchers select to validate their studies and the researchers’ paradigm assumptions.

4.3.1 Validity

For this study, the methods proposed by Creswell and Miller (2000), Cho and Lee (2014) and Creswell and Creswell (2018) were used to establish validity from the researcher’s perspective and from constructivist and critical perspective paradigms. Regarding the first, validity was established through the length of the study, the use of appropriate sample size and composition, the achievement of an acceptable level of saturation and an iterative process for reflecting on and revising the assigned codes to ensure accurate interpretation and categorization of participants’ contributions. An iterative process was used to narrow the categories to relevant themes and eliminate overlapping themes.

Validity was also established using constructivist and critical perspectives paradigms based on trustworthiness (also described as credibility, transferability, dependability and confirmability), authenticity (e.g. fairness) and reflection on potential researcher bias. Credibility was established using data triangulation, whereby the same approach was applied to analyze data from different sources to verify or falsify trends perceived in the data. Transferability (applicability) was established by setting the context of the study as the COVID-19 pandemic. According to Creswell and Creswell (2018), a detailed description that allows readers to determine whether the data can be transferred to other scenarios can be used as a validation method. Dependability (consistency) was established by ensuring all coding was meticulously recorded. The role of the researcher’s supply chain background was also examined in deriving the codes. While the codes were primarily determined using an inductive approach, the researcher’s understanding and knowledge of supply chain management helped to develop some code descriptions deductively.

4.3.2 Reliability

While there is a lack of consensus on what constitutes reliability in qualitative research, it is generally agreed that consistency in coding, rather than exact replication of methods and results (Carcary, 2009), is appropriate to establish reliability. Mason (2002) notes that from an interpretivist’s view, reliability is about providing evidence that the researcher has not invented or misrepresented data or been negligent in data recording and analysis. Grossoehme (2014) recognizes that the researcher is an integral part of the subject of the study and will influence it; however, this does not diminish the reliability of the study but, rather, improves it. Creswell and Creswell (2018) suggest documenting the procedures employed in detail so that another researcher can follow the methodology and produce similar results. Silverman (2009) proposes constant comparison and the use of comprehensive data, including data that deviate from expected results, while Gibbs (2007) recommends that transcripts are checked for accuracy; a single coder is used to ensure consistency and a codebook is established to document the results. The data derived from sources must be continually checked for accuracy and context by a single coder or multiple coders.

For this study, reliability was established in three ways. First, through an extensive iterative process, the codes were reflected on and refined by an experienced supply chain specialist to categorize chunks of data, while also comparing similarly coded data from different sources to ensure consistency. Secondly, multiple sources were used to increase the reliability of the findings. Thirdly, as coding was conducted by a single person, reliability was established through intra-rater repeatability by coded documents at least six months apart. In all, 50 samples were pulled from the data sources using a simple random number generator. For each document, excerpts were randomly selected, coded and compared to the previously coded document and assessed using a binary yes/no approach. The results indicated over 90% agreement at the sub-factor Level 1 and sub-factor Level 2 echelons.

In this study, 36 sources of data were imported into NVivo 12, read, analyzed and coded. Through the iterative process of code refining, two of the data sources, which were both academic papers (Sources 22 and 29) ( Appendix 1), were found to provide little data in support of VSC resilience capabilities, essentially reducing the number of sources to 34.

What primary capabilities are essential to building resilience in VSCs supporting a mass vaccination operation during a pandemic?

Through an iterative coding process, 2,246 coded references were categorized into seven primary factors essential to resilience in VSCs during a pandemic. Agility accounted for over 51% of the codes, stressing the vital importance of rapid assembly and deployment of the VSC to meet critical volume requirements. Risk Mapping, Modeling, Planning and Control (Risk MMPC) followed at 15.2% of the codes. Inter-organizational, Cross-sector and Cross-Border Collaboration (ICC Collaboration) amassed 12.9% of the codes, and Network Planning and Design (Network P & D) received 9.9%. The final three categories accounted for 10.8% of the codes: Supply and Demand Planning and Coordination received 4.3%, Complex system Management Skills 4.2% and Pre-pandemic Preparedness 2.3% of the codes (Figure 5).

Figure 5

Relative importance of the seven primary dimensional factors driving resilience in mass vaccination supply chains

Figure 5

Relative importance of the seven primary dimensional factors driving resilience in mass vaccination supply chains

Close modal

What sub-factor resilience capabilities underpin the primary resilience capabilities and how should these be categorized and prioritized?

An analysis of the sub-factors that underpin the resilience properties of each of the seven primary factors provides deeper insights into where and how resilience needs to be built in VSCs. The data were sorted into 44 Level 1 and 145 Level 2 sub-factor categories, with Level 1 sub-factors disaggregated to align to each of the seven critical VSC flows as identified by Lawrence (2024) – that is, product flow, financial flow, information flow, vaccine recipient flow, knowledge flow, skilled worker flow and waste flowAppendix 2). Level 2 sub-factors detail specific ways in which resilience can be operationalized in each VSC flow. Figure 6 demonstrates the coding hierarchy.

Figure 6

Coding hierarchy of resilience properties

Figure 6

Coding hierarchy of resilience properties

Close modal

5.2.1 Agility

Based on the flows identified in the VSC during a pandemic (Lawrence, 2024), seven Level 1 categories of sub-factor capabilities were identified to support the primary factor Agility. Data analysis revealed that Agility capabilities of Product Flows were the most frequently coded category, followed by Agility capabilities of Information, Financial and Knowledge Flows in that order. Significantly less emphasis was placed on the Agility capabilities of Skilled Worker, Vaccine Recipient and Waste Flows. The radial graph in Figure 7 depicts the relative importance assigned to each of the respective Level 1 factors.

Figure 7

Level 1 resilience sub-factors supporting primary factor, agility

Figure 7

Level 1 resilience sub-factors supporting primary factor, agility

Close modal

Further data analysis indicated that 52 Level 2 sub-factors are required to support the Agility Level 1 sub-factors. Of these, 14 fell in the top 80% based on coding frequency (Table 5). A complete list of Level 2 sub-factors supporting Agility Level 1 sub-factors is provided in  Appendix 3.

Table 5

Top 80% most frequently coded agility Level 2 sub-factors

Primary factorLevel 1 sub-factorLevel 2 sub-factor capabilities
AgilityAgility – Product flowExpediting of in-country and cross-border flows
  Rapid ramp-up of supplier and manufacturer capacity
  Rapid ramp-up of vaccination capacity
  Implementation of redundancy strategies in vaccine development, manufacturing and logistics
  Continuous improvement of speed (takt time, cycle time)
  Flexibility, substitutability and interchangeability of materials, equipment, infrastructure
  Rapid ramp-up of warehouse, logistics and distribution capacity
  Implementation of national and international policies and actions to facilitate the flow of inputs and vaccines
 Agility – Information flowImplementation of process simplification, integration and digitalization
  Implementation of information-sharing platforms via physical and electronic means
 Agility – Financial flowInvestment at risk in vaccine development and production
 Agility – Vaccine recipient flowDevelopment/use of diverse vaccine advertising and promotion strategies
 Agility – Knowledge flowCross-border transfer of technology
  Training in regulatory requirements, manufacturing, inventory management, cold chain logistics and immunization processes
Source: Author’s own creation/work

5.2.2 Risk mapping, modeling, planning and control (Risk MMPC)

Mounting a global mass vaccination campaign involves an exorbitant amount of risk, from the selection of vaccine technology to determining the quantity and timing of vaccine doses to meet herd immunity goals. Because of the unpredictable nature of a pandemic, risks are generally not known or understood in advance. Capabilities must, therefore, be developed to rapidly map, model, plan and control the risks as they occur during a pandemic.

Based on the flows identified in the VSC during a pandemic (Lawrence, 2024), seven Level 1 categories of sub-factor capabilities were identified to support the primary factor Risk MMPC. Analysis of the data revealed that Risk MMPC capabilities of Product, Financial and Waste Flows were coded most frequently. Risk MMPC of Vaccine Recipient Flows was addressed moderately, while minimal emphasis was placed on Risk MMPC of Knowledge, Information and Skilled Worker Flows (see the radial graph in Figure 8).

Figure 8

Level 1 resilience sub-factors supporting primary factor, risk mapping, modeling, planning and control (Risk MMPC)

Figure 8

Level 1 resilience sub-factors supporting primary factor, risk mapping, modeling, planning and control (Risk MMPC)

Close modal

Further data analysis identified 27 Level 2 resilience sub-factors, supporting Level 1 Risk MMPC sub-factors. Of these, six fell in the top 80% of Risk MMPC Level two factors based on coding frequency (Table 6). A complete list of Level 2 sub-factors supporting Risk MMPC Level 1 sub-factors is provided in  Appendix 4.

Table 6

Top 80% most frequently coded risk MMPC Level 2 sub-factors

Primary factorLevel 1 sub-factorLevel 2 sub-factor capabilities
Risk MMPCRisk MMPC – Product flowMapping of input, manufacturing, cold chain and vaccine supply bottlenecks
  Supply strategies to minimize stockouts
 Risk MMPC – Financial flowInvestment in capacity at risk by the private sector, government and international organizations
 Risk MMPC – Vaccine recipient flowUse of diverse strategies to reduce vaccine hesitancy
 Risk MMPC – Waste flowImplementation of strategies to minimize waste from contamination, damage, expiry, criminal activity and temperature deviations
  Identification and prioritization of security and other threats
Source: Author’s own creation/work

5.2.3 Inter-organizational, cross-sector and cross-border collaboration (ICC collaboration)

Mass vaccination is an endeavor that requires global collaboration, as well as local organizational and cross-sectoral collaboration. Based on the COVID-19 pandemic, the most frequently discussed type of collaboration entailed partnerships and alliances to enable rapid product flow.

Based on the identified flows in the VSC (Lawrence, 2024), seven Level 1 categories of sub-factor capabilities were identified to support the primary factor ICC Collaboration. Of these, ICC Collaboration to build resilient Product Flows was cited most frequently. ICC Collaboration to facilitate Financial Flow resilience was also highly discussed. ICC Collaboration pertaining to Information, Knowledge and Vaccine Recipient Flows was discussed moderately to minimally. ICC Collaboration to achieve Waste Flow resilience received minimal attention and ICC Collaboration for Skilled Worker Flows received no attention (see the radial graph in Figure 9).

Figure 9

Level 1 resilience sub-factors supporting primary factor, inter-organizational, cross-sector and cross-border collaboration (ICC collaboration)

Figure 9

Level 1 resilience sub-factors supporting primary factor, inter-organizational, cross-sector and cross-border collaboration (ICC collaboration)

Close modal

From the data, 17 Level 2 resilience sub-factors supporting ICC Collaboration Level 1 sub-factors emerged. Of these, five fell in the top 80% of ICC Collaboration Level two factors based on coding frequency (Table 7). A complete list of Level 2 sub-factors supporting ICC Collaboration Level 1 sub-factors is provided in  Appendix 5.

Table 7

Top 80% most frequently coded ICC collaboration Level 2 sub-factors

Primary factorLevel 1 sub-factorLevel 2 sub-factor
ICC collaborationICC Collaboration – Product flowCollaboration to build cold chain capacity, air cargo logistics, transportation and last mile delivery capacity
  Collaboration to expand and improve supplier and manufacturer capacity and procurement
  Collaboration for vaccine research and development and regulatory approval
  Collaboration for cross-border management
 ICC Collaboration – Financial flowGovernment subsidization of manufacturing capacity
Source: Author’s own creation/work

5.2.4 Network planning and design

VSC networks supporting routine immunization during normal times quickly collapse during a pandemic because of speed, volume, scalability and reach requirements. To maintain high stakeholder satisfaction levels, a well-designed resilient end-to-end supply chain network is essential.

Based on the flows identified in the VSC, seven Level 1 categories of sub-factor capabilities were identified to support the primary factor, Network Planning and Design. Of these, Network Planning and Design to facilitate Product Flow resilience overwhelmingly received priority. All other factors were minimally addressed (see the radial graph in Figure 10).

Figure 10

Level 1 resilience sub-factors supporting primary factor, network planning and design (Network P&D)

Figure 10

Level 1 resilience sub-factors supporting primary factor, network planning and design (Network P&D)

Close modal

From the data, 14 Level 2 resilience sub-factors supporting Network Planning and Design Level 1 sub-factors were identified. Of these, three fell in the top 80% of Network Planning and Design Level 2 factors based on coding frequency (Table 8). A complete list of Level 2 sub-factors supporting Network Planning and Design Level 1 sub-factors is provided in  Appendix 6.

Table 8

Top 80% of most frequently coded network planning and design (network P&D) Level 2 sub-factors

Primary factorLevel 1 sub-factorLevel 2 sub-factor
Network P&DNetwork P &D – Product flowDesign of distribution and logistics network for reach and scalability
  Design to ensure adequate cold chain infrastructure and capacity
  Design for manufacturing scalability
Source: Author’s own creation/work

5.2.5 Supply and demand planning and coordination

During normal times, planning and coordination of inventory flows require tremendous skill to avoid stockouts and potential penalties. During a pandemic, the processes are even more critical, as the needs of all potential recipients must be met expediently and equitably.

Based on the flows identified in the VSC during a pandemic (Lawrence, 2024), seven Level 1 categories of sub-factor capabilities were identified to support the primary factor Supply and Demand Planning and Coordination (see the radial graph in Figure 11). Of these, Supply and Demand Planning and Coordination supporting the resilience of Product Flows was the most extensively discussed.

Figure 11

Level 1 resilience sub-factors supporting primary factor, supply and demand planning and coordination

Figure 11

Level 1 resilience sub-factors supporting primary factor, supply and demand planning and coordination

Close modal

From the data, ten Level 2 resilience sub-factors supporting Supply and Demand Planning and Collaboration Level 1 sub-factors were identified. Of these, three fell in the top 80% based on coding frequency (Table 9). A complete list of Level 2 sub-factors supporting Network Planning and Design Level 1 sub-factors is provided in  Appendix 7.

Table 9

Top 80% of most frequently coded supply and demand planning and coordination (supply and demand P&C) Level 2 sub-factors

Primary factorLevel 1 sub-factorLevel 2 sub-factor
Supply and demand P&CSupply and demand P&C – Product flowManagement and synchronization of inventory (inputs, doses, ancillary supplies)
  Allocation, logistics, distribution, and administration of vaccines
  Use of appropriate forecasting techniques
Source: Author’s own creation/work

5.2.6 Pre-pandemic preparedness

Although a pandemic is a rare catastrophic event, lessons from the COVID-19 pandemic suggest that some actions can be taken in advance to support the resilience of mass VSCs.

Based on the identified flows in the VSC (Lawrence, 2024), seven Level 1 sub-factor capabilities are required to support the primary factor Pre-Pandemic Preparedness (see the radial graph in Figure 12). Of these, Pre-pandemic Preparation to support the resilience of Product Flows was the most heavily discussed. Pre-pandemic Preparation of Financial, Knowledge and Vaccine Recipient Flows was moderately discussed, while Pre-pandemic Preparation of Information, Skilled Worker and Waste Flows was not addressed.

Figure 12

Level 1 resilience sub-factors supporting primary factor, pre-pandemic preparation

Figure 12

Level 1 resilience sub-factors supporting primary factor, pre-pandemic preparation

Close modal

From the data, 13 Level 2 resilience sub-factors supporting Pre-Pandemic Preparedness Level 1 sub-factors were identified. Of these, three fell in the top 80% based on coding frequency (Table 10). A complete list of Level 2 sub-factors supporting Pre-pandemic Preparedness 1 sub-factors is provided in  Appendix 8.

Table 10

Top 80% of most frequently coded pre-pandemic preparation Level 2 sub-factors

Primary factorLevel 1 sub-factorLevel 2 sub-factor
Pre-pandemic preparednessPre-pandemic preparedness – product flowPre-Pandemic global development of supplier, manufacturing, logistics and distribution capacity
  Validation of processes, equipment and routes
  Development of contingency plans for product flow changes
  Pre-pandemic development of vaccine technologies
  Negotiation of public-private sector contracts for vaccine distribution during a pandemic
 Pre-pandemic preparedness – financial flowPre-Pandemic investment planning
Source: Author’s own creation/work

5.2.7 Complex system management skills

The VSC deployed during a pandemic is a complex system of systems that requires a set of unique management skills to achieve the overall goal of herd immunity. As for other complex systems, achieving this outcome requires significant interactions between various entities and sub-systems. From the data, two broad categories of Complex System Management Skills emerged – namely, system management skills and globally responsible leadership. The overwhelming number of references fell under system management skills (Figure 13).

Figure 13

Level 1 resilience sub-factors supporting primary factor, complex system management skills

Figure 13

Level 1 resilience sub-factors supporting primary factor, complex system management skills

Close modal

Complex System Management Skills comprised 12 of the Level 2 sub-factors. Of these, seven skills fell in the top 80% (Table 11). However, an important complex system management skill – the ability to work with ambiguity, complexity and uncertainty was not considered to any great extent, falling below the top 80% range. A complete list of Level 2 sub-factors supporting Complex System Management Skills Level 2 sub-factors is provided in  Appendix 9.

Table 11

Top 80% of most frequently coded complex system management skills Level 2 sub-factors

Primary factorLevel 1 sub-factorLevel 2 sub-factor
Complex system management skillsSystem management skillsCross-functional, inter-organizational, cross-sectoral and cross-border teamwork
  Ability to leverage lessons from past experiences for future success
  Open communication
  Ability to build vaccine trust
  Ability to develop multi-stakeholder collaborative relationships
  Ability to devise agile and adaptive strategies
 Globally responsible leadershipDevelopment of national government vaccine diplomacy programs
Source: Author’s own creation/work

What similarities and associations are evident between the primary resilience capabilities and the sub-factor resilience capabilities?

To determine the similarities and connections within the data, a cluster analysis was further performed on the sources of data, primary factors and Level 1 sub-factors. Data sources were clustered based on word similarity and evaluated using Pearson’s coefficient. Primary and Level 1 sub-factors were clustered based on coding similarity and evaluated using Jaccard’s coefficient. In each case, the coefficients were calculated for pairs of items in a matrix. The resulting similarities were depicted in hierarchical dendrograms and circle graphs. Hierarchical dendrograms indicate the degree of similarity through nested relationships, with the innermost nests having the strongest similarities. Lines connecting different factors in circle graphs indicate a relationship or similarity, with thicker lines indicating stronger similarities.

5.3.1 Cluster analysis of data sources based on word similarity

A cluster analysis of the data sources based on word similarity and assessed by Pearson’s correlation coefficient (r) indicated two large clusters roughly divided between the audiovisual presentations and the written sources, regardless of sector/industry. This is evident in the horizontal dendrogram in Figure 14. The Pearson coefficient (r) ranged from 0.1275 to 0.8738.

Figure 14

Dendrogram and circle graphs of data sources clustered by word similarity based on 36 data sources (meetings, webinars and symposia; white papers; and academic papers)

Figure 14

Dendrogram and circle graphs of data sources clustered by word similarity based on 36 data sources (meetings, webinars and symposia; white papers; and academic papers)

Close modal

The results depicted as a circle diagram indicated very strong similarities (r = 0.7–1.0) between 15 of the 21 audiovisual presentation sources when Pearson’s correlation coefficient was used to measure the associations. Moderate correlation (r = 0.5–0.7) was evident among all the sources (Figure 14).

5.3.2 Cluster analysis of primary factors based on coding similarity

The primary resilience capabilities were analyzed based on coding frequency, with clusters indicating similarities or associations arising from coding of a reference to more than one node. Several primary factor pairs exhibited strong similarities when Jaccard’s coefficient was calculated. The strongest relationships were denoted by the thickest lines, with very strong associations observed between Agility and Risk Mapping, Modeling, Planning and Control (J = 0.9412) and between Agility and Network Planning and Design (J = 0.8824). Table 12 summarizes the relationships with a Jaccard coefficient of 0.7–1.0. In the moderate range of 0.3–0.5, several similarities were also identified between the factors. These similarities may help to explain actual relationships (See Figure 15 for a dendrogram of these relationships; See  Appendix 10 for circle graph relationships; and Table 12 for connected pairs of primary factors in the matrix).

Table 12

Matrix of relationships between primary factor pairs with Jaccard coefficient > 0.70

Matrix pairsPrimary factor APrimary factor BJaccard coefficient
1AgilityRisk mapping, modeling, planning and control0.9412
2AgilityNetwork planning and design0.8824
3Risk mapping, modeling, planning and controlNetwork planning and design0.8235
4AgilityInter-organizational, cross-sector and cross-border collaboration0.8235
5Inter-organizational, cross-sector and cross-border collaborationRisk mapping, modeling, planning and control0.8181
6Inter-organizational, cross-sector, and cross-border collaborationNetwork planning and design0.7576
7Supply and demand planning and coordinationNetwork planning and design0.7419
8Complex system management skillsAgility0.7353
9Complex system management skillsNetwork planning and design0.7186
10Complex system management skillsInter-organizational, cross-sector and cross-border collaboration0.7059
Source: Author’s own creation/work
Figure 15

Dendrogram of data sources clustered by coding similarity

Figure 15

Dendrogram of data sources clustered by coding similarity

Close modal

5.3.3 Cluster analysis of Level 1 sub-factors based on coding similarity

A cluster analysis of Level 1 sub-factors based on coding similarity revealed that the strongest associations (Jaccard coefficients > 0.80) were observed between Supply and Demand Planning and Coordination and Network Planning and Design supporting financial flows and skilled worker flows; Inter-organizational, cross-sector and cross border collaboration and Risk mapping, modelling, planning and control supporting financial flows; and between Agility capabilities supporting product and information flows. These associations are represented in the horizontal dendrogram in Figure 16 and circle diagram in  Appendix 11. Table 13 indicates significant similarities (J > 0.7) for 13 pairs of Level 1 sub-causal factors.

Figure 16

Dendrogram of Level 1 sub-factors clustered based on coding similarity Jaccard coefficient range: 0–1

Figure 16

Dendrogram of Level 1 sub-factors clustered based on coding similarity Jaccard coefficient range: 0–1

Close modal
Table 13

Matrix of relationships between Level 1 sub-factor pairs with Jaccard coefficient > 0.70

Matrix pairsLevel 1 sub-factor ALevel 1 sub-factor BJaccard coefficient
1Supply and demand planning and coordination – financial flowNetwork planning and design – financial flow1.0000
2Supply and demand planning and coordination – skilled worker flowNetwork planning and design – financial flow1.0000
3Supply and demand planning and coordination – skilled worker flowSupply and demand planning and coordination – financial flow1.0000
4Inter-organizational, cross-sector and cross-border collaboration – financial flowRisk mapping, modeling, planning and control – financial flow0.9412
5Agility – information flowAgility – product flow0.8823
6Agility – product flowNetwork planning and design – product flow0.7647
7Agility – product flowInter-Organizational, Cross-Sector, and Cross-Border collaboration – product flow0.7576
8Agility – information flowNetwork planning and design – product flow0.7576
9Agility – financial flowInter-organizational, cross-sector, and cross-border collaboration – product flow0.7500
10Agility – financial flowAgility – product flow0.7273
11Agility – vaccine recipient flowNetwork planning and design – product flow0.7241
12Agility – financial flowRisk mapping, modeling, planning and control – financial flow0.7083
13Risk mapping, modeling, planning and control – product flowNetwork planning and design – product flow0.7000
Source: Author’s own creation/work

This study aimed to identify the critical resilience capabilities required to handle unexpected disruptions in VSCs deployed to support a mass vaccination campaign during a global pandemic. With the help of NVivo 12 software, audiovisual presentations of over 100 global experts, along with white papers, reports and other documents on the COVID-19 pandemic, were reviewed and analyzed using a rigorous iterative coding process over several months. More than two thousand raw coded references were derived from the source data and gradually consolidated into increasingly higher categories in accordance with the practice of content analysis. The results yielded a set of primary factors and supporting sub-factors essential to achieving VSC resilience in seven critical flows of mass VSCs.

The results of the study indicate that based on the COVID-19 context, VSC resilience during a pandemic can be achieved by developing resilience capabilities along seven primary lines:

  1. agility;

  2. risk mapping, modeling, planning and control;

  3. network planning and design;

  4. inter-organization, cross-sector and cross-border collaboration;

  5. supply and demand planning and coordination;

  6. pre-pandemic preparedness; and

  7. complex system management skills.

Given the unpredictable nature of a pandemic and its global spread, Agility capabilities emerged as the most critical primary factor. This is not surprising as pandemics occur rarely and without warning and the scale needed to arrest the disease may not justify the building of infrastructure that is unused during normal times. Instead, the ability to rapidly reconfigure supply chains to support all critical flows becomes imperative.

Regarding specific VSC flows, the data largely indicate that there is a strong awareness of the need to build resilience in product and financial flows, and to some extent, information flows. However, the limited attention afforded to building resilience in Knowledge, Vaccine Recipient, Skilled Worker and Waste Flows suggests that these areas may be assumed to be adequate to meet the needs of VSCs deployed in response to a pandemic. The infrastructural, policy and organizational decisions to support a global emergency effort of the scale of COVID-19 require greater attention.

To further strengthen resilience properties, the appropriate complex management system skills are integral to achieving the overarching goal of herd immunity. One of the most critical complex system management skills – the ability to work with ambiguity, complexity and uncertainty – was not emphasized in the discussions on the VSC. This capability fell in the bottom 20% of complex system management skills discussed in the data sources, suggesting that the systemic nature of mass vaccination supply chains may be unrecognized or poorly understood. Future considerations to develop a pipeline of complex system management talent will be essential to strengthen the deployment of resilient VSCs during a future pandemic. The implications are also relevant for team building and overall leadership and management of a complex VSC system.

While Pre-Pandemic Preparation was least emphasized in the discussions, it should not be construed that this dimension is irrelevant. Sub-factors supporting pre-pandemic preparedness reduce VSC risks that could lead to disruption and lay the groundwork for building agile response capabilities.

Several sub-causal factor capabilities to support resilience in the critical VSC flows emerged from the data. Of these, the major factors included the capability to: expedite cross-border flows through national and international policies; ramp up capacity across the end-to-end supply chain in manufacturing, cold chain infrastructure, air cargo, dry ice production and last mile delivery; implement redundancy strategies in vaccine research and development, manufacturing and logistics; implement flexibility, substitutability and interchangeability across raw materials and component parts; map end-to-end supply chain bottlenecks; develop strategies to minimize stockouts; collaborate at national and international government levels in subsidizing capacity, research and development and regulatory approval; develop information sharing platforms both physically and electronically; invest at risk in all stages of the VSC, particularly research and development and manufacturing; forecast, manage, synchronize and allocate materials and products in accordance with supply chain techniques; develop readiness strategies in vaccine research, production, regulation, option contract negotiation and investment planning; develop diverse strategies to promote vaccine safety and efficacy and avert vaccine hesitancy; and develop strategies to minimize waste through waste handling and sustainability policies and strategies.

From the Jaccard coefficient values, sub-causal factor associations were also identified, with the strongest associations between financial, skilled worker, product, information and vaccine recipient flows supporting the primary factors, Supply and Demand Planning and Coordination, Network Planning and Design, Inter-Organizational, Cross-Sector and Cross-Border Collaboration, Agility and Risk Mapping, Modeling, Planning and Control. What this suggests is that there are many dependencies, interconnections and cause-and-effect relationships that, when combined concurrently, reinforce resilience in mass vaccination supply chains.

Cluster analysis of the data provided some interesting insights into both the primary and Level 1 sub-causal factors. Cluster analysis performed on a qualitative data set provides exploratory rather than causality insights. However, the close association observed between several pairs of factors, for example, Agility and Risk MMPC; Agility and Network Planning and Design; and Agility and Inter-organizational, Cross-sector and Cross-border Collaboration, points to a complex VSC network with dependencies that exceed linear relationships and may need to be built and executed simultaneously to reinforce or achieve VSC resilience.

A pandemic of the scale of COVID-19 requires urgent containment to avoid disastrous consequences to human life, society and the economy. Presently, mass vaccination is considered to be the most effective way to immunize a population against a pandemic disease. However, because mass vaccination supply chains are complex systems, disruptions in one part can produce a domino effect of breakdowns that delay the attainment of herd immunity goals. To prevent this outcome, resilience capabilities must be built throughout the VSC to allow it to quickly adapt and recover from disruptions itself.

This study provides deep insights into the factors essential to VSC resilience during a pandemic. As an academic study, the results serve to complement and validate the information provided by practitioners and others on the COVID-19 pandemic. Using data from a wide spectrum of published and audiovisual sources, this study reports seven categories of resilience capabilities to reduce disturbances in mass vaccination supply chains. Each category of resilience capabilities is further aligned to the seven critical flows in the VSC (Level 1 sub-factors) and broken down into specific activities (Level 2 sub-factors) to achieve resilient flows. Through cluster analysis, associations between the resilience capabilities are identified, indicating where several strategies may be required simultaneously to reinforce VSC resilience.

While conducted as a comprehensive investigation of discussions at the highest levels globally, the research can be improved in several ways. First, the study used passive data extraction primarily from YouTube presentations, white papers, reports and academic publications, to reach a large number of high-level individuals involved with the VSC and the mass vaccination campaign. However, further clarification of data could be obtained through the use of focus groups, semi-structured interviews or surveys using a select pool of participants.

Opportunities also exist to verify and validate the priorities or weightings of the primary dimensions and underlying sub-factors. For example, weightings could be compared to the code frequency in this study to validate the findings. Data could also be limited to a particular country or region to focus on the specific issues manifested during the COVID-19 pandemic.

Other opportunities include using the results of this study as a starting point for conducting quantitative research related to hypothesis testing, structural equation modeling and the development of quantitative models to better explain resilience in VSCs. While data was extracted during the peak of the pandemic, retrospective reflection at the end of the pandemic could possibly elicit new details.

Through cluster analysis, this study provided insights into resilience capabilities that may be dependent or complementary. However, cluster analysis is an exploratory technique and further analytical work would be necessary to derive causality relationships.

Alam
,
S.T.
,
Ahmed
,
A.
,
Ali
,
S.M.
,
Sarker
,
S.
,
Kabir
,
G.
and
Ul-Islam
,
A.
(
2021
), “
Challenges to COVID-19 vaccine supply chain: implications for sustainable development goals
”,
International Journal of Production Economics
, Vol.
239
, p.
108193
.
Allgaier
,
J.
(
2020
), “
Rezo and German climate change policy: the influence of networked expertise on YouTube and Beyond
”,
Media and Communication
, Vol.
8
No.
2
, p.
2862
.
Apoorva
,
K.
,
Karimi
,
I.A.
and
Wang
,
X.
(
2022
), “
Global supply chain optimization for COVID-19 vaccine under COVAX initiative
”,
Computer Aided Chemical Engineering
, Vol.
49
, pp.
601
-
606
.
Bamakan
,
S.M.H.
,
Malekinejad
,
P.
,
Ziaeian
,
M.
and
Motavali
,
A.
(
2021
), “
Bullwhip effect reduction map for COVID-19 vaccine supply chain
”,
Sustainable Operations and Computers
, Vol.
2
, pp.
139
-
148
.
Baroud
,
H.
,
Ramirez-Marquez
,
J.E.
,
Barker
,
K.
and
Rocco
,
C.M.
(
2014
), “
Stochastic measures of network resilience: applications to waterway commodity flows
”,
Risk Analysis
, Vol.
34
No.
7
.
Bastani
,
P.D.
(
2021
), “
Designing a resilience model for pharmaceutical supply chain during crises: a grounded theory approach
”,
Journal of Pharmaceutical Policy and Practice
, Vol.
14
No.
1
, doi: .
Bastani
,
P.
,
Dehghan
,
Z.
,
Kashfi
,
S.M.
,
Dorosti
,
H.
,
Mohammadpour
,
M.
,
Mehralian
,
G.
and
Ravangard
,
R.
(
2021
), “
Strategies to improve pharmaceutical supply chain resilience under politico-economic sanctions: the case of Iran
”,
Journal of Pharmaceutical Policy and Practice
, Vol.
14
No.
1
, doi: .
Behzadi
,
G.
,
O’Sullivan
,
M.J.
and
Olsen
,
T.L.
(
2020
), “
On metrics for supply chain resilience
”,
European Journal of Operational Research
, Vol.
287
No.
1
, pp.
145
-
158
.
Biringer
,
B.
,
Vugrin
,
E.
and
Warren
,
D.
(
2010
), “
Critical infrastructure system security and resiliency
”,
CRC Press, Taylor and Francis Group
.
Bown
,
C.P.
(
2022
), “Why the world trade organization is critical for vaccine supply chain resilience during a pandemic”,
International Bank for Reconstruction and Development, The World Bank
.
Bown
,
K.
(
2023
), “
The WTO and vaccine supply chain during a pandemic
”,
Journal of International Economic Law
, Vol.
26
No.
2
.
Bruneau
,
M.
,
Chang
,
S.E.
,
Eguchi
,
R.T.
,
Lee
,
G.C.
,
O’Rourke
,
T.
,
Reinhorn
,
A.M.
,
Shinozuka
,
M.
,
Tierney
,
K.
,
Wallace
,
W.A.
and
von Winterfeldt
,
D.
(
2003
), “
A framework to quantitatively assess and enhance the seismic resilience of communities
”,
Earthquake Spectra
, Vol.
19
No.
4
, p.
1623497
, doi: .
Budish
,
E.
(
2021
), “
Market design to accelerate COVID-19 vaccine supply
”,
University of Chicago Booth School of Business
,
available at:
www.youtube.com/watch?v=lXZOzVYUO6I
Cafone
,
J.
(
2022
), “
Technical workshop on COVID-19 vaccine R&D, manufacturing and distribution: how it is in practice
”,
World Trade Organization
,
available at:
www.youtube.com/watch?v=lxoI4Zdj3BY&t=3s
Carcary
,
M.
(
2009
), “
The research audit trail – enhancing trustworthiness in qualitative inquiry
”,
Electronic Journal of Business Research Methods
, Vol.
7
, pp.
11
-
24
.
Carpenter
,
S.R.
,
Walker
,
B.H.
,
Anderies
,
M.A.
and
Abel
,
N.A.
(
2001
), “
From metaphor to measurement: resilience of what to what?
”,
Ecosystems
, Vol.
4
No.
8
, pp.
765
-
781
.
Castillo
,
C.
(
2022
), “
Is there a theory of supply chain resilience? A bibliometric analysis of the literature
”,
International Journal of Operations & Production Management
, Vol.
43
No.
1
,
Cho
,
J.Y.
and
Lee
,
E.-H.
(
2014
), “
Reducing confusion about grounded theory and qualitative content analysis: similarities and differences
”,
The Qualitative Report
, Vol.
19
No.
32
,
Choi
,
T.Y.
,
Dooley
,
K.J.
and
Rungtusanatham
,
M.
(
2001
), “
Supply networks and complex adaptive systems: control versus emergence
”,
Journal of Operations Management
, Vol.
19
No.
3
, pp.
351
-
366
.
Chowdury
,
P.
,
Paul
,
S.K.
,
Kaisar
,
S.
and
Moktadir
,
M.
(
2021
), “
COVID-19 pandemic related supply chain studies: a systematic review
”,
Transportation Research Part E: Logistics and Transportation Review
, Vol.
148
, p.
102271
, doi: .
Christopher
,
M.
(
2011
),
Logistics and Supply Chain Management
, (4th ed) .,
Prentice Hall Financial Times
,
London
.
Christopher
,
M.
and
Peck
,
H.
(
2004
), “
Building the resilient supply chain
”,
The International Journal of Logistics Management
, Vol.
15
No.
2
, pp.
1
-
13
.
Craighead
,
C.W.
,
Blackhurst
,
J.
,
Rungtusanatham
,
M.J.
and
Handfield
,
R.B.
(
2007
), “
The severity of supply chain disruptions: design characteristics and mitigation capabilities
”,
Decision Sciences
, Vol.
38
No.
1
, pp.
131
-
156
.
Creswell
,
J.W.
and
Creswell
,
J.D.
(
2018
),
Research Design, Qualitative, Quantitative, and Mixed Methods Approaches
,
Sage Publications
,
CA., USA
.
Creswell
,
J.W.
and
Miller
,
D.L.
(
2000
), “
Determining validity in qualitative inquiry
”,
Theory into Practice
, Vol.
39
No.
3
, pp.
124
-
130
.
Datta
,
P.
(
2017
), “
Supply network resilience: a systematic literature review and future research
”,
The International Journal of Logistics Management
, Vol.
28
No.
4
.
De Bruijne
,
M.
and
van Eeten
,
M.
(
2007
), “
Systems that should have failed: critical infrastructure protection in an institutionally fragmented environment
”,
Journal of Contingencies and Crisis Management
, Vol.
15
No.
1
.
De Weck
,
O.
,
Magee
,
C.L.
and
Roos
,
D.
(
2011
),
Engineering Systems: Meeting Human Needs in a Complex Technological World
,
The MIT Press
,
Cambridge, MA
.
El Korchi
,
A.
(
2022
), “
Survivability, resilience, and sustainability of supply chains: the COVID-19 pandemic
”,
Journal of Cleaner Production
, Vol.
377
, p.
134363
.
Elo
,
S.
and
Kyngäs
,
H.
(
2007
), “
The qualitative content analysis
”,
Advanced Nursing
, Vol.
62
No.
1
, pp.
107
-
115
.
Fahrni
,
M.L.
,
Ismail
,
I.A.-N.
,
Refi
,
D.M.
,
Almerman
,
A.
,
Yaakob
,
N.C.
,
Sarnan
,
K.M.
,
Mansor
,
N.F.
,
Noordin
,
M.
and
Babar
,
Z.-U.-D.
(
2022
), “
Management of COVID-19 vaccines cold chain logistics: a scoping review
”,
Journal of Pharmaceutical Policy and Practice
, Vol.
15
No.
1
, p.
16
.
Falasca
,
M.
,
Zobel
,
C.W.
and
Cook
,
D.
(
2008
), “
A decision support framework to assess supply chain resilience
”,
Proceedings of the 5th International ISCRAM Conference
,
Washington, DC
.
Ferdous
,
J.
,
Medhekar
,
A.
,
Akbar
,
D.
,
Khandaker
,
G.
and
Hossain
,
M.R.
(
2023
), “
Developing an analytical framework to depict disruptions in the pharmaceutical supply chain during covid 19: a scoping review
”,
The Australasian Journal of Regional Studies
, Vol.
29
No.
1
, pp.
73
-
92
, doi: .
Feddema
,
J.
,
Fernald
,
K.D.S.
,
Schikan
,
H.G.C.P.
and
van de Burgwal
,
L.H.M.
(
2023
), “
Upscaling vaccine manufacturing capacity – key bottlenecks and lessons learned
”,
Vaccine
, Vol.
41
No.
30
, pp.
4359
-
4368
.
Ferranna
,
M.
(
2024
), “
Causes and costs of global COVID-19 vaccine inequity
”,
Seminars in Immunopathology
, Vol.
45
Nos
4/6
, pp.
469
-
480
.
Finkenstadt
,
D.J.
and
Handfield
,
R.B.
(
2021
), “
Tuning value chains for better signals in the post-COVID era: vaccine supply chain concerns
”,
International Journal of Operations & Production Management
, Vol.
41
No.
8
, pp.
1302
-
1317
, doi: .
Forman
,
R.
,
Shah
,
S.
,
Jeurissen
,
P.
,
Jit
,
M.
and
Mossialos
,
E.
(
2021
), “
COVID-19 vaccine challenges: what have we learned so far and what remains to be done?
”,
Health Policy
, Vol.
125
No.
5
, pp.
553
-
567
.
Ganguly
,
A.
and
Farr
,
J.V.
(
2024
), “
An interpretive structural modelling (ISM) approach to evaluate barriers to resiliency in Indian pharmaceutical supply chains
”,
Business Perspectives and Research
, Vol.
12
No.
4
, pp.
599
-
616
.
Gibbs
,
G.R.
(
2007
),
Analyzing Qualitative Data
,
Sage Publications
,
London
.
GlobalData Healthcare
(
2022
), “
Manufacturing disruptions delay covid-19 vaccine distribution. Pharmaceutical technology
”, Retrieved at,
available at:
www.pharmaceutical-technology.com/comment/covid-19-vaccine-manufacturing-disruptions/
Golan
,
M.S.
,
Jernegan
,
L.H.
and
Linkov
,
I.
(
2020
), “
Trends and applications of resilience analytics in supply chain modeling: systematic literature review in the context of the covid-19 pandemic
”,
Environment Systems and Decisions
, Vol.
40
No.
2
, pp.
222
-
243
.
Golan
,
M.S.
,
Mahoney
,
E.
,
Trump
,
B.
and
Linkov
,
I.
(
2021a
), “
Resilience and efficiency for nanotechnology supply chains underpinning COVID-19 vaccine development
”,
Current Opinion in Chemical Engineering
, Vol.
34
, p.
100759
.
Golan
,
M.S.
,
Trump
,
B.D.
,
Cegan
,
J.C.
and
Linkov
,
I.
(
2021b
), “
Supply chain resilience for vaccines: review of modeling approaches in the context of the COVID-19 pandemic
”,
Industrial Management & Data Systems
, Vol.
121
No.
7
, doi: .
Gress
,
E.S.H.
,
Hernandez-Gress
,
N.
and
Contla
,
K.S.
(
2021
), “
Methodology for designing humanitarian supply chains: distribution of COVID-19 vaccines in Mexico
”,
Administrative Sciences
, Vol.
11
No.
4
, p.
134
.
Grossoehme
,
D.H.
(
2014
), “
Research methodology overview of qualitative research
”,
Journal of Health Care Chaplaincy
, Vol.
20
No.
3
, pp.
109
-
122
.
Gunderson
,
L.
and
Holling
,
C.S.
(Eds). (
2001
),
Panarchy: Understanding Transformations in Human and Natural Systems
,
Island Press
,
Washington, DC
.
Gunderson
,
L.H.
,
Allen
,
C.R.
and
Holling
,
C.S.
(
2010
), (Eds.)
Foundations of Ecological Resilience
,
Island Press
.
Hartner
,
A.-M.
,
Xiang
,
L.
and
Gaythorpe
,
K.
(
2024
), “
COVID-19 related disruption and resilience in immunization activities in LMICs: a rapid review
”,
BMJ Open
, Vol.
14
No.
8
, p.
e076607
.
Henry
,
D.
and
Ramirez-Marquez
,
J.E.
(
2012
), “
Generic metrics and quantitative approaches for system resilience as a function of time
”,
Reliability Engineering & System Safety
, Vol.
99
, pp.
114
-
122
.
Holling
,
C.S.
(
1996
), “Engineering resilience versus ecological resilience”, in
Schulze
,
P.
(Ed.),
Engineering within Ecological Constraints
,
National Academy Press
,
Washington, DC
, pp.
31
-
43
.
Holling
,
C.S.
(
1973
), “
Resilience and stability of ecological systems
”,
Institute of Resource Ecology, University of British Columbia
,
Canada
.
Hosseini
,
S.
,
Barker
,
K.
and
Ramirez-Marquez
,
J.E.
(
2016
), “
A review of definitions and measures of system resilience
”,
Reliability Engineering & System Safety
, Vol.
145
, pp.
47
-
61
.
Hsieh
,
H.-F.
and
Shannon
,
S.E.
(
2005
), “
Three approaches to qualitative content analysis
”,
Qualitative Health Research
, Vol.
15
No.
9
, pp.
1277
-
1288
.
Hussin
,
M.
,
Frazier
,
S.
and
Thompson
,
J.K.
(
2011
), “
Fat stigmatization on YouTube: a content analysis
”,
Body Image
, Vol.
8
No.
1
, pp.
90
-
92
.
Jahed
,
A.
,
Molana
,
S.M.J.
,
Tavakkoli-Moghaddam
,
R.
and
Valizadeh
,
V.
(
2024
), “
Designing an integrated sustainable-resilient mix-and-match vaccine supply chain network
”,
Annals of Operations Research
, doi: .
Jamil Uddin
,
S.M.
,
Albert
,
A.
,
Tamanna
,
M.
and
Alsharef
,
A.
(
2023
), “
YouTube as a source of information: early coverage of the COVID-19 pandemic in the context of the construction industry
”,
Construction Management and Economics
, Vol.
41
No.
5
, p.
2162096
.
Joshi
,
S.
and
Sharma
,
M.
(
2022
), “
A literature survey on vaccine supply chain management amidst COVID-19: literature developments, future directions and open challenges for public health
”,
World
, Vol.
3
No.
4
, p.
4
, doi: .
Kauffman
,
L.
and
Denk
,
N.
(
2011
), “
How to demonstrate rigor when presenting grounded theory research in the supply chain literature
”,
Journal of Supply Chain Management
, Vol.
47
No.
4
.
Kazancoglu
,
Y.
,
Sezer
,
M.D.
,
Ozbiltekin-Pala
,
M.
and
Kucukavar
,
M.
(
2022
), “
Investigating the role of stakeholder engagement for more resilient vaccine supply chains during COVID-19
”,
Operations Management Research
, Vol.
15
Nos
1/2
, doi: .
Kochan
,
C.G.
and
Nowicki
,
D.R.
(
2018
), “
Supply chain resilience: a systematic literature review and typological framework
”,
International Journal of Physical Distribution and Logistics Management
, Vol.
48
, No.
8
, pp.
842
-
865
.
Lawrence
,
J.-M.E.
(
2024
), “
Disruptors and resilience capabilities of pharmaceutical supply chains exposed to rare catastrophic disasters: case studies of one localized and one global disaster
”, Theses and Dissertations, p.
6134
,
available at:
https://scholarsjunction.msstate.edu/td/6134.
Mahmud
,
P.
,
Ahmed
,
M.
,
Janan
,
F.
,
Xames
,
M.
and
Chowdhury
,
N.R.
(
2023
), “
Strategies to develop a sustainable and resilient vaccine supply chain in the context of a developing economy
”,
Socio-Economic Planning Sciences
, Vol.
87
, p.
101616
.
Maramba
,
G.
,
Smuts
,
H.
,
Hattingh
,
M.
,
Adebesin
,
F.
,
Moongela
,
H.
,
Mawela
,
T.
and
Enakrire
,
R.
(
2023
), “
Healthcare supply chain efficacy as a mechanism to contain pandemic Flare-Ups: a South African case study
”,
International Journal of Information Systems and Supply Chain Management
, Vol.
17
No.
1
, p.
333713
.
Marceau
,
G.
and
Parwani
,
P.
(
2021
), “
COVID-19 and international trade: the role of the WTO in fighting the pandemic and building back better
”,
Global Trade and Customs Journal
, Vol.
16
Nos
7/8
, pp.
280
-
295
.
Marshall
,
B.
,
Cardon
,
P.
,
Poddar
,
A.
and
Fontenot
,
R.
(
2013
), “
Does sample size matter in qualitative research? A review of qualitative interviews in I.S
”,
Research”, Journal of Computer Information Systems
, Vol.
54
No.
1
, pp.
11
-
22
.
Mason
,
J.
(
2002
),
Qualitative Researching
, (2nd ed) .,
Sage Publications
,
London
.
Mekonen
,
Z.T.
,
Fenta
,
T.G.
,
Nadeem
,
S.P.
and
Cho
,
D.J.
(
2024
), “
Global health commodities supply chain in the era of COVID-19 pandemic: challenges, impacts and prospects: a systematic review
”,
Journal of Multidisciplinary Healthcare
, Vol.
17
, pp.
1523
-
1539
.
Mensah
,
P.
and
Merkuryev
,
Y.
(
2014
), “
Developing a resilient supply chain
”,
Procedia – Social and Behavioral Sciences
, Vol.
110
, pp.
309
-
319
, doi: .
Miguel
,
B.
,
Shilpa
,
B.
,
Pireethi
,
B.
,
Hardik
,
G.
and
Bishwajeet
,
P.
(
2021
), ““
Advancing deep learning for supply chain optimization of covid-19 vaccination in rural communities
”,
Proceedings of IEEE 10th International Conference on Communication Systems and Network Technologies
, pp.
690
-
695
.
MIT Technology Review
(
2020
), “
Building resilient supply chains
”,
MIT Technology Review Insights
,
available at:
www.technologyreview.com/2020/11/24/1012450/building-resilient-supply-chains/
Moosavi
,
J.
,
Fathollahi-Fard
,
A.M.
and
Dulebenets
,
M.A.
(
2022
), “
Supply chain disruption during the COVID-19 pandemic: recognizing potential disruption management strategies
”,
International Journal of Disaster Risk Reduction
, Vol.
75
, p.
102983
.
Moretti
,
F.
,
van Vliet
,
L.
,
Bensing
,
J.
,
Deledda
,
G.
,
Mazzi
,
M.
,
Rimondini
,
M.
,
Zimmermann
,
C.
and
Fletcher
,
I.
(
2011
), “
A standardized approach to qualitative content analysis of focus group discussions from different countries
”,
Patient Education and Counseling
, Vol.
82
No.
3
, pp.
420
-
428
.
Owens
,
J.K.
,
Stidham
,
A.W.
and
Owens
,
E.L.
(
2013
), “
Disaster evacuation for persons with special needs: a content analysis of information on YouTube
”,
Applied Nursing Research
, Vol.
26
No.
4
, pp.
273
-
275
.
Pennisi
,
F.
,
Genovese
,
C.
and
Gianfredi
,
V.
(
2024
), “
Lessons from the COVID-19 pandemic: promoting vaccination and public health resilience, a narrative review
”,
Vaccines
, Vol.
12
No.
8
, p.
891
.
Pettit
,
T.J.
,
Fiksel
,
J.
and
Croxton
,
K.L.
(
2010
), “
Ensuring supply chain resilience: development of a conceptual framework
”,
Journal of Business Logistics
, Vol.
31
No.
1
.
Ponis
,
S.T.
and
Koronis
,
E.
(
2012
), “
Supply chain resilience: definition of concept and its formative elements
”,
Journal of Applied Business Research
, Vol.
28
No.
5
.
Ponomarov
,
S.Y.
and
Holcomb
,
M.C.
(
2009
), “
Understanding the concept of supply chain resilience
”,
The International Journal of Logistics Management
, Vol.
20
No.
1
,
Qrunfleh
,
S.
,
Vivek
,
S.
and
Merz
,
R.
(
2023
), “
ICT-Based research tools to determine the importance of vaccine distribution in supply chain efficiency: specific case of bibliometrix
”,
Lecture Notes in Networks and Systems
, Vol.
516
, pp.
199
-
206
.
Ravitz
,
G.
,
Shyu
,
M.-L.
and
Powell
,
M.D.
(
2010
), “
Integrating multimedia content analysis of YouTube videos with hurricane wind analysis for public situation awareness and outreach
”,
International Journal of Software Engineering and Knowledge Engineering
, Vol.
20
No.
2
, pp.
155
-
172
.
Restream
(
2022
), “
The best free social streaming platforms in 2022
”,
Restream
,
available at:
https://restream.io/blog/best-live-streaming-platforms/
Rice
,
J.B.
and
Caniato
,
F.
(
2003
), “
Building a secure and resilient network
”,
Supply Chain Management Review
, Vol.
7
No.
5
, pp.
22
-
30
.
Rinaldi
,
M.
,
Turino
,
M.A.
,
Fera
,
M.
and
MacChiaroli
,
R.
(
2023
), “
Improving the distribution of covid-19 vaccines using the blockchain technology: the Italian case study
”,
Procedia Computer Science
, Vol.
217
, pp.
366
-
375
.
Rout
,
L.
,
Acharya
,
M.K.
and
Acharya
,
S.
(
2024
), “
Content analysis of YouTube videos regarding natural disasters in India and analysis of users’ sentiments through viewer comments
”,
Natural Hazards
, Vol.
120
No.
1
, pp.
219
-
234
.
Sandelowski
,
M.
(
1995
), “
Sample size in qualitative research
”,
Research in Nursing & Health
, Vol.
18
No.
2
, pp.
179
-
183
.
Sarkis
,
J.
(
2020
), “
Supply chain sustainability: learning from the COVID-19 pandemic
”,
International Journal of Operations & Production Management
, Vol.
41
No.
1
, pp.
63
-
73
.
Sauser
,
B.
,
Boardman
,
J.
and
Gorod
,
A.
(
2008
), “System of systems management”, in
Jamshidi
,
M.
(Ed.),
System of Systems – Innovations for the 21st Century
,
Wiley
,
London
.
Shahparvari
,
S.
,
Hassanizadeh
,
B.
,
Mohammadi
,
A.
,
Kiani
,
B.
,
Lau
,
K.H.
,
Chhetri
,
P.
and
Abbasi
,
B.
(
2022
), “
A decision support system for prioritized COVID-19 Two-Dose vaccination allocation and distribution
”,
Transportation Research Part E: Logistics and Transportation Review
, Vol.
159
, p.
102598
.
Sheffi
,
Y.
(
2020
),
The New Ab(Normal): Reshaping Business and Supply Chain Strategy Beyond COVID-19
,
MIT Center for Transportation and Logistics
,
Cambridge, MA
.
Sheffi
,
Y.
and
Rice
,
J.B.
(
2005
), “
A supply chain view of the resilient enterprise
”,
MIT Sloan Management Review
, Vol.
47
No.
1
, pp.
41
-
48
.
Silverman
,
D.
(
2009
),
Doing Qualitative Research
,
Sage Publications
,
London
.
Simchi-Levi
,
D.
,
Schmidt
,
W.
,
Wei
,
Y.
,
Zhang
,
P.Y.
,
Combs
,
K.
,
Yao
,
G.
,
Gusikhin
,
O.
,
Sanders
,
M.
and
Zhang
,
D.
(
2014
), “
Identifying risks and mitigating disruptions in the automotive supply chain
”,
Interfaces
, Vol.
45
No.
5
, pp.
375
-
390
,
available at:
www.jstor.org/stable/43699517.
Simchi-Levi
,
D.
and
Simchi-Levi
,
E.
(
2020
), “
We need a stress test for critical supply chains
”,
Harvard Business Review
.
Singh
,
C.S.
,
Soni
,
G.
and
Badhotiya
,
G.K.
(
2019
), “
Performance indicators for supply chain resilience: review and conceptual framework
”,
Journal of Industrial Engineering International
, Vol.
15
No.
S1
, pp.
S105
-
S117
.
Sinha
,
P.
,
Kumar
,
S.
and
Chandra
,
C.
(
2022
), “
Strategies for ensuring required service level for COVID-19 herd immunity in Indian vaccine supply chain
”,
European Journal of Operational Research
, Vol.
304
No.
1
, pp.
339
-
352
.
Slick
,
J.
(
2019
), “
Experiencing fire: a phenomenological study of YouTube videos of the 2016 fort McMurray fire
”,
Natural Hazards
, Vol.
98
No.
1
, pp.
181
-
212
.
Statista
(
2022
), “
Most popular websites worldwide as of November 2021, by total visits (in billions)
”,
Statista
,
available at:
www.statista.com/statistics/1201880/most-visited-websites-worldwide/
Suciu
,
P.
(
2021
), “
YouTube remains the most dominant social media platform
”,
Forbes
,
available at:
www.forbes.com/sites/petersuciu/2021/04/07/youtube-remains-the-most-dominant-social-media-platform/?sh=19be39426322
Swann
,
J.
,
Macis
,
M.
and
Helton
,
J.
(
2020
), “
The greatest supply chain challenge ever: the COVID-19 vaccine
”,
UC Denver School of Business Presentation
,
available at:
www.youtube.com/watch?v=tmGmsEWxe4s
Thacker
,
S.
,
Pant
,
R.
and
Hall
,
J.W.
(
2017
), “
System-of-systems formulation and disruption analysis for multi-scale critical national infrastructures
”,
Reliability Engineering & System Safety
, Vol.
167
, pp.
30
-
41
.
Trump
,
B.D.
,
Golan
,
M.S.
,
Keisler
,
J.M.
,
Cegan
,
J.C.
and
Linkov
,
I.
(
2022
), “
Vaccine supply chain: resilience-by-design and resilience-by-intervention
”,
Vaccine
, Vol.
40
No.
12
, pp.
1695
-
1698
.
Tukahumabwa
,
B.R.
and
Stevenson
,
M.
(
2015
), “
Supply chain resilience: definition, review and theoretical foundations for further study
”,
International Journal of Production Research
, Vol.
53
No.
18
, doi: .
Van Note Chism
,
N.
,
Douglas
,
E.
and
Hilson
,
W.J.
 Jr.
(
2008
), “
Qualitative research basics: a Guide for engineering educators
”,
Rigorous Research in Engineering Education
,
NSF DUE-0341127
.
Verma
,
A.
,
Bhattacharya
,
P.
,
Zuhair
,
M.
,
Tanwar
,
S.
and
Kumar
,
N.
(
2022
), “
VaCoChain: blockchain-Based 5G-Assisted UAV vaccine distribution scheme for future pandemics
”,
IEEE Journal of Biomedical and Health Informatics
, Vol.
26
No.
5
, pp.
1997
-
2007
.
Weiland
,
A.
and
Durach
,
C.F.
(
2021
), “
Two perspectives on supply chain resilience
”,
Journal of Business Logistics
, Vol.
42
No.
3
, pp.
315
-
322
.
Wied
,
M.
,
Oehmen
,
J.
and
Welo
,
T.
(
2019
),
Conceptualizing Resilience in Engineering Systems: An Analysis of the Literature
,
Wiley Periodicals
.
Williams
,
D.F.
, Jr.
,
Thomas
,
S.P.
and
Liao-Troth
,
S.
(
2017
), “
The truck driver experience: identifying psychological stressors from the voice of the driver
”,
Transportation Journal
, Vol.
56
No.
1
, pp.
54
-
76
.
World Health Organization (WHO)
(
2023
), “
WHO coronavirus (COVID-19) dashboard
”,
World Health Organization
,
available at:
https://covid19.who.int/
Zsidisin
,
G.A.
and
Wagner
,
S.M.
(
2010
), “
Do perceptions become reality? The moderating role of supply chain resiliency on disruption occurrence
”,
Journal of Business Logistics
, Vol.
31
No.
2
.
Birigner
,
B.
,
Vugrin
,
E.
and
Warren
,
D.
(
2016
), “
Critical infrastructure system security and resilience
”,
CRC Press
.
Boddy
,
C.R.
(
2016
), “
Sample size for qualitative research
”,
Qualitative Market Research: An International Journal
, Vol.
19
No.
4
, pp.
426
-
432
.
Centers for Disease Control and Prevention
(
2021
), “
Performance measure guidance: COVID-19 vaccination supplemental funding
”,
Centers for Disease Control
,
available at:
www.cdc.gov/vaccines/covid-19/downloads/performance-measures-supplemental-funding.pdf
Chen
,
L.
and
Miller-Hooks
,
E.
(
2011
), “
Resilience: an indicator of recovery capability in intermodal freight transport
”,
Transportation Science
, Vol.
46
No.
1
.
Cheng
,
Y.
,
Eslayed
,
E.A.
and
Huang
,
Z.
(
2021
), “
Systems resilience assessments: a review, framework, and metrics
”,
International Journal of Production Research
, Vol.
60
No.
2
, doi: .
D’Lima
,
M.
and
Medda
,
F.
(
2015
), “
A new measure of resilience: an application to the London underground
”,
Transportation Research Part A: Policy and Practice
, Vol.
81
, pp.
35
-
46
.
Hobb
,
W.J.
(
2008
),
Supply Chain Science
,
Mc Graw-Hill Irwin
.
Johns Hopkins University
(
2022
), “
Coronavirus resource center. John Hopkins university and medicine
”,
available at:
https://coronavirus.jhu.edu/
Our World in Data
(
2021
), “
Coronavirus (COVID-19) vaccinations
”,
Our World in Data
,
available at:
https://ourworldindata.org/covid-vaccinations
Pant
,
R.
,
Barker
,
K.
and
Zobel
,
C.W.
(
2014
), “
Static and dynamic metrics of economic resilience for interdependent infrastructure and industry sectors
”,
Reliability Engineering & System Safety
, Vol.
125
, pp.
92
-
102
.
Rose
,
A.
(
2007
), “
Economic resilience to natural and man-made disasters: multidisciplinary origins and contextual dimensions
”,
Environmental Hazards
, Vol.
7
No.
4
, pp.
383
-
398
.
Sargut
,
G.
and
McGrath
,
R.
(
2011
), “
Learning to live with complexity
”,
Harvard Business Review
, Vol.
89
No.
9
.
Vlajic
,
J.V.
,
van der Vorst
,
J.G.
and
Haijema
,
R.A.J.
(
2012
), “
A framework for designing robust food supply chains
”,
International Journal of Production Economics
, Vol.
137
No.
1
, pp.
176
-
189
.

Table A1 

Table A1

List of data sources

New nameHosting organizationDiversity of participants/references of experiences
Source_1International organizationGlobal
Source_2UniversityThe USA
Source_3UniversityEurope
Source_4UniversityThe USA/Asia
Source_5Logistics companyEurope/Middle east
Source_6UniversityThe USA/Europe
Source_7Private sector organizationThe USA
Source_8International trade associationEurope/Global
Source_9PublisherThe USA
Source_10UniversityThe USA
Source_11Logistics mediaIndia
Source_12UniversityIndia
Source_13Consulting companyThe USA/Africa
Source_14Professional organizationThe UK
Source_15International organizationGlobal
Source_16Professional organizationThe USA/Global
Source_17International companyThe USA
Source_18Non-Profit organizationThe USA
Source_19Consulting / advisory firmThe USA
Source_20UniversityThe USA
Source_21Government departmentThe USA
Source_22Academic paperN/A
Source_23Consulting companyN/A
Source_24International organizationN/A
Source_25ReportN/A
Source_26White paperN/A
Source_27White paperN/A
Source_28Academic paperN/A
Source_29Academic paperN/A
Source_30White paperN/A
Source_31White paperN/A
Source_32Academic paperN/A
Source_33International organizationN/A
Source_34White paperN/A
Source_35ReportN/A
Source_36ReportN/A
Source: Author’s own creation/work

Table A2 

Table A2

Credentials of presenters and panelists (audiovisual presentations)

Matrix pairsTitle / position heldOrganization type
1Director, manufacturing and supply chain networksGlobal health organization/coalition
2Vice president, strategy and operations managementPharmaceutical company
3Team lead, vaccines prequalification and regulationInternational health organization
4Executive director, international regulatory affairsPharmaceutical company
5Senior vice president and chief regulatory officerPharmaceutical company
6Technical specialistInternational humanitarian organization
7Senior director for regulatory affairsGlobal logistics company
8Unit head, immunizationInternational health organization
9Senior economist, healthInternational organization
10Deputy, national immunization programGovernment – national level
11Professor, supply chain managementUniversity
12County health officerGovernment – state level
13Deputy Chief for Supply, Production and Distribution (COVID-19 Vaccine)Government – federal level
14Senior director, special pathogensGovernment – city level (major metropolis)
15Professor – supply chain, health careUniversity
16Senior research fellowThink tank – international affairs
17PresidentBiotechnology trade association
18Chief executive officerGlobal health organization/coalition
19Director generalPharmaceutical trade association
20Chief executive officerAlliance of vaccine manufacturers (developing countries)
21President/chair of the boardAlliance of vaccine manufacturers (developing countries)
22Chief executive officer 
23Chief executive officer and founderGlobal health intelligence and analytics company
24Cyprus Ad-IFPMA 
25Director, global strategic developmentPharmaceutical company
26Chief commercial officerSmart container company
27Head of global pharmaCargo airline
28General managerFreight transportation/cargo company
29ConsultantPharmaceutical company
30Managing directorTransportation / logistics company
31Lead, serialization and vaccines traceabilityPharmaceutical company
32Professor – cold economy (mechanical engineering)University
33Director of product marketingTransportation / logistics company
34Chief executive officerDigital solutions company
35Senior program directorSustainability development education organization
36Chief financial officerPharmaceutical company
37Professor of operations managementUniversity
38Professor of operations and supply chain managementUniversity
39Chief executive officerDigital solutions company
40Director of health systems and immunizationGlobal vaccine alliance
41Professor, business administrationUniversity
42President, life sciences and health-care sectorGlobal logistics company
43Vice president, product strategy – supply chain applicationsComputer software company
44Regional president, vaccinesPharmaceutical company
45Director, global healthHospital / health-care provider
46Managing director, cyber riskConsulting firm
47Associate managing director – Compliance, risk and diligenceConsulting firm
48Managing director –security risk managementConsulting firm
49Deputy chief supply chain, production and distribution / integrated logistics support – COVID vaccineGovernment (federal)
50Associate professor – internal medicineUniversity
51Manager – COVID vaccineGovernment (federal)
52Vaccine program managerGovernment (federal)
53Vice President, Enterprise Program Lead – COVID-19 VaccinesPharmaceutical distribution company
54Biological supply chain consultantGovernment (federal)
55Professor of operations and logistics managementUniversity
56Head, industry and partner solutionsComputer software company
57ConsultantIT services company
58Professor of economicsUniversity
59Founder and chairmanConsulting/advisory firm – due diligence and technical advisory
60EconomistAir transport association
61COVID-19 Vaccine Global Logistics LeadInternational humanitarian organization
62General manager, cargo and logistics developmentTransportation / pharma logistics company
63Head specialty productsShipping company
64Global pharma products managerFreight forwarding company
65Transportation managerPharmaceutical company
66Visiting policy associate, healthUniversity
67PhysicianUniversity
68Vice presidentIntegrated health solutions company
69Senior vice presidentChain drugstore association
70Professor – medicine/ health policy advisorUniversity
71Assistant Professor – LawUniversity
72Professor of philosophyUniversity
73Senior technical advisor – supply chainsPublic health consulting company
74Professor – international tradeUniversity
75Secretary, health and family welfareGovernment (national)
76Senior editorPublisher
77Retired diplomat/public officerN/A
78Assistant director generalInternational health organization
79Deputy secretary generalGlobal customs organization
80Chief economistInternational trade organization
81CEO and founderGlobal health intelligence and analytics company
82Head, strategy and regulations – single market and industrial policyGovernment
83Policy directorChamber of commerce
84Vice president, international businessPharmaceutical company
85Vice president of supply chain, emerging marketsPharmaceutical company
86CEO and managing directorPharmaceutical company
87Executive director – animal healthPharmaceutical company
88Chief, market access intelligenceInternational trade organization
89Counselor, market accessInternational trade organization
90Deputy director, tradeGlobal customs organization
91Policy analystIntergovernmental organization
92Senior fellow / economistThink tank organization
93Chief, regional cooperation and integrationDevelopment bank
94Vice president, life sciences and health-care customer solutionsGlobal logistics company
95Head, cargo border managementInternational air transport organization
96Senior advisorRoad transportation union
97Chief executive, medicines and health-care productsRegulatory agency
98Director, regulation and prequalificationGlobal health organization
99Chief executiveRegulatory agency
100Chief executive officerRegulatory agency
101Chief executive, developing countries vaccine manufacturing network 
102Business plan coordinate, pharmaceutical manufacturing plantInternational organization
103Independent advisor – regulatory access 
104Immunization and logistics advisorGlobal public health consulting company
105Program director, health administrationUniversity
106Professor, industrial and systems engineeringUniversity
107Professor, economicsUniversity
108Assistant professor, health administrationUniversity
Source: Author’s own creation/work

Table A3 

Table A3

Level 2 resilience sub-factors supporting agility

Level 1 sub-factorLevel 2 sub-factor capabilities
Agility – product flowExpediting of in-country and cross-border flows
 Rapid ramp-up of supplier and manufacturer capacity to meet production volume requirements
 Implementation of redundancy strategies in vaccine development, manufacturing and logistics
 Rapid ramp-up of vaccination capacity
 Capability for flexibility, substitutability and interchangeability of materials, equipment, infrastructure
 Continuous improvement of speed (takt time, cycle time)
 Rapid ramp-up of warehouse, logistics and distribution capacity
 Implementation of national and international policies and actions to facilitate the flow of inputs and vaccines
 Parallel performance of critical activities
 Selection of vaccine technology to support speed, scalability and accessibility
 Government negotiation of real options to expand manufacturing, procurement and distribution capacity
Agility – financial flowInvestment at risk in vaccine development and production
 Availability/ability to access funding for vaccine promotion, procurement, rollout, administration, and waste management
 Ability to access government subsidies for rapid building of capacity
 Ability to access emergency funding to subsidize and expand cold chain capacity and transportation
 Use of intermediary international organizations to procure vaccine doses
 Simplification of processes for accessing and deploying finances
 Ability of private sector to raise funds for air cargo and shipping capacity expansion
 Government coordination of subsidies for cross-border vaccine supply chains
Agility – information flowProcess simplification, integration, and digitalization using advanced technologies to increase speed and efficiency
 Information sharing via physical and electronic platforms for decision-making
 Implementation of data Lakes and databases for data collection to support data analytics
 Cross-sector, cross-border data exchange through implementation of global interoperability standards
 Communication of standard operating procedures (SOPs) and key performance indicators (KPIs)
 Implementation of policies, contractual terms, standards and incentives to access vaccine supply chain information
 Communication of procedures for assessing and approving vaccines
Agility – vaccine recipient flowUse of diverse vaccine advertising and promotion strategies
 Implementation of mandatory and prioritized vaccination
 Establishment of diverse, accessible vaccination administration sites
 Implementation of seamless user-friendly registration methods
 Availability of assistants to assist potential recipients with registration
 Administration of single rather than multiple dose vaccines
Agility – knowledge flowCross-border transfer of technology
 Training in regulatory requirements, manufacturing, inventory management, cold chain logistics, and immunization processes
 Training in data analytics for strategic and operational decisions
 Training of volunteers and students in health professions to serve as vaccinators and assistants
 Training in vaccine administration and post vaccination monitoring
 Training in information technology and information system skills
 Training in the application of international conventions, instruments, and standards to facilitate cross-border flows
 Training in best practices in cross-border flow of goods
 Training in healthcare system readiness and resilience
 Training in biomedical waste management
Agility – skilled worker flowUse of non-traditional labor pools to meet immunization demand requirements
 Facilitation of cross-border free flow of skilled workers
 Expansion of traditional skilled labor pools through recruitment
 Maintenance of substitute labor pools in event of sickness and attrition
 Maintenance of multilingual immunization worker pool
 Immunization of public health workers to minimize illness
Agility – waste flowExpansion of waste infrastructure and capacity
 Implementation of strategies for handling and disposing of biomedical waste
 Planning for adequate waste management resources
 Planning of unused vaccines to prevent wastage
Source: Author’s own creation/work

Table A4 

Table A4

Level 2 resilience Sub-factors supporting risk mapping, modeling, planning and control (risk MMPC)

Level 1 resilience sub-factorsLevel 2 resilience sub-factors
Risk MMPC – product flowMapping of input, manufacturing, cold chain and vaccine supply bottlenecks
 Supply strategies to minimize stockouts
 Use of advanced modeling technologies to identify system risks
 Identification and prioritization of security and other threats
Capacity sharing and production incentivizing strategies
 Use of foreign manufactured vaccines to increase supply
 Implementation of regulatory standards and compliance requirements
 Immunization of health-care workers to minimize illness
 Guaranteed vaccine supply arrangements
 Strategic location of inventory
 Transportation assessments and validations
 Selection of suppliers based on technical and compliance capabilities
Risk MMPC – financial flowInvestment in capacity at risk by private sector, government, international organizations
 Use of contractual terms to mitigate financial risk
Risk MMPC – information flowMapping and control of cyber risks
 Use of electronic marketplaces to rapidly identify input suppliers
 Information dissemination to reduce vaccine hesitancy
 Tracking of vaccine serialization and adverse effects following immunization
 Use of monitoring and alert systems to identify risks and bottlenecks
 Availability of back up equipment for monitoring cold chain temperatures
Risk MMPC – vaccine recipient flowStrategies to reduce vaccine hesitancy
Risk MMPC – knowledge flowStrategies for transferring technology
 Minimization of liability associated with technology use and licensure
Risk MMPC – skilled worker flowEstablishment of regulatory training center
 Establishment of logistics training center
Risk MMPC – waste flowStrategies to minimize waste
 Ability to trace vaccine waste resulting from criminal activity
Source: Author’s own creation/work

Table A5 

Table A5

Level 2 resilience sub-factors supporting inter-organizational, cross-sector and cross-border collaboration (ICC collaboration)

Level 1 resilience sub-factorsLevel 2 resilience sub-factors
Collaboration – product flowCollaboration to build cold chain capacity, design air cargo logistics, transportation and last mile delivery
 Collaboration to expand and improve supplier and manufacturer capacity and procurement
 Collaboration for vaccine R&D and regulatory approval
 Collaboration in cross-border management
 Collaboration to ensure vaccine safety, security and quality assurance
Collaboration – financial flowGovernment subsidization of manufacturing capacity
 Government procurement of vaccines
 Multilateral and international organization funding of manufacturing capacity and procurement of vaccines
 Government subsidization of input manufacturing capacity
 Government subsidization of freight
Collaboration – information flowCollaboration for use of digital and advanced technologies to speed logistics operations
 Cooperation in disseminating information for decision-making
 Collaboration in providing information to encourage immunization
Collaboration – vaccine recipient flowCollaboration in managing distribution and mass vaccination logistics
 Ethical distribution of vaccines to remote and isolated vaccine recipients
Collaboration – knowledge flowPrivate sector collaboration to transfer technology
Collaboration – skilled worker flowN/A*
Collaboration – waste flowCross-border collaboration to redeploy unused vaccines to other countries prior to expiry

Note: *N/A – implies no references were coded to these nodes

Source: Author’s own creation/work

Table A6 

Table A6

Level 2 resilience sub-factors supporting network planning and design (network P &D)

Level 1 resilience sub-factorsLevel 2 resilience sub-factors
Network – product flowDesign of distribution and logistics network for reach and scalability
 Design for adequate cold chain infrastructure, capacity and efficiency
 Design for manufacturing scalability
 Design for mass vaccination scale and reach
Network – financial flowModeling and analysis of costs to meet mass vaccination budgets
Network – information flowUse of information systems to track real time data on cold chain temperatures
 Use of information systems to determine airport pairs for flight scheduling
Network – vaccine recipient flowDesign of vaccination site logistics for speed (queuing)
Network – knowledge flowIdentification of vaccine technology types and manufacturing requirements
 Building of regulatory capacity to meet requirements
Network – skilled worker flowDetermination of number of vaccinators and healthcare workers at mass vaccination sites
Network – waste flowDesign of sustainable or circular waste management systems
 Assessment of waste disposal capacity
 Use of real temperature data to control product waste
 Design of reverse logistics for disposal of unused vaccine
Source: Author’s own creation/work

Table A7 

Table A7

Level 2 resilience sub-factors supporting supply and demand planning and coordination

Level 1 resilience sub-factorsLevel 2 resilience sub-factors
Supply and demand planning and coordination – product flowManagement and synchronization of the flow of inventory
 Allocation, logistics, distribution and administration of vaccines
 Use of appropriate forecasting techniques
Supply and demand planning and coordination – financial flowExpense planning to ensure vaccine plans are within budget
Supply and demand planning and coordination – information flowRegistration and communication with vaccine recipients
 Recording of patient uptake
 Development of algorithms for inventory allocation
 Monitoring of inventory levels
Supply and demand planning and coordination – vaccine recipient flow*N/A
Supply and demand planning and coordination – knowledge flowDevelopment of forecasting expertise
Supply and demand planning and coordination – skilled worker flowDetermination of manpower requirements for resource planning
Supply and demand planning and coordination – waste flow*N/A

Note: *N/A – implies no references were coded to these nodes

Source: Author’s own creation/work

Table A8 

Table A8

Level 2 resilience sub-factors supporting pre-pandemic preparedness

Level 1 resilience sub-factorsLevel 2 resilience sub-factors
Pre-pandemic preparedness – product flowPre-pandemic global development of supplier, manufacturing, logistics and distribution capacity
 Validation of processes, equipment and routes
 Development of contingency plans for product flow changes
 Pre-Pandemic development of vaccine technologies
 Negotiation of public-private sector contracts for vaccine distribution during a pandemic
 Pre-pandemic development of regulatory reserve capacity
 Early negotiation of material and input supply agreements
Pre-pandemic preparedness – financial flowPre-pandemic investment planning
Pre-pandemic preparedness – information flowN/A*
Pre-pandemic preparedness – vaccine recipient flowDevelopment of vaccine deployment plan
 Planning of vaccination sites
 Readiness of vaccination sites for emergencies
Pre-pandemic preparedness – knowledge flowDevelopment of standard operating procedures (SOPs)
 Training on protocols for vaccine handling
Pre-pandemic preparedness – skilled worker flowN/A*
Pre-pandemic preparedness – waste flowN/A*

Note: *N/A – implies no references were coded to these nodes

Source: Author’s own creation/work

Table A9 

Table A9

Level 2 resilience sub-factors supporting complex system management skills

Level 1 resilience sub-factorsLevel 2 resilience sub-factors
Globally responsible leadershipDevelopment of national government vaccine diplomacy programs
 Global commitment and ethical responsibility of pharmaceutical and private sector firms
 Contribution of national government to intermediary organizations to support equitable global distribution of vaccines
System management skillsCross-functional, inter-organizational, cross-sectoral and cross-border teamwork
 Ability to leverage lessons from past experiences for future success
 Open communication
 Ability to build vaccine trust
 Ability to develop multi-stakeholder collaborative relationships
 Ability to work with ambiguity, complexity and uncertainty
 Ability to devise agile and adaptive strategies
 Ability to handle and manage risk
 Human-technology interaction
Source: Author’s own creation/work

Figure A1 

Figure A1

Strong correlation – Jaccard coefficient range: 0.7–1.0

Figure A1

Strong correlation – Jaccard coefficient range: 0.7–1.0

Close modal

Figure A2 

Figure A2

Moderate correlation – Jaccard coefficient range: 0.3–0.5

Figure A2

Moderate correlation – Jaccard coefficient range: 0.3–0.5

Close modal

Figure A3 

Figure A3

Circle graph of Level 1 sub-factors clustered based on coding similarity - Jaccard coefficient range: 0.7–1.0

Figure A3

Circle graph of Level 1 sub-factors clustered based on coding similarity - Jaccard coefficient range: 0.7–1.0

Close modal
Published by Emerald Publishing Limited. This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence maybe seen at Link to the terms of the CC BY 4.0 licenceLink to the terms of the CC BY 4.0 licence.

or Create an Account

Close Modal
Close Modal