Skip to main content

Developing a crisis leadership evaluation system for Chinese nursing staff during major infectious disease emergencies: a modified Delphi study

Abstract

Aims

To create a consensus on the nursing crisis leadership evaluation system during major infectious disease emergencies.

Background

Crisis leadership is critical to prevent and mitigate an infectious disease infectious disease public health emergency during crisis time. However, there has been no crisis leadership evaluation system for nursing staff during major infectious diseases emergencies in China.

Methods

We used a two-part modified Delphi method. Part 1 focused on creating a pool of indicators and developing an evaluation framework through a systematic literature review and a qualitative interview. Part 2 revised the indicators and built the final the evaluation system using two rounds of the Delphi surveys, following the Conducting and REporting of DElphi Studies (CREDES) guidance. Indicators were scored by a panel of experts based on the 5-point Likert scale. The weights of the indicators at each level were identified by analytical hierarchy process (AHP) methods.

Results

A consensus was reached on a framework for assessing crisis leadership in nursing. Experts who met the inclusion criteria participated in round 1 (n = 23) and 2 (n = 19). The recovery rates for the two rounds of the Delphi survey were 92% and 82%. The authority coefficients (Cr) were 0.88 and 0.93, respectively, indicating the high reliability of the consultation results. The Kendall coefficients (W) of the two rounds were 0.106 and 0.150 (P < 0.001). The final consensus set comprised 6 primary indicators, 18 secondary indicators, and 38 tertiary indicators. The Weights of the six primary indicators allocated by AHP, namely loading the responsibility, heading the team, governing the situation, foreseeing the crisis, thriving on crisis, and insisting on the faith, were 0.3056, 0.2500, 0.1944, 0.1389, 0.0833, and 0.0278.

Conclusion

A consensus-based, contemporary set of nursing crisis leadership evaluation systems in the context of major infectious disease emergencies has been identified. Ongoing work is needed to further develop a highly reliable scale, determine the current state of nursing crisis leadership, construct a targeted training curriculum, and implement the program into practice that managers may wish to use to assess, select, and develop the next generation of nursing leaders.

Peer Review reports

Background

Recent major infectious disease emergencies, such as the 2014 Ebola epidemics, the coronavirus disease 2019 (COVID-19) pandemic, and the 2022 mpox outbreak, spread rapidly worldwide and caused substantial morbidity and mortality [1]. Specifically, nearly half a million infections and over 50,000 deaths associated with novel coronavirus occurred in mainland China alone during the 2020–2022 COVID-19 period [2]. The pandemic posed a serious threat to social security, human health, and economic development. The effective control and mitigation of pandemic crises caused by infectious diseases are public health priorities.

Crises are often understood as events perceived by managers and stakeholders as unexpected, highly salient, and potentially devastating to individuals, organizations, and societies [3]. Crisis events are context-specific with varying characteristics; for example, epidemics are highly contagious and easily spread, whereas earthquakes are not. Crisis leadership refers to the process in which leaders take action to prepare for the onset of unexpected crises, respond to their salient effects, and grow from the devastating experiences of crises [4]. Crisis leadership in nursing focuses on six core attributes: clear, rapid, and honest communication; high-level collaboration; information sharing; prioritizing decision-making and equity; building trust; and competency [5]. Effective crisis leadership is critical to the survival and growth of an organization. Nursing staff, as the largest group of healthcare professionals, play an essential role in providing direct care to frontline patients and meeting the society’s health needs, especially during public health emergencies of infectious diseases. Crisis leadership is not limited to nursing managers; every nurse is a potential leader [6, 7]. We must recognize that COVID-19 will not be the last public health crisis that policymakers and healthcare professionals confront [8], and therefore nursing crisis leadership has a significant place in the domain of infectious disease prevention and control and deserves special attention.

When the COVID-19 pandemic crisis broke out, nursing leaders and their staff had to make quick decisions in unpredictable situations and promptly adjust work patterns and procedures [9]. In particular, frontline nurses faced multiple pressures: delivering life-saving treatments with limited healthcare resources, risking infection, and enduring psychological challenges such as fear, panic, and anxiety [10]. Given the multiple demands on nurses during crises, careful consideration must be given to the qualifications of nurses who comprise emergency or crisis response teams. These teams are critical frontline responders who are dispatched to provide essential medical relief and care to individuals impacted by a disaster or emergency [11].

In China, however, the nursing crisis response teams are staffed from various wards or departments. Apart from infection departments and intensive care units, nurses in general wards often lack experience in managing virulent infectious diseases and occupational protection against such diseases. Pre-service training for crisis response teams primarily relies on unannounced intensive emergency training as the main training mode, and the selection of personnel for clinical first-line emergency response teams is often based on subjective evaluation rather than systematic and objective criteria. These limitations hinder proactive and scientifically informed responses to crises. If properly managed, crisis events can serve as key turning points for positive change and offer new opportunities for development [12]. The overall level of crisis leadership among nursing staff determines, in part, the success or failure of an infectious disease crisis. A deeper understanding of nursing crisis leadership is urgently needed to prevent and control future infectious diseases emergencies and to cultivate the next generation of nurse leaders [13].

Many studies have explored crisis leadership and emphasized the need for preparedness to lead complex crisis events [14]. For example, a recent scoping review analyzed the evidence of various crisis leadership competencies during a pandemic and grouped them into task competencies (preparing and planning, communication, collaboration), people competencies (inspiring and influencing, leadership presence, empathy, and awareness), and adaptive competencies (decision making, systems thinking and sensemaking, tacit skills) [15]. Although these reviews were theory-based, describing the most common characteristics of crisis leadership [4, 5, 12, 15, 16], there was no specific research on nursing crisis leadership and the unique nature of nurses’ work during crises, as well as on the characteristics of infectious disease crisis events (e.g., COVID-19 pandemic). Notably, the literature lacks a distinct nursing crisis leadership evaluation system for major infectious disease emergencies. Additionally, several separate studies provided unsystematic conceptual frameworks of crisis leadership using subjective approaches [17, 18]; they did not follow rigorous methodologies such as PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) during development or publication [17, 18]; and many lacked theoretical underpinning [17, 18].

Therefore, we aimed to reach a Delphi-generated expert consensus on the crisis leadership characteristics of nursing staff and its evaluation indicator framework, with a focus on major infectious disease emergencies. A clear evaluation system of nursing crisis leadership is critical to minimize role confusion within nursing crisis response team and to help individuals understand their competencies in combating pandemic. In healthcare education setting, it can also inform the blueprinting of a curriculum, including supporting nursing staff, enhancing their skills through training, and strengthening their leadership to manage crises or pandemics successfully. This study provides a reference for healthcare organizations to assess, select, and nurture nursing leaders who can effectively respond to future crises.

Theoretical framework

The Conceptual Model of Crisis Leadership, known as FLIGHT model, was developed by Zheng et al. based on the case of a Chinese aircraft captain [19]. Using the classical grounded theory, the FLIGHT model identified the six dimensions of crisis leadership: foreseeing the crisis (F), loading the responsibility (L), insisting on the faith (I), governing the situation (G), heading the team (H), and thriving on crisis (T). A detailed description is shown in Fig. 1. This model offers an effective framework for crisis response and mitigation from a leadership perspective, transcending the traditional stage-based analysis of crisis management (e.g., pre-crisis, mid-crisis, and post-crisis). Among the various crisis management theories, the 4R Crisis Management Theory is widely applied [20, 21]. Pioneered by Robert Heath, the 4R Crisis Management Theory posits that the three phases of a crisis (pre-crisis, mid-crisis, and post-crisis) should be managed in a continuous and dynamic cycle through the four aspects: Reduction, Readiness, Response, and Recovery, to mitigate or prevent risks [20]. Despite the different stages of crisis events, data from our preliminary research with caregivers suggest that the entire crisis process, regardless of phase, requires nursing staff to possess common traits (e.g., responsibility). Therefore, we adopted the more integrated FLIGHT Model to identify its components in the nursing field and to construct an evaluation system for nursing crisis leadership in the context of major infectious disease emergencies.

Fig. 1
figure 1

The FLIGHT model of crisis leadership

Methods

Design

We employed the modified Delphi technique following the Conducting and REporting of DElphi Studies (CREDES) guidance, as detailed in Supplementary File 1 [22]. We conducted a two-phase design: (1) a systematic review and a qualitative interview were conducted to generate an initial set of potential indicators and develop an evaluation framework for nursing crisis leadership during major infectious disease emergencies, and (2) a two-round Delphi survey was performed to refine the indicators and finally reach a consensus on the nursing crisis leadership evaluation system in infectious public emergencies. The Delphi technique is recommended as a reliable method to achieve consensus on a research issue [23, 24]. The method involves an iterative process of repeated rounds of anonymous communication and can effectively gather the opinions of a group of experts. The first round of the classical Delphi is unstructured allowing experts to give open-ended presentations on issues they deem important [23, 24], whereas the modified Delphi method initially collects responses to a series of structured questions [25]. Studies have shown that the modified Delphi technique is more highly effective compared to the original Delphi method [25]. These steps are explained below (Fig. 2).

Phase 1: Establishing a framework for nursing crisis leadership in major infectious disease emergencies

A systematic review of nursing crisis leadership research was performed following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines [26]. Chinese and English databases were comprehensively searched, including PubMed, Web of Science, China Biology Medicine (CBM), China National Knowledge Infrastructure (CNKI), China Science and Technology Journal Database (VIP), and Wanfang Database. The search was done using the search term ‘crisis leadership’ and ‘pandemic’ for articles published from the severe acute respiratory syndrome (SARS) pandemic in 2003 to February 28, 2023. Articles were included if they met the following criteria: (1) studies focused on pandemics and leadership; (2) studies were written in English or Chinese; (3) studies were published in peer-reviewed journals. Duplicates, news, and letters were excluded. Of 3560 articles identified, we screened 2998 articles by titles and abstracts to determine eligibility. Of these, 89 full-text articles were available for review. Finally, 43 articles were eligible for inclusion (see Supplementary file 2). The flowchart of the study selection is provided in Supplementary file 3. Based on the framework of the crisis leadership conceptual model, the obtained data were extracted and categorized into six dimensions: foreseeing the crisis, loading the responsibility, insisting on the faith, governing the situation, heading the team, and thriving on crisis.

In addition, we interviewed 11 nursing managers and 10 clinical nurses using semi-structured individual interviews to supplement the evaluation indicators. Detailed information about the interviewees, the interview process and the results have been published [27]. A preliminary evaluation index system was formed after iteratively review and discussion by the research team, consisting of 6 primary indicators, 17 secondary indicators, and 52 tertiary indicators.

Phase 2: Two-Round Delphi survey to determine the final evaluation system

Expert panel selection

Based on the nature and size of the study, strict inclusion criteria were developed for the Delphi expert consultation to assure the scientific validity, reliability, and rigor of the evaluation system. The inclusion criteria for experts were as follows: (1) 10 years or more working experience in medical management, nursing management, or scale development; (2) a bachelor’s degree or above; (3) intermediate or higher professional title; (4) participation in COVID-19 treatment or management work; and (5) informed consent and voluntary participation in this study. Additionally, the disciplinary representation and geographical distribution of the experts were taken into account. A purposive method was used to recruit experts from different regions of China.

Fig. 2
figure 2

Research design flowchart

Data collection

In round 1, a structured questionnaire was meticulously crafted by the research team, consisting of three parts (see Supplementary file 4). The first part is an introduction to the experts that describes the background of the study, its purpose and the requirements for completing the questionnaire. The second part is the basic information of experts, including age, working years, research direction, professional title, familiarity coefficient (Cs), and judgment coefficient (Ca) [28]. The Cs data refers to expert’s familiarity with the survey’s content, including five levels (0.20 = very unfamiliar, 0.4 = not familiar, 0.6 = generally familiar, 0.8 = familiar, 1.0 = very familiar) [28]. The Ca data, representing the experts’ judgment basis, were divided into four levels (theoretical analysis, practical work experience, domestic and foreign literature reference, and intuitive judgment) [28]. The third part is the initial nursing crisis leadership evaluation framework. The list included 52 items collected from existing literature and in-depth semi-structured interviews. Experts were requested to rate the importance of each item on a 5-point Likert scale from 1 (unimportant) to 5 (very important). A blank column was also provided for experts to give comments and additional suggestions. Prior to initiating the round 1, the questionnaire was rigorously reviewed by two experts (LHJ and HXJ) with expertise in managing and mitigating pandemics. This critical assessment aimed at testing the questionnaire’s structure and content, ascertaining its robustness for the subsequent stages.

After the first-round questionnaires were returned, the corresponding entries were modified, deleted, or added according to the feedback from the indicator screening criteria and expert comments. In round 2, experts were invited to answer the modified questionnaire in the same manner as in round 1 (see Supplementary file 5). For those statements with non-consensus, the experts provided free-text answers to newly formulated questions in the second round. Each round of the Delphi questionnaire was sent to the experts by e-mail or WeChat to avoid unintentional guiding feedback and collected within two weeks. If experts did not return within 10 days, they were reminded by email or phone. Round 1 was completed from 12/27/2022 to 01/11/2023 and round 2 from 02/22/2023 to 03/08/2023.

Data analysis

SPSS 26.0 and Microsoft Excel were used for statistical analysis. The general information about the experts was analyzed by using frequency, rate, mean, and standard deviation (SD). The expert positive coefficient is shown by the questionnaire recovery rate, with a recovery rate > 70% is considered satisfactory [29]. Furthermore, the authority coefficients (Cr) is the degree of experts’ authority, determined by a combination of Cs (expert’s familiarity with the items) and Ca (the judgment basis). The formula is Cr = (Ca + Cs) /2. When Cr ≥ 0.70, the result is generally considered reliable [29]. The coordination degree of expert opinions is indicated by the coordination coefficient (Kendall’s W). A higher Kendall’s W value means better coordination of the items and higher consistency of expert opinions. In this study, the criteria for selecting indicators were: average importance value ≥ 3.5 points and coefficient of variation (CV) [(SD/average importance value) × 100%] ≤ 0.25, as well as combining the experts’ opinions on the modification of the items and the discussion results of the subject group to select the indicators [30]. The pre-defined cut-off for consensus on an indicator or set of similar opinions was ≥ 70% [31]. The analytical hierarchy process (AHP) is utilized to calculate the weights of the entries at each level [32].

Ethical considerations

Participation was voluntary and the panel had the right to refuse or withdraw from the study at any time. At the beginning of the study, all participants were informed of the purpose of the study and signed an informed consent form. We obtained approval from the ethics committee of the Second Affiliated Hospital of Air Force Medical University (No. K202303-13).

Results

Basic information of experts

In the first round, 25 experts were invited, 23 of whom responded (response rate 92%). The 23 participants were female with a mean age of 51.04 years (SD = 7.772) and an average work experience of 30.22 years (SD = 9.327). In the second round, 19 of the 23 invited experts responded with a response rate of 82%. The mean age of the 19 respondents was 48.79 years (SD = 8.370) and the mean work experience was 27.74 years (SD = 10.082). All participants in a two-round Delphi survey were a deputy senior title or above, and a bachelor’s degree or above. The basic details are shown in Table 1.

Table 1 Participant demographic data

Authority and coordination of experts

In round one, the Ca was 0.9, the Cs was 0.8, and the Cr of experts was 0.88. In round two, the Ca was 1.0, the Cs was 0.9, and the Cr was 0.93. The Kendall’s W for the two rounds were 0.106 (χ2 = 173.041) and 0.150 (χ2 = 262.238), respectively, and the results were tested to be statistically significant (P < 0.001). The relatively low Kendall’s W values indicate a modest level of agreement among raters, suggesting that while consensus was achieved, the degree of consistency in rankings was not strong. This may be attributed to the complexity or subjectivity of the evaluated criteria. Despite the low values, the statistical significance confirms that the observed agreement is not due to chance, supporting the validity of the consensus process.

Indicator modifications

Through a literature review and semi-structured interviews, an initial nursing crisis leadership evaluation framework was developed, including 6 primary indicators, 17 secondary indicators, and 52 tertiary indicators. After the first round, 116 comments from 14 experts were received for revisions. Consensus was reached on tier 1 indicators and a new indicator “executive ability” was added to tier 2 indicators. 35 tertiary items were deleted, added, merged, or split. Specifically, the ability to identify public health emergencies of different infectious diseases was added in the sub-dimension of event screening ability. Experts suggested that honor belongs not only to the individual, but also to the organization, so we have revised “Win honor for the individual” to “win honor for the individual and the collective”. In terms of educational guidance ability, two experts recommended to remove “provide clinical supervision to nursing students”. The reason is that during the fight against infectious diseases, where the virus spreads rapidly and patients are in critical condition, nursing students rarely participate in such situations as members of the crisis response team. It was suggested to add an item “the ability to grasp the latest evidence-based evidence” under the rapid learning ability subdimension. The second round received 52 revisions from 13 experts. The experts agreed on the first-level and second-level items and amended the content of the tertiary indicators. A high-level consensus was reached after the second Delphi survey. Finally, the nursing crisis leadership evaluation system in major infectious disease emergencies included 6 primary indicators, 18 secondary indicators, and 38 tertiary indicators (Table 2). The weights of the indicators at each tier by AHP were shown in Table 2.

Table 2 An evaluation system of crisis leadership among Chinese nursing staff in major infectious disease emergencies

Discussion

In this study, we integrated evidence from a systematic review and semi-structured interviews, and performed a two-round modified Delphi survey to reach a consensus on nursing crisis leadership in major infectious disease emergencies. The final consensus set includes 6 primary indicators, 18 secondary indicators, and 38 tertiary indicators.

Based on the FLIGHT theoretical framework, we constructed a generic crisis leadership evaluation system for nursing staff. The framework did not distinguish between managers and clinical nurses for two reasons. First, it aligns with the WHO’s policy priority to invest in leadership development for nurses [33]. Leadership, unlike managerial competence by nature, does not rely on a formal position [34]. Second, the data obtained from the qualitative interviews confirmed this. We conducted in-depth interviews with 11 nursing managers and 10 clinical nurses, all of whom were involved in frontline crisis response during the outbreak. The results verified that the traits required for two different positional groups during an infectious disease crisis were similar. For example, managers emphasized indicators such as executive ability, responsibility and a sense of honor, which were equally indispensable for clinical nurses. The six primary abilities are critical at all stages, for example, at any stage before, during and after a crisis, when reflection and fast learning ability are required for continuous improvement. This validated the scientific validity and rationality of opting for the FLIGHT model as a framework for research, rather than by crisis phase.

Among the evaluation indicators, loading the responsibility provided the largest weight, followed by heading the team, governing the situation, foreseeing the crisis, thriving on crisis, and insisting on the faith. This suggests that loading the responsibility was the most critical indicator for the nursing crisis leadership in major infectious disease emergencies. Regarding the sub-dimensions, a sense of the big picture and responsibility are particularly prominent. The recent crisis events, such as the Ebola outbreak, have posed huge challenges to healthcare systems. Due to the inherent nature of infectious diseases (e.g., urgent time, limited information, rapid virus transmission, and life-threatening), nursing staff not only face health risks but also endure high-intensity rescue and care work. Furthermore, when confronted with major outbreaks and emergent crises, nursing staff need to adopt a holistic perspective whenever possible, take into account the entire organization, and seize critical decision-making moments to identify optimal solutions to the crisis (e.g., shortage of supplies, occupational exposure, power outage, etc.). These challenges make it particularly difficult for nursing staff, especially non-managerial nurses, to respond effectively to infectious disease crises. Therefore, hospitals should prioritize selecting nursing staff with global awareness and a strong sense of responsibility to form emergency teams, which is a key factor in effectively responding to emerging infectious disease emergencies.

Additionally, heading the team was identified as an important indicator of nursing crisis leadership in major infectious disease emergencies. It refers to the ability of nursing staff to motivate and stabilize team and collaborate effectively during major infectious diseases emergencies in this study. During the COVID-19 pandemic, numerous studies have demonstrated that frontline nursing staff experienced high levels of psychological distress, including anxiety, depression, fear, hopelessness, loss of purpose, insecurity, and posttraumatic stress disorder (PTSD) [35]. Heading the team can contribute to positive cognitive appraisal, which helps boost confidence in nursing staff to overcome the epidemic, relieve their psychological stress, and enable them to regulate emotions effectively [36]. Among the sub-dimensions of heading the team, the one with the highest weight was evocative capacity, which refers to the ability to attract, motivate, and unite people to work together. Consistent with previous research, it could inspire and evoke hope and confidence in colleagues and patients, enabling them to combat infectious diseases with a positive mindset, greater passion, and motivation. To enhance these abilities, we suggest that the key way is through effective communication, the port of emotional and psychological connection with each other. It is also vital to empathize with others, lead by example, and demonstrate confidence to build emotional trust, evoke inspiration, and stabilize the team.

Several scholars argued that the ability to control the situation was an important indicator in responding to infectious disease public health emergencies. This study found that nursing staff applied decision-making, organizational, executive, and educational guidance abilities to manage crises and respond effectively to major infectious disease emergencies. Based on feedback from the panelists, executive ability was added to the sub-dimension of control power after the first Delphi round. Previous studies pointed out that, to a certain extent, the executive ability of nursing staff is closely related to the survival and development of the hospital [37]. Executive ability in this study refers to the ability of the capacity of an individual or group to accurately and swiftly complete anti-epidemic tasks or achieve goals. Perhaps one of the greatest advantages of possessing executive ability is the speed with which actions can be implemented. Individuals with high executive competence are aware of their responsibilities and tend to propose ideas proactively and effectively, even when facing challenges, thereby enhancing the hospital’s overall crisis management. Thus, the above results highlight that executive ability is an important indicator for assessing nursing crisis leadership during major infectious disease emergencies.

The selection of experts was a critical factor influencing the quality of the Delphi method. To ensure high-quality consultation, all selected experts had frontline experience during the COVID-19 pandemic and had more than 10 years of experience in fighting viruses and managing and controlling public health emergencies of infectious diseases. We choose experts from 12 provinces, autonomous regions, municipalities in China, including Shaanxi, Shandong, Yunnan, Gansu, Xinjiang, Zhejiang, Beijing, Hubei, Hunan, Shanghai, Chongqing, and Guangdong. The effective response rates for the two rounds of expert consultation were 92% and 82% respectively, and the experts put forward a total of 168 constructive suggestions, showing the high level of engagement and support from the experts for this study. After two rounds of consultation, the authority coefficients were 0.88 and 0.93, respectively, ensuring the authority and reliability of the results. The importance scores for all items were 4.30-5.00, and CVs were 0–25%. The CV for most items decreased from round 1 to round 2, indicating that the degree of fluctuation of expert opinions was small, the degree of coordination was improved, and experts’ opinions tended to be consistent.

The variability in expert opinions observed, particularly in round 1, can be attributed to several factors. First, the diverse professional backgrounds and experiences of the experts, including nursing managers, medical managers, educators, and researchers from various regions of China, shaped their unique perspective. Second, the complexity of nursing crisis leadership in major infectious disease emergencies likely led to differing interpretations of the indicators. For instance, clinically experienced experts prioritized practical skills (e.g., executive ability), while those with administrative backgrounds emphasized strategic or emotional competencies (e.g., evocative ability, sense of honor). Finally, the iterative nature of the Delphi method, which encourages reflection and reconsideration, contributed to the variability. As experts reviewed peer feedback and reflected on their responses in round 2, their opinions evolved, leading to greater consensus. This demonstrates the Delphi method’s effectiveness in balancing diverse viewpoints while achieving consensus. Overall, this study not only provides a reasonable and scientific evaluation framework of nursing crisis leadership in major infectious disease emergencies in China but also identifies key dimensions by calculating weights of the indicators.

Limitations

Although the Delphi technique is a robust tool and has been extensively used in various health domains, including nursing, it has certain limitations. First, the evidence was drawn from the expert consensus rather than experimental results, as the experimental or quasi-experimental designs would not be practical given real-world considerations. Second, even the CREDES standards are inconclusive about the selection of expert panels and the sample sizes needed for optimal study results [38]. While our Delphi participants represented diverse health professions and expertise, they may not fully represent the views of everyone in the industry, and further research on a broader national scope will enrich the results of this study. Additionally, the number of recruited experts for this study was relatively small but consistent with previous studies of panels of 10–50 experts [32, 39]. Third, it was difficult to achieve a higher Kendall’s W score because of the different backgrounds and experiences of the respondents and the fact that the meaning of the two-round questionnaires was insufficiently explained. Finally, this Delphi technique focused specifically on nursing crisis leadership in major infectious disease emergencies, with participants from China. Thus, the findings may not be generalizable to other contexts or populations. It is vital to consider the cultural and contextual differences across countries.

Future research directions

Subsequent research on the evaluation system will focus on acceptance, translation, implementation, and evaluation. Acceptance will grow as we develop intervention strategies and operational methods to improve their operationalization. Translation, that is, translating the evaluation system of this study into a specific easy-to-use scale, will be conducted through extensive validation to refine the identified indicators of nursing crisis leadership. The validity, reliability, differentiation, and sensitivity of the assessment tools must be rigorously tested. Implementation will involve developing a targeted training curriculum, and designing and testing effective strategies to implement the program into practice. In addition, conducting quantitative studies, such as questionnaires, will help clarify the current state of crisis leadership among nursing staff at various levels. Qualitative research, such as interviews from different perspectives including hospital directors, nursing managers, nursing educators, clinical caregivers, and other stakeholders, is also recommended to provide insight into influencing factors and training needs. Finally, as scientific knowledge advances, it is imperative to constantly evaluate and incorporate the latest evidence to provide nursing staff with an optimal evaluation system and improved practices.

Implications for practice

An evaluation system for nursing crisis leadership can strongly contribute to the leadership development of nursing staff during crisis. For nursing staff, the findings can help minimize role confusion and understand their competencies in pandemic response, thus guiding the selecting of appropriate enhancement programs to address individual deficiencies. For educators, it is necessary to identify gaps in current training programs to better prepare nurses for future pandemic crises. Existing training on infectious disease outbreaks is often incomplete, e.g., focusing on prevention, control skills, and mental health [40], yet neglecting the development of early warning skills. Additionally, trainers were selected by separate organizations without uniform and clear qualification criteria, e.g. their experience in outbreak management or handling was not reported by the studies [41]. The effectiveness of the training was difficult to assess accurately; many studies evaluated short-term outcomes after training but fail to measure long-term impacts in real-world practice [41, 42], especially regarding nurses’ ability to govern situation and thrive during crises in epidemic settings.

Our interviews revealed that frontline experience during epidemics significantly influenced nurses’ crisis leadership levels. Therefore, managers should strengthen training for new nurses to prepare future nursing leaders for infectious disease crisis. It is recommended to conduct research on emerging infectious disease outbreaks, focusing on prediction and early warning, and to develop an early warning model tailored for nursing staff. Additionally, patient care histories of individuals with typical infection symptoms should be screened and extracted from literature and medical records to create a case bank of emergency care scenarios from major infectious disease outbreaks. Virtual simulation is highly recommended due to its multiple advantages, such as providing realistic scenarios, avoiding infections caused by improper handling, and reducing site setup costs. An AI learning platform built on a nurses’ portrait system is also being suggested to intelligently assign personalized learning resources to new nurses. These measures aim to strengthen three capacities: foreseeing the crisis, governing the situation, and thriving on crisis. Additionally, managers can use diverse strategies to promote the indicators of taking the responsibility, insisting on the faith, and heading the team. Examples include mainstream media campaigns and recognition of anti-epidemic heroes. These efforts can create a united and harmonious departmental culture, enhance the attractiveness of the nursing team, and establish a role model effect.

For the global nursing community, we hope that the finding will drive reform of international nursing education to intentionally teach and develop crisis leadership for future nursing leaders. It must be noted that the current nursing education systems lack leadership training in medical schools, offer only elective courses, or fail to reach every student, which is concern [43]. We recommend integrating crisis leadership development for future pandemics into university and graduate education curricula.

At the policy level, we propose establishing and promoting a national acute infectious disease team, developing a national-level management information system to assess the team capacity, and implementing a unified management system and certification procedures. Second, we recommend developing a scientific and reasonable resource allocation plan and equipment strategy for the emergency response team. Third, a cross-regional intelligent dispatch system should be established to enhance inter-regional collaboration. At the provincial and municipal levels, specialized emergency response teams for major infectious disease outbreaks should be established in accordance with regional characteristics, operating on a ‘peacetime-crisis’ model to strengthen risk assessment and emergency preparedness for public health emergencies.

Conclusion

Leadership has become one of the priority global strategic directions for nursing. In this study, we set out to formulate a scientifically rigorous and credible crisis leadership evaluation framework based on the Conceptual Model of Crisis Leadership. The evaluation system consists of 6 primary indicators, 18 secondary indicators, and 38 tertiary indicators. Among these, loading the responsibility, heading the team, governing the situation emerged as the top three core dimensions. The results indicated that the system can be used in the selection, training, and evaluation of nursing crisis leadership performance before, during, and after a crisis.

Data availability

The data that support the findings of this study are available from the corresponding author.

Abbreviations

AHP:

Analytical hierarchy process

CBM:

China Biology Medicine

CNKI:

China National Knowledge Infrastructure

CREDES:

Conducting and REporting of DElphi Studies

CV:

Coefficient of variation

PRISMA:

Preferred Reporting Items for Systematic Reviews and Meta-Analyses

SARS:

Severe acute respiratory syndrome

SD:

Standard deviation

VIP:

China Science and Technology Journal Database

References

  1. Bollyky TJ, Castro E, Aravkin AY, et al. Lancet. 2023;401(10385):1341–60. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/S0140-6736(23)00461-0. Assessing COVID-19 Pandemic Policies and Behaviours and their Economic and Educational Trade-Offs Across US States From Jan 1, 2020, to July 31, 2022: An Observational Analysis.

  2. Chinese Center for Disease Control and Prevention. National epidemic of novel coronavirus infections. 2023. https://www.chinacdc.cn/jksj/xgbdyq/202411/t20241112_302569.html

  3. Bundy J, Pfarrer MD, Short CE. WT’ C. Crises and crisis management: integration, interpretation, and research development. J Manage. 2017;43(6):1661–92. https://doiorg.publicaciones.saludcastillayleon.es/10.1177/0149206316680030.

    Article  Google Scholar 

  4. Wu YL, Shao B, Newman A, Schwarz G. Crisis leadership: A review and future research agenda. Leadersh Q. 2021;32(6):101518–39. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.leaqua.2021.101518.

    Article  Google Scholar 

  5. Kim SJ. Crisis leadership: an evolutionary concept analysis. APPL NURS RES. 2021;60:151454–60. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.apnr.2021.151454.

    Article  PubMed  Google Scholar 

  6. American Nurses Association. Nursing: Scope and Standards of Practice, Fourth Edition. Silver Spring, MD: American Nurses Association; 2021.

  7. American Nurses Association. Lead like a nurse: leadership in every healthcare setting. American Nurses Association, Inc.; 2018.

  8. Serchen J, Cline K, Mathew S, Hilden D. Preparing for future pandemics and public health emergencies: an American college of physicians policy position paper. Ann Intern Med. 2023;176(9):1240–4. https://doiorg.publicaciones.saludcastillayleon.es/10.7326/M23-0768.

    Article  PubMed  Google Scholar 

  9. Kvist T, Seitovirta J, Nurmeksela A. Nursing leadership from crisis to postpandemic. J Nurs Manage. 2022;30(7):2448–50. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/jonm.13699.

    Article  Google Scholar 

  10. Liu D, Xie S, Jing J, Niyomsilp E, Xie L, Nie X, Liang Y. The effect of perceived organizational support and Ego-Resilience on the relationship between occupational stressors and compassion fatigue in COVID-19 frontline nurses: A Cross-Sectional study in Sichuan, China. BMC Nurs. 2024;23(1):817. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12912-024-02473-z.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Almukhlifi Y, Crowfoot G, Wilson A, Hutton A. Disaster knowledge, skills, and preparedness among emergency medical services in Saudi Arabia. Disaster Med Public. 2024;18:e233. https://doiorg.publicaciones.saludcastillayleon.es/10.1017/dmp.2024.276.

    Article  Google Scholar 

  12. Eid J, Hansen AL, Andreassen N, Espevik R, Brattebø G, Johnsen BH. Developing local crisis Leadership - A research and training agenda. Front Psychol. 2023;14:1041387–95. https://doiorg.publicaciones.saludcastillayleon.es/10.3389/fpsyg.2023.1041387.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Rosser EA, Edwards S, Kwan R, Ito M, Potter DR, Hodges KT, Buckner E. The global leadership mentoring community: an evaluation of its impact on nursing leadership. Int Nurs Rev. 2023;70(3):279–85. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/inr.12860.

    Article  PubMed  Google Scholar 

  14. Hertelendy AJ, Chekijian S, McNulty E, et al. Crisis leadership: A case for inclusion in accredited master of public health program curricula. Public Health. 2022;209:14–8. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.puhe.2022.05.012.

    Article  CAS  PubMed  Google Scholar 

  15. Sriharan A, Hertelendy AJ, Banaszak-Holl J, Fleig-Palmer MM, Mitchell C, Nigam A, Gutberg J, Rapp DJ, Singer SJ. Public health and health sector crisis leadership during pandemics: A review of the medical and business literature. Med Care Res Rev. 2022;79(4):475–86. https://doiorg.publicaciones.saludcastillayleon.es/10.1177/10775587211039201.

    Article  PubMed  Google Scholar 

  16. Nicola M, Sohrabi C, Mathew G, Kerwan A, Al-Jabir A, Griffin M, Agha M, Agha R. Health policy and leadership models during the COVID-19 pandemic: A review. Int J Surg. 2020;81:122–9. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.ijsu.2020.07.026.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Glotzbecker MP. Crisis leadership: lessons learned from the COVID pandemic. J Pediatr Orthoped. 2022;42(Suppl 1):S56–9. https://doiorg.publicaciones.saludcastillayleon.es/10.1097/BPO.0000000000002068.

    Article  Google Scholar 

  18. Chekijian S, Hertelendy A, McNulty E, Ciottone GR. Integrating crisis leadership in academic medicine. BMJ Lead. 2022;6(4):303–6. https://doiorg.publicaciones.saludcastillayleon.es/10.1136/leader-2021-000585.

    Article  PubMed  Google Scholar 

  19. Zheng X, Guo Y, Liu Z. Constructing the conceptual model of crisis leadership: A qualitative study based on the case of Chinese flight captain Liu Chuanjian. Chin J Manage. 2021;18(1):12–21. https://doiorg.publicaciones.saludcastillayleon.es/10.3969/j.issn.1672-884x.2021.01.002.

    Article  Google Scholar 

  20. Heath R. Crisis management. Beijing: Citic Press Corporation; 2001.

    Google Scholar 

  21. Wang J, Liu H. Analysis of public hospital network public opinion and crisis management countermeasures from the perspective of 4R crisis management. Chin Hosp. 2024;02(28):95–7. https://doiorg.publicaciones.saludcastillayleon.es/10.19660/j.issn.1671-0592.2024.2.24.

    Article  Google Scholar 

  22. Jünger S, Payne SA, Brine J, Radbruch L, Brearley SG. Guidance on conducting and reporting DElphi studies (CREDES) in palliative care: recommendations based on a methodological systematic review. Palliat Med. 2017;31(8):684–706. https://doiorg.publicaciones.saludcastillayleon.es/10.1177/0269216317690685.

    Article  PubMed  Google Scholar 

  23. Powell P C. The Delphi technique: Myths and realities. J Adv Nurs. 2003;41(4):376–82. https://doiorg.publicaciones.saludcastillayleon.es/10.1046/j.1365-2648.2003.02537.x.

    Article  PubMed  Google Scholar 

  24. Trevelyan EG, Robinson PN. Delphi methodology in health research: how to do it? Eur J Integr Med. 2015;7(4):423–8. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.eujim.2015.07.002.

    Article  Google Scholar 

  25. Veugelers R, Gaakeer MI, Patka P, Huijsman R. Improving design choices in Delphi studies in medicine: the case of an exemplary physician Multi-Round panel study with 100% response. Med Res Methodol. 2020;20(1):156. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12874-020-01029-4.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and Meta-Analyses: the PRISMA statement. Plos Med. 2009;6(7):e1000097. https://doiorg.publicaciones.saludcastillayleon.es/10.1371/journal.pmed.1000097.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Chen C, Hu X, Jiang W, Zheng X, Mu H, Zhang M, Lang H. Characteristic elements of nursing crisis leadership in infectious public health emergencies: A qualitative study. J Nurs Sci. 2023;38(16):77–81. https://doiorg.publicaciones.saludcastillayleon.es/10.3870/j.issn.1001-4152.2023.16.077.

    Article  Google Scholar 

  28. Luo Z, Zhou Z, Hao Y, Feng J, Gong Y, Li Y, Huang Y, Zhang Y, Li S. Establishment of an indicator framework for the transmission risk of the Mountain-Type zoonotic visceral leishmaniasis based on the Delphi-Entropy weight method. Infect Dis Poverty. 2022;11(1):122. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s40249-022-01045-0.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Li X, Ding L, Ning P, Li Y, Wei H, Meng Q. Construction of a nurses’ interpersonal communication knowledge system: A Delphi study. Nurs Educ Today. 2023;120:105630. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.nedt.2022.105630.

    Article  Google Scholar 

  30. Wei J, Fang X, Qiao J, et al. Construction on teaching quality evaluation indicator system of Multi-Disciplinary team (MDT) clinical nursing practice in China: A Delphi study. Nurs Educ Pract. 2022;64:103452. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.nepr.2022.103452.

    Article  PubMed  Google Scholar 

  31. Mustafa HJ, Sambatur EV, Shamshirsaz AA, et al. Monitoring and management of hemolytic disease of the fetus and newborn based on an international expert Delphi consensus. Am J Obstet Gynecol. 2024. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.ajog.2024.11.003.

    Article  PubMed  Google Scholar 

  32. Yang X, Li L, Liu Y, et al. Establishing quality evaluation system of nursing management in fever clinics: A Delphi method. J Nurs Manage. 2021;29(8):2542–56. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/jonm.13408.

    Article  Google Scholar 

  33. World Health Organization. Global Strategic Directions for Nursing and Midwifery 2021–2025. World Health Organization. 2021. https://doiorg.publicaciones.saludcastillayleon.es/https://www.who.int/publications/i/item/9789240033863

  34. Ferrazzi K, Weyrich N. Leading without authority: how the new power of Co-Elevation can break down silos. Transform Teams, and Reinvent Collaboration: Penguin Random House; 2020.

    Google Scholar 

  35. Lee B, Ling M, Boyd L, Olsson C, Sheen J. The prevalence of probable mental health disorders among hospital healthcare workers during COVID-19: A systematic review and Meta-Analysis. J Affect Disorders. 2023;330:329–45. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.jad.2023.03.012.

    Article  PubMed  Google Scholar 

  36. Wang H, Zhou X, Jia X, Song C, Luo X, Zhang H, Wu H, Ye J. Emotional exhaustion in Front-Line healthcare workers during the COVID-19 pandemic in Wuhan, China: the effects of time pressure, social sharing and cognitive appraisal. BMC Public Health. 2021;21(1):829. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12889-021-10891-w.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  37. He H. Study On the Index System of the Clinical Nurses’ Executive Ability Evaluation. Sichuan University; 2021.

  38. Jing Y, Liu R, Chu H, Sun W. Interpretation of standards for conducting and reporting Delphi studies (CREDES) in healthcare research. Chin J Evidence-Based Med. 2023;23(2):233–9. https://doiorg.publicaciones.saludcastillayleon.es/10.7507/1672-2531.202210047.

    Article  Google Scholar 

  39. Jiang N, Liu WB, Zong Y, Yu L, Cheng S. Construction of an index system of core competence assessment for sleep medicine nurse specialists in China: A Delphi study. BMC Nurs. 2024;23(1):689. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12912-024-02349-2.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Ni L, Yin X, Liu L, Sun K, Zhang W. Research on the effectiveness of the training of nosocomial infection control specialist nurses under the background of the new crown epidemic based on Competence-Based theory. Altern Ther Health M. 2024.

  41. Wu C, Zhang H, Lin Y, Yuan W, He J, Li L, Jiang D, Ji Z, Lang H. Construction and application of the core competence course training system for infectious disease specialist nurses. BMC Med Educ. 2024;24(1):410. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12909-024-05405-2.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Liang B, Zhang J, Qu Z, Jiang N, Chen C, Cheng S, Li L. Development of COVID-19 infection prevention and control training program based on ADDIE model for clinical nurses: A Pretest-Posttest study. Nurs Health Sci. 2024;26(4):e13194. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/nhs.13194.

    Article  PubMed  Google Scholar 

  43. Cabell GH, Anjorin A, Price M, Biswas S, Doty JP. How the COVID-19 pandemic has demonstrated a need for increased leadership education in medicine. J HealthC LeadersH 2021;13:137–8. https://doiorg.publicaciones.saludcastillayleon.es/10.2147/JHL.S317847.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We acknowledge the respondents who completed the questionnaire in this study.

Funding

This study was sponsored by Shaanxi Provincial Key R&D Project (No. 2024SF-YBXM-666), Army Nursing Innovation and Cultivation Special Project (No. 2023HL008), Scientific and Technological Research Project on Major Issues in Military and Aviation Medicine (No. 2023JSYX19).

Author information

Authors and Affiliations

Authors

Contributions

Changchang Chen: Conceptualization, Methodology, Data curation, Formal analysis, Investigation, Supervision, Methodology, Project administration, Writing-original draft. Xutong Zheng: Conceptualization, Methodology, Data curation, Formal analysis, Investigation, Supervision, Project administration, Writing-review & editing. Man Zhang: Supervision, Methodology, Project administration, Writing-review & editing. Luxi Zhang: Investigation, Validation, Writing-review & editing. Wenjie Chen: Formal analysis, Writing-original draft, Writing-review & editing. Shizhe He: Data curation, Investigation, Supervision, Methodology, Writing-review & editing. Hezi Mu: Formal analysis, Project administration, Writing-review & editing. Xuejun Hu: Conceptualization, Methodology, Data curation, Formal analysis, Supervision, Project administration, Writing-review & editing. Hongjuan Lang: Conceptualization, Methodology, Data curation, Formal analysis, Supervision, Project administration, Writing-review & editing.

Corresponding authors

Correspondence to Xuejun Hu or Hongjuan Lang.

Ethics declarations

Ethical approval and consent to participate

Participation was voluntary and the panel had the right to refuse or withdraw from the study at any time. At the beginning of the study, all participants were informed of the purpose of the study and signed an informed consent form. The study obtained approval from the ethics committee of the Second Affiliated Hospital of Air Force Medical University (No. K202303-13) in accordance with the Declaration of Helsinki.

Consent for publication

Not application.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, C., Zheng, X., Zhang, M. et al. Developing a crisis leadership evaluation system for Chinese nursing staff during major infectious disease emergencies: a modified Delphi study. BMC Nurs 24, 423 (2025). https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12912-025-03050-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12912-025-03050-8

Keywords