eISSN: 1731-2531
ISSN: 1642-5758
Anaesthesiology Intensive Therapy
Current issue Archive Manuscripts accepted About the journal Supplements Editorial board Reviewers Abstracting and indexing Subscription Contact Instructions for authors Publication charge Ethical standards and procedures
Editorial System
Submit your Manuscript
SCImago Journal & Country Rank
4/2023
vol. 55
 
Share:
Share:
Original article

WHO Surgical Safety Checklist and Anesthesia Equipment Checklist efficacy in war-affected low-resource settings: a prospective two-arm multicenter study

Kateryna Bielka
1
,
Iurii Kuchyn
1
,
Michael Frank
1
,
Ihor Sirenko
1, 2
,
Uliana Kashchii
1
,
Artem Yurovich
3
,
Hanna Fomina
1
,
Ivan Lisnyy
1, 4
,
Nataliia Semenko
1

  1. Department of Surgery, Anesthesiology and Intensive Care, Bogomolets National Medical University, Kyiv, Ukraine
  2. Kyiv City Maternity Hospital #5, Kyiv, Ukraine
  3. Mukachevo Central District Hospital (St. Martin Hospital), Mukachevo, Ukraine
  4. National Cancer Institute, Kyiv, Ukraine
Anaesthesiol Intensive Ther 2023; 55, 4: 291–296
Online publish date: 2023/11/04
Article file
Get citation
 
PlumX metrics:
 

Checklists are a low-cost safety practice with well-documented benefits in both low- and middle-income countries (LMIC) and high-income countries (HIC) [1, 2]. They are now fully integrated into the routines of most hospitals in HIC and the workflows of surgical teams, aiming to improve the quality of care. On the other hand, limited resources are seen as a key barrier to completing points of the checklist in an LMIC [3]. These concerns are multiplied in areas of armed conflicts, where the entire workflow is disrupted.

The Russian invasion of Ukraine has become the biggest war in Europe since World War Two and has led to hundreds of thousands being killed and injured [4]. This has caused huge damage to all medical infrastructure, and increased the number of patients with trauma and burns by hundreds of times. Medical care in these extremely stressful conditions, with continuous risk for both patients and personnel, limited resources, and overload, could significantly impair patient safety [5]. Therefore, use of the WHO Surgical Safety Checklist and the Anesthesia Equipment Checklist could improve patient outcomes during wartime.

We expected the lack of personnel, time, and other resources to negatively influence the checklist implementation process, as found previously by other researchers [68]. On the other hand, we had reasons to expect a net positive impact: the WHO Surgical Safety Checklist and checklists in general are designed to prevent simple mistakes, which are often brought on by a lack of vigilance caused by overexertion, staff shortage and disruptions in the usual workflow – all invariably present in a war-affected hospital [9].

The aim of our study was to assess the impact of the WHO Surgical Safety Checklist and Anesthesia Equipment Checklist implementation on patient outcomes and adherence to safety standards in low-resource settings, affected by an ongoing war.

METHODS

A prospective multicenter study was conducted in 6 large Ukrainian hospitals: Kyiv City Clinical Hospitals #1, University Clinic of the Bogomolets National Medical University, Kyiv City Maternity Hospital #5, National Cancer Institute, Shalimov National Institute of Surgery and Transplantology, Saint Martin Hospital in Mukachevo. Institutions were selected among those that aimed to improve their adherence to the Safe Surgery Saves Lives campaign recommendations but had not yet introduced the WHO Surgical Safety Checklist. On each study site, 1 or 2 operating rooms were designated for data collection. All surgical procedures observed by the data collectors in those operating rooms were included. The study was conducted in two phases: a control period, lasting from March 1, 2022, until August July 31, 2022, followed by a week-long educational period during which the WHO Surgical Safety Checklist and the Anesthesia Equipment Checklist (available in English as supplementary materials) were used, but no data were collected. The intervention period began on August 8, 2022, and lasted until December 31, 2022. Hospital administration and members of all surgical teams were informed about the nature of the study and the proper checklist use procedure. The WHO Surgical Safety Checklist and the Anesthesia Equipment Checklist were provided in the designated operating rooms. Both checklists were translated into Ukrainian. The ethical committee of Bogomolets National Medical University waived the requirement for written informed consent from the patient. The study design was approved by the ethics committee of the Bogomolets National Medical University (protocol #148, 07.09.2021) and retrospectively registered at clinicaltrials.gov on 22/03/2023 (NCT05798000).

Data collection

The anesthesiologists recorded data into a standardized data sheet after every included surgical procedure. The patients’ contact information was recorded for a 30-day follow-up. Collected data included: the date of surgery, patients’ name, age, gender, diagnosis, type of intervention, safety measures performed (airway check, sufficient intravenous access, timely antibiotic prophylaxis, identity confirmation, tool accounting, postoperative mana-gement discussion), hospital, postoperative adverse events, 30-day outcome, and patients’ contact data. Postoperative complications included: massive bleeding (over 1000 ml), acute kidney injury, deep vein thrombosis, myocardial infarction, coma, cerebral stroke, pulmonary artery thromboembolism, surgical infection, pneumonia, sepsis, reoperation, and “other major” (defined as those that qualified as such based on the Clavien Score). Obtained data were then entered into an Excel spreadsheet and transferred to the primary investigators for further monthly analysis.

Outcomes

The primary outcomes were any major complications, including death, during 30 days after surgery.

The secondary outcomes were adherence to six safety measures: airway evaluation and documentation before anesthesia, presence of two peripheral intravenous catheters or a central venous line before the incision if the expected blood loss was 500 mL or higher, timely antibiotic prophylaxis (at least 30 minutes before the incision), identity and surgical site oral confirmation before the incision, sponge, and instrument number confirmation, postoperative management discussion.

Data analysis

Statistical analysis was performed using online calculators [www.calculatorsoup.com]. Frequencies of safety measure performance and postoperative complications were calculated for each site to minimize the effect of differences in the numbers of patients at each site. After that logistic-regression analysis was used to estimate the intervention effect in each group. To evaluate the significance level Pearson’s χ2 test was performed, with a P-value < 0.05 being considered statistically significant.

RESULTS

Overall, 2237 surgical procedures were recorded – 1178 in the control group and 1059 in the intervention (checklist) group. The mean patients’ age was 51.4 and 49.2 years in the intervention and control groups respectively (Table 1). The overall male to female ratio among the patients was 1/0.98, with two sites presenting a male (site 4 – 90.4% and 87.3% in the intervention and the control group respectively) or female (site 3 – 98.1% and 99.3% in the intervention and the control group respectively) predominance. The groups showed no significant differences in demographic characteristics.

TABLE 1

Characteristics of the included patient population. Intervention (After) and control (Before) groups are shown, split based on the study site. The odds ratio, 95% confidence intervals, and P-values obtained via Pearson’s χ2 test for the control and intervention groups are presented

SiteNumber of patientsMean patient ageFemale patients (%)Procedures under general anesthesia (%)
BeforeAfterBeforeAfterBeforeAfterBeforeAfter
18615055.6 ± 15.161.0 ± 11.851.253.395.394.0
2466741.1 ± 17.053.5 ± 16.458.749.352.049.0
316115946.8 ± 14.346.4 ± 13.498.146.895.796.2
456039744.0 ± 14.644.9 ± 12.512.79.640.136.7
5804454.1 ± 14.652.2 ± 14.746.345.5100.0100.0
624524245.6 ± 17.847.9 ± 17.755.563.246.548.8
Total/Mean ± SD1178105947.9 ± 5.849.5 ± 6.853.7 ± 27.444.6 ± 18.371.6 ± 28.170.8 ± 28.8
P-value (t-test)0.170.260.48

In the control group, 16 (1.3%) patients died within 30 days after surgery, which was significantly higher than in the intervention group, where 5 (0.3%) patients died (OR = 0.35 [0.13–0.95], P = 0.03). Major complications occurred more frequently in the control group as well (OR = 0.32 [0.19–0.52], P < 0.001). Reoperation and surgical infection incidence decreased significantly after checklist implementation (OR = 0.3 [0.1–0.8], P = 0.009, and OR = 0.3 [0.1–0.8], P = 0.01, respectively). However, the incidence of blood loss exceeding 1000 ml and other complications remained unchanged. Theresults are presented in Table 2.

TABLE 2

Local incidence of major postoperative complications. Intervention (After) and control (Before) groups are shown, split based on study site. Odds ratio, 95% confidence intervals and P-values obtained via Pearson’s χ2 test for the entire control and intervention groups are presented

Site30-day mortality (%)Blood loss over 1000 mL (%)Reoperation (%)Surgical infection (%)Other (%)Any complication
(%)
BeforeAfterBeforeAfterBeforeAfterBeforeAfterBeforeAfterBeforeAfter
11.1000.63.402.30.62.309.21.3
22.102.100.602.1001.47.11.4
31.20.61.90.61.90.61.21.20.60.66.93.7
41.00.20.50.51.20.51.40.21.40.77.12.2
51.201.201.202.502.54.58.84.5
60.81.20.801.60.80.80.41.60.85.73.2
Total1.30.30.90.41.70.51.50.11.40.86.92.4
OR [95% CI]
P-value
0.4 [0.1–0.9] 0.030.5 [0.2–1.5] 0.10.3 [0.1–0.8] 0.010.3 [0.1–0.8] 0.010.6 [0.2–1.4] 0.20.3 [0.2–0.5] < 0.001

Checklist implementation also was associated with a higher incidence of performed safety measures (Table 3). The investigators reported that preoperative airway assessment and documentation had risen from 74.7% to 95.4% (OR = 4.5 [3.3–6.3], P < 0.0001), antibiotic infusion at least 30 minutes before the incision was performed more often (OR = 23.5 [16.2–34], P < 0.0001), patient identification and surgical site confirmation frequency increased from 82.7% to 98.1% (OR = 10.7 [6.7–17], P < 0.0001). Instrument and sponge count were completed more often (OR = 1.1 [1.0–1.2], P = 0.02), and postoperative management was properly discussed more regularly (OR = 6.7 [4.9–9.3], P = 0.0005). We analyzed the adequacy of the venous access during surgical procedures where blood loss exceeding 500 mL was expected. Adequate venous access was placed in 52.1% (n = 61) of patients in the control group and 90.4% (n = 95) in the intervention group (OR=8.72 [4.1–18.4], P < 0.0001). Detailed data are presented in Table 4.

TABLE 3

Number of included patients and local incidence of successfully performed safety measures in intervention (After) and control (Before) groups, split based on study site. Odds ratio, 95% confidence interval and P-value obtained via Pearson’s χ2 test for the entire control and intervention groups are presented

SiteNumber of patientsPreoperative airway assessment and documentation
(%)
Antibiotics at least 30 minutes prior to incision (%)Patient identity, surgical site oral confirmation before incision (%)Completed instrument and sponge count (%)Postoperative management discussed
(%)
BeforeAfterBeforeAfterBeforeAfterBeforeAfterBeforeAfterBeforeAfter
18615089.510010010097.610098.810098.8100
2466754310080.497100100010032100
316115994.399.990.699.386.910057.799.372.6100
456039790.196.74393.994.295.495.895.482.389.1
5804497.783.710097.798.797.75097.728.693.1
62452421004036.798.34099.510099.184.5100
Total1178105974.795.457.796.982.798.184.897.976.595.1
OR [95% CI],
P-value
4.5 [3.3–6.3]
< 0.0001
23.5 [16.2–34]
< 0.0001
10.68 [6.7–17]
< 0.0001
1.07 [1.0–1.2]
0.0197
6.7 [4.9–9.3]
0.0005
TABLE 4

Number of patients and local incidence of adequate venous access (2 peripheral or 1 central lines) during procedures, where over 500 mL of blood loss are expected. Intervention (After) and control (Before) groups are shown, split based on study site. Odds ratio, 95% confidence interval and P-value obtained via Pearson’s χ2 test for the entire control and intervention groups are presented

SiteNumber of patientsAdequate venous access (%)
BeforeAfterBeforeAfter
1181020.089.0
26650.083.3
3171860.094.0
4264158.588.4
561163.6100.0
6323141.990.6
Total10511752.190.4
OR [95% CI]
P-value
8.72 [4.14–18.39]
< 0.0001

DISCUSSION

Our findings confirm the previous data on the effect of routine Surgical Safety Checklist and Anesthesia Equipment Checklist use on major postoperative complications [9, 10]. However, the results of our study emphasize the importance of introduction of both checklists especially during an ongoing war and in limited resources areas. A significant improvement in the performance rate of periope-rative safety actions provides numerous potential explanations for the effect of checklists on patient outcomes. In this study, adequate intravenous access rate increase was associated with a decrease in 30-day mortality. In contrast, massive bleeding rates have remained unchanged, suggesting a possible contribution of this practice to patient survival. While the effect of the discussed minor safety measures may appear insignificant concerning other modern practices, one may examine their unique place as a fundamental activity involving the entire surgical team, necessitating comprehensive communication even during the simplest procedures [11, 12]. Being a method consistently proven to have a positive impact in almost any surgical setting, the Surgical Safety Checklist is a reliable way to introduce modern safety standards. Of particular interest to us was the evaluation of checklist reception in settings traditionally more opposed to the concept, such as military surgery. Despite reasonable concerns regarding checklist use in combat conditions, the practice is also gradually gaining a foothold in that area [13]. In our research, Site 4 has reported a marked improvement in adherence to standards of antibiotic prophylaxis.

As the WHO Surgical Safety Checklist is a brief reflection of the Safe Surgery Saves Lives recommendations, its implementation has been described as one of the tools for the promotion of the campaign’s messages in LMIC [14]. In low-resource settings, surgical safety checklists may be met with skepticism due to a marked initial difference in expected and existing routine approaches, further amplified by the fact that elimination of such obstacles would require cooperation between the administration of multiple hospital departments. While being a great challenge, this peculiarity may also indirectly explain the positive impact of the practice on problems related to the surgical safety checklists. Such standardized rearrangements often highlight concerns unique to the setting, helping document and rectify the otherwise ignored routine issues [15]. Despite the presence of more significant barriers to proper implementation, it is in the low-resource settings that use of the Surgical Safety Checklist results in the most impressive improvements [16].

It should also be noted that even though for the medical personnel the local development of safety culture may be a protracted uphill battle with seemingly minuscule or non-existent daily benefits, in the eyes of a surgical patient, measures such as checklist reading are perceived as a more professional approach and may have a reassuring effect before a major intervention [17]. This side effect is also a step towards a culture of open communication between the healthcare providers and the patient, contributing to the development of greater trust and an overall more humane approach to the hospitalization process.

It is currently known that the impact of the WHO Surgical Safety Checklist is greater in LMIC [18]. These data encouraged us to take a closer look into its effects in such settings during wartime, since the amount of information available on the matter is limited, notably so when compared to the volume of existing evidence supporting general Surgical Safety Checklist use. Our results indicate that surgical safety checklists still positively influence the quality of care during an armed conflict, suggesting that further research into this topic is ethically justified. Other authors, who described their experience in Syria, also highlight the importance of minimal safety standards while maintaining improvised surgical theaters in the warzone [19].

Study limitations

There was no possibility to perform an interrupted time series analysis [20]. The chosen time frame coincided with other safety policy introductions at some sites, which, combined with consecutive group examinations, likely resulted in some confounding. The entire period of the study also coincided with a Russian invasion, which had a considerable effect on patient profile, availability of medication, personnel, and other prerequisites of adequate medical care. Proper documentation of every significant restriction that influenced the quality of treatment (such as temporary lack of water or electricity) has proved impossible for the allocated staff. Criteria for safety check fulfillment could differ for specific sites and the study protocol, which may have led to underreporting of safety checks performed according to institutional regulations.

CONCLUSIONS

Routine use of the WHO Surgical Safety Checklist and the Anesthesia Equipment Checklist significantly improves the performance rate of basic safety actions and decreases the incidence of major postoperative adverse events. Implementation of checklists during wartime still results in an improvement in patient outcomes.

ACKNOWLEDGEMENTS

Assistance with the article

We thank all the surgical teams taking part in the included procedures.

Financial support and sponsorship

All necessary funds were provided by the Department of Surgery, Anesthesiology and Intensive Care of postgraduate education of Bogomolets National Medical University.

Conflicts of interest

none.

Presentation

none.

References

1 

Tiruneh A, Yetneberk T. A three-year retrospective study of the World Health Organisation safety checklist compliance in a comprehensive specialized hospital in Debre Tabor, North Central Ethiopia. Open Access Surg 2020; 13: 95-99. doi: 10.2147/OAS.S286969.

2 

Haugen AS, Søfteland E, Almeland SK, et al. Effect of the World Health Organization checklist on patient outcomes: a stepped wedge cluster randomized controlled trial. Ann Surg 2015; 261: 821-828. doi: 10.1097/SLA.0000000000000716.

3 

Cadman V. Use of the WHO surgical safety checklist in low and middle income countries: a review of the literature. J Perioper Pract 2018; 28: 334-338. doi: 10.1177/1750458918776551.

4 

The UN and the war in Ukraine: key information. United Nations Western Europe. 2022, March 9 (updated 2023, August 30). Available from: https://unric.org/en/the-un-and-the-war-in-ukraine-key-information/ (Accessed: 31.08.2023).

5 

Bielka K, Kuchyn I, Horoshko V. Intensive care units during the Ukraine war: challenges and opportunities. Intensive Care Med 2023; 49: 1011-1014. doi: 10.1007/s00134-023-07117-5.

6 

Sendlhofer G, Mosbacher N, Karina L, et al. Implementation of a surgical safety checklist: interventions to optimize the process and hints to increase compliance. PLoS One 2015; 10: e0116926. doi: 10.1371/journal.pone.0116926.

7 

Aveling EL, McCulloch P, Dixon-Woods M. A qualitative study comparing experiences of the surgical safety checklist in hospitals in high-income and low-income countries. BMJ Open 2013; 3: e003039. doi: 10.1136/bmjopen-2013-003039.

8 

Schwendimann R, Blatter C, Lüthy M, et al. Adherence to the WHO surgical safety checklist: an observational study in a Swiss academic center. Patient Saf Surg 2019; 13: 14. doi: 10.1186/s13037-019-0194-4.

9 

Lau C, Chamberlain R. The World Health Organization Surgical Safety Checklist improves post-operative outcomes: a meta-analysis and systematic review. Surg Sci 2016; 7: 206-217. doi: 10.4236/ss.2016.74029.

10 

Bergs J, Hellings J, Cleemput I, et al. Systematic review and meta-analysis of the effect of the World Health Organization surgical safety checklist on postoperative complications. Br J Surg 2014; 101: 150-158. doi: 10.1002/bjs.9381.

11 

Pugel AE, Simianu VV, Flum DR, et al. Use of the surgical safety checklist to improve communication and reduce complications. J Infect Public Health 2015; 8: 219-225. doi: 10.1016/j.jiph.2015.01.001.

12 

Wæhle HV, Haugen AS, Wiig S, et al. How does the WHO Surgical Safety Checklist fit with existing perioperative risk management strate-gies? An ethnographic study across surgical specialties. BMC Health Serv Res 2020; 20: 111. doi: 10.1186/s12913-020-4965-5.

13 

Hilsden R, McPherson J, Power D, et al. Development of a combat surgical safety checklist. J Trauma Acute Care Surg 2020; 89: e182-e186. doi: 10.1097/TA.0000000000002921.

14 

Cadman V. Use of the WHO surgical safety checklist in low and middle income countries: a review of the literature. J Perioper Pract 2018; 28: 334-338. doi: 10.1177/1750458918776551.

15 

Gong J, Ma Y, An Y, Yuan Q, Li Y, Hu J. The surgical safety checklist: a quantitative study on attitudes and barriers among gynecological surgery teams. BMC Health Serv Res 2021; 21: 1106. doi: 10.1186/s12913-021-07130-8.

16 

Kwok AC, Funk LM, Baltaga R, et al. Implementation of the World Health Organization surgical safety checklist, including introduction of pulse oximetry, in a resource-limited setting. Ann Surg 2013; 257: 633-639. doi: 10.1097/SLA.0b013e3182777fa4.

17 

Kawano T, Taniwaki M, Ogata K, et al. Improvement of teamwork and safety climate following implementation of the WHO surgical safety checklist at a university hospital in Japan. J Anesth 2014; 28: 467-470. doi: 10.1007/s00540-013-1737-y.

18 

Lau CS, Chamberlain RS. The World Health Organization surgical safety checklist improves post-operative outcomes: a meta-analysis and systematic review. Surg Sci 2016; 7: 206. doi: 10.4236/ss.2016.74029.

19 

Trelles M, Dominguez L, Tayler-Smith K, et al. Providing surgery in a war-torn context: the Médecins Sans Frontières experience in Syria. Confl Health 2015; 9: 36. doi: 10.1186/s13031-015-0064-3.

20 

Drzymalski DM, Schumann R, Massaro FJ, Trzcinka A, Azocar RJ. Effect of a cognitive aid on reducing sugammadex use and associated costs: a time series analysis. Anesthesiology 2019; 131: 1036-1045. doi: 10.1097/ALN.0000000000002946.

This is an Open Access journal, all articles are distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0). License (http://creativecommons.org/licenses/by-nc-sa/4.0/), allowing third parties to copy and redistribute the material in any medium or format and to remix, transform, and build upon the material, provided the original work is properly cited and states its license.
 
Quick links
© 2024 Termedia Sp. z o.o.
Developed by Bentus.