Article Text
PDF
Abstract
Introduction The Lancet Commission on Global Surgery proposed the perioperative mortality rate (POMR) as one of the six key indicators of the strength of a country’s surgical system. Despite its widespread use in high-income settings, few studies have described procedure-specific POMR across low-income and middle-income countries (LMICs). We aimed to estimate POMR across a wide range of surgical procedures in LMICs. We also describe how POMR is defined and reported in the LMIC literature to provide recommendations for future monitoring in resource-constrained settings.
Methods We did a systematic review of studies from LMICs published from 2009 to 2014 reporting POMR for any surgical procedure. We extracted select variables in duplicate from each included study and pooled estimates of POMR by type of procedure using random-effects meta-analysis of proportions and the Freeman-Tukey double arcsine transformation to stabilise variances.
Results We included 985 studies conducted across 83 LMICs, covering 191 types of surgical procedures performed on 1 020 869 patients. Pooled POMR ranged from less than 0.1% for appendectomy, cholecystectomy and caesarean delivery to 20%–27% for typhoid intestinal perforation, intracranial haemorrhage and operative head injury. We found no consistent associations between procedure-specific POMR and Human Development Index (HDI) or income-group apart from emergency peripartum hysterectomy POMR, which appeared higher in low-income countries. Inpatient mortality was the most commonly used definition, though only 46.2% of studies explicitly defined the time frame during which deaths accrued.
Conclusions Efforts to improve access to surgical care in LMICs should be accompanied by investment in improving the quality and safety of care. To improve the usefulness of POMR as a safety benchmark, standard reporting items should be included with any POMR estimate. Choosing a basket of procedures for which POMR is tracked may offer institutions and countries the standardisation required to meaningfully compare surgical outcomes across contexts and improve population health outcomes.
- perioperative mortality
- surgical outcomes
- global surgery
- systematic review
This is an open access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: http://creativecommons.org/licenses/by/4.0/
Statistics from Altmetric.com
Key questions
What is already known?
Previous systematic reviews of anaesthetic mortality and mortality in specific surgical populations have shown decreasing mortality trends over time and differences by world region.
Geographical differences have similarly been reported in cohort studies such as the GlobalSurg I study, the European Surgical Outcomes Study and the African Surgical Outcomes Study.
What are the new findings?
This is the first systematic review to attempt broad baseline estimation of perioperative mortality rate (POMR) across procedures and describe how low-income and middle-income countries (LMICs) authors define POMR.
We show here that POMR varies widely by procedure or diagnosis; further, we show significant variation in how POMR is reported, limiting comparisons across contexts.
What do the new findings imply?
POMR is widely used and reported in all contexts; to promote its utility as a standardised surgical safety indicator, greater specificity in the types of procedures assessed and the way in which data are collected, risk adjusted and reported is required.
Introduction
Over 260 million surgical procedures are performed each year globally, but a further 143 million procedures are required to meet essential surgical needs in low-income and middle-income countries (LMICs).1 In addition to increasing surgical access in LMICs, efforts should also focus on improving the quality and safety of surgical care and reducing the risk of death in the perioperative period.
The perioperative mortality rate (POMR), defined as the number of deaths during or after surgery divided by the number of procedures performed, has been championed in the literature as a useful indicator to measure surgical safety at an institutional and national level.2–4
The Lancet Commission on Global Surgery recommended the national POMR as one of six key indicators to measure the strength of a country’s surgical system.2 However, despite its demonstrated utility in high-income settings, few studies have described POMR across LMICs and little research exists on how POMR is used and defined in resource-constrained settings. Bainbridge et al showed decreasing perioperative and anaesthetic-related mortality rates in LMICs since 1970, although procedure-specific rates were not studied or reported.5 Uribe-Leitz and others quantified mortality after three common procedures in LMICs: caesarean delivery, appendectomies and groin hernia repair.6 A prospective cohort study across 58 countries found that emergency abdominal surgery POMR was three times higher in low-Human Development Index (HDI) compared with high-HDI countries. Most recently, the African Surgical Outcomes Study found that despite being younger, with a lower surgical risk profile and undergoing less complex surgeries, patients in Africa are twice as likely to die after surgery when compared with outcomes at the global level.7 Nonetheless, to our knowledge, no study has reported procedure-specific POMR across a wide range of surgical conditions across LMICs.
To address this gap, we undertook a systematic review of the perioperative mortality literature for all surgical procedures in LMICs. We reviewed all studies on POMR published in LMICs over a 6-year period between 2009 and 2014. This covers the period roughly between the publication of the WHO Guidelines for Safe Surgery 2009 and The Lancet Commission on Global Surgery, providing a modern account of the POMR literature.2 8
This study had several aims: (1) to describe POMR across a wide range of surgical procedures in LMICs, (2) to determine whether these rates vary across contexts and (3) to determine how POMR is defined, reported and used in the LMIC literature, including how risk adjustment is undertaken. Finally, we provide recommendations for improving POMR reporting in resource-constrained settings.
Methods
Search strategy and selection criteria
The original study protocol was published alongside a preliminary abstract in 2015,9 the final version of which is available in the online Supplementary material protocol. We conducted a systematic review and meta-analysis following Preferred Reporting Items for Systematic Reviews and Meta-Analyses and Meta-analysis Of Observational Studies in Epidemiology guidelines.10 11 We included published studies primarily reporting facility-based outcomes or mortality for patients who underwent surgery in LMICs (defined according to 2013 World Bank Income Groups).12
Supplementary file 1
All study designs (descriptive, case–control, cohort or trial) were eligible for inclusion. We included full-text articles published in English between 1 January 2009 and 31 December 2014. Final searches were performed on 10 January 2015. The perioperative period was defined as the period from entry into the operating theatre to either discharge or 30 days following a surgical procedure, whichever was later. However, studies explicitly discussing surgery-related mortality, but whose shortest reporting interval was 31–90 days after surgery were included. Surgery was defined as any procedure performed in an operating theatre. A list of excluded procedure types is available in the attached review protocol. Only studies providing raw mortality data were eligible for inclusion; those in which the numerator (deaths) or denominator (patients or procedures) were estimated or modelled were excluded. We did not impose a large sample size requirement that would exclude literature published in smaller centres with lower surgical volumes.
We searched PubMed, EMBASE, LILACS, Web of Science, African Index Medicus and the WHO Global Health Library. Search terms for all databases were developed in consultation with a medical librarian. Variants of ‘surgery’, ‘operation’, ‘anaesthesia’, ‘intraoperative’, ‘perioperative’, ‘postoperative’ and ‘mortality’ were included in all searches. In addition, we also hand-searched the references of recently published reviews of specific procedures.6 13–16 Stand-alone abstracts and unpublished studies were excluded from the review. Full inclusion and exclusion criteria, as well as database-specific searches, are provided in the attached review protocol.
Data extraction, outcome definition and procedure classification
Titles and abstracts were reviewed independently in duplicate to evaluate for inclusion. Eligibility assessment based on full-text reviews and data abstraction were done by two clinicians. Selected variables including the surgical procedure or diagnosis under consideration, the perioperative mortality rate, case urgency and the definition of POMR were extracted in duplicate. Disagreements in data extraction were resolved by a single physician coder (JNK). A data dictionary describing all variables, codes, assumptions and simplifications is provided in the online Supplementary data dictionary.
Supplementary file 2
The primary outcome of interest was the POMR, and secondary outcomes were the definition of perioperative mortality and the reporting and adjustment for selected preoperative risk factors. When the time frame relative to surgery during which deaths accrued was not clearly defined, it was assumed to be in-hospital mortality. If mortality was reported at multiple postoperative intervals, the longest (up to 30 days) was used.
To describe each patient population accurately and consistently, coding was performed iteratively. First, a clinician identified the broadest procedure or diagnosis group in each study and assigned it a code. A list of such codes was developed and revised by a second clinician. Within each code, we identified studies performed in high-risk populations (eg, restricted to patients with comorbidities such as renal dysfunction or HIV). When possible, we also stratified patients by case urgency.
Economic variables and risk of bias
We obtained country lending classification data from the World Bank and Human Development Index data from the UN Development Programme.17 18 Where data were unavailable for a given country for a given year, the closest available year to the midpoint year of data collection was used. Two potential sources of bias were assessed: selection bias resulting from failure to report on all consecutive cases and detection bias resulting from failure to provide complete follow-up data. The data collected were analysed as case-series outcomes (mortality rates), regardless of the underlying study design.
Statistical analysis
In order to summarise POMR across procedures, we pooled estimates using random-effects meta-analysis of proportions and the Freeman-Tukey double arcsine transformation to stabilise variances.19 This procedure allows for the inclusion of studies with a zero event rate. Meta-analyses were weighted by the inverse variance of the transformed estimates, giving more weight to the more precise rates in the pooled estimate. We used the metaprop command in Stata/IC V.13.19 In order to determine whether there were differences in procedure-specific POMR across study-country income groups and HDI categories, we used the non-parametric Kruskal-Wallis equality-of-populations test.20
The role of the funder
This study was funded in part by Boston Children’s Hospital, which had no role in the design, conduct, analysis or writing of this study and did not influence the decision to publish.
Results
After the removal of duplicate citations, we screened the titles and abstracts of 7701 unique citations. Of these, we requested 1595 full-text articles for further review. A total of 985 articles met our inclusion criteria (figure 1). These studies were conducted across 83 LMICs. The country where the most POMR literature was published was Brazil (145 articles), followed by Nigeria (121), China (111), Pakistan (107) India (87), Turkey (65) and Iran (62) (figure 2; online Supplementary appendix 1 table S1). These studies covered a total of 191 different procedure or diagnostic groups (‘procedures’) in 13 surgical specialties and ranged from small case series of five patients to expansive registries with 152 110 surgical patients (median, 86 patients, IQR 36–234,S upplementary appendix table S2). In total, the surgical outcomes of 1 020 869 patients were included (figure 2). Most studies were conducted in urban environments (n=884, 89.7%) and in academic centres (n=821, 83.4%). The majority of studies were descriptive (n=711, 72.2%) and retrospective (n=685, 69.5%, table 1). Primary data are available in the online Supplementary appendix 2.
Supplementary file 3
Supplementary file 4
Hospital and study descriptors
Flow diagram. Preferred Reporting Items for Systematic Reviews and Meta-Analyses flow diagram. HIC, high-income country; ICU, intensive care unit.
Distribution of the perioperative mortality rate (POMR) literature in low-income and middle-income countries. The number of papers presenting POMR data for each country.
Across the 191 procedures identified, the most commonly reported were caesarean delivery (55 studies) followed by coronary artery bypass grafts (49 studies), emergency peripartum hysterectomies (39 studies) and cardiac valve procedures (35 studies) (table 2). A total of 77 procedures identified were reported in only one study (online Supplementary table s3). Among procedures described in at least four studies (n=67), most demonstrated significant between-study heterogeneity in reported POMR (I2>50%, n=55).
Inverse-variance aggregated perioperative mortality rate (POMR) across the 34 most commonly reported procedures or diagnoses described in the low-income and middle-income countries surgical outcomes literature, 2009–2014
While acknowledging the significant between-study heterogeneity within procedures resulting from differences in methodology, outcome definition and patient-level risk, we elected to create pooled POMR estimates as an approximate baseline to inform future research. Procedure-specific POMR pooled by inverse-variance-weighted random-effects meta-analyses for the 34 most commonly reported procedures (ie, reported in at least eight studies) are shown in table 2. Given the high between-study heterogeneity, we also include the median study-level POMR for each procedure and the range across which studies varied.
POMR varied considerably between procedures. For example, pooled POMR ranged from less than 0.1% for cholecystectomy to 20%–27% for typhoid intestinal perforation, intracranial haemorrhage and operative head injury (table 2). While caesarean delivery POMR was a mere 0.05% (95% CI 0 to 0.13), small outlier studies reported rates of up to 16%. After emergency peripartum hysterectomy, however, the risk of dying was 7.81% (95% CI 5.81 to 10.04). Similarly, the risk of dying after appendectomy was 0.01% (95% CI 0 to 0.19) whereas, after surgery for a perforated hollow viscus (excluding typhoid), POMR was 11.85% (95% CI 8.35 to 15.83). Paediatric surgical procedures demonstrated alarmingly high mortality rates: surgery for oesophageal atresia/tracheo-oesophageal fistula carried a 24.41% mortality risk (95% CI 6.76 to 48.04), Hirschsprung’s disease 10.65% (95% CI 0.42% to 29.11%), intestinal atresias 30.95% (95% CI 18.71 to 44.53) and gastroschisis 29.68 (95% CI 10.75 to 53.14).
Mortality rates across all 191 identified procedures are shown in the online Supplementary table s3. As a sensitivity analysis, we excluded all studies performed in high-risk populations (such as studies restricted to patients with specific comorbidities); results are shown in the online Supplementary table s4. There was a little change in pooled POMR estimates after excluding these studies.
We looked at whether procedure-specific POMR varied by study country income group or categories of HDI. For this analysis, procedure-specific POMR estimates for high-income countries were identified through a purposive search of the literature. We found a statistically significant difference in POMR for emergency peripartum hysterectomy across income groups (p<0.05). This relationship was not statistically significant for any other procedure types including caesarean section, appendectomy and colon resection. We found no consistent association between procedure-specific POMR and HDI.
Over half of the studies (n=530, 53.8%, table 3) did not provide a clear POMR definition (ie, of the timeframe during which deaths accrued). In the other studies, a variety of timeframes for calculating POMR were employed. About 20% of studies reported 30-day mortality and a smaller number referred to variants thereof (such as ‘mortality within 30 days of surgery or during the index hospital stay’). Some obstetric surgery studies reported mortality at 42 days after surgery (n=6). Most studies used the number of patients undergoing surgery, rather than the number of procedures performed, as the denominator of POMR (n=969, 98.4%). We also found that studies performed in upper-middle income countries were more likely to provide a clear definition of the POMR described.
Definitions of perioperative mortality rate
Risk-adjustment methodology varied widely (table 4). Some studies reported gross mortality rates without risk adjustment; by contrast, authors from Brazil and China used detailed registry data to develop sophisticated population-specific scores to determine risk after cardiac surgery. Most studies reported median patient age (95.0%) and case urgency (74.1%), but only 7.5% reported the ASA status (American Society of Anesthesiologists Physical Status Classification). About a third of studies (n=331) reported a clinical risk score, but only 14.3% performed risk adjustment or stratification based on such scores. A summary of the scores used by surgical specialty is included in the online Supplementary appendix 1 table S5.
Risk factor reporting and adjustment
Discussion
In LMICs, the POMR literature is as diverse as the institutions and countries that produce it. It spans all surgical specialties and a wide variety of procedures and diagnoses both common and rare. To our knowledge, this is the first systematic review to report procedure-specific POMR across a wide range of surgical conditions in LMICs. This review included data from 985 studies conducted in 83 LMICs and covering 191 types of surgical procedures performed on a population of 1 020 869 patients.
POMR is used for many purposes. In the studies included here, authors used POMR data to argue for increased critical care resources,21 quantify the particular surgical risk for the HIV-positive population,22 assess the impact of delay in reaching care on outcomes,23 raise alarm over high mortality rates in the paediatric population24 25 and establish the relative safety of traditionally high-risk procedures in select LMIC environments, among other aims.26 The utility of this metric at the institution level is undeniable; with clear outcome definitions, a well-defined population, and robust analysis, perioperative mortality rates can be used to monitor and improve patient safety. To demonstrate patterns in mortality rates beyond the level of the institution requires some standardisation of definitions, methods of data capture and patient-level risk assessment. The studies included here were too heterogeneous on these fronts to demonstrate stable relationships between POMR and macroeconomic variables such as HDI or income groups.
By contrast, the GlobalSurg group demonstrated a clear inverse relationship between POMR and HDI for emergency abdominal surgery, and a previous systematic review by Bainbridge et al, showed similar findings for all-comer anaesthesia-related mortality.5 27 Assuming this relationship is true, several potential reasons may explain why this study did not demonstrate it. First, unlike Bainbridge et al, we report procedure-specific POMR. The small number of studies within each procedure group decreased the power to detect such relationships and prevented us from conducting meta-regression analyses. Second, heterogeneity in POMR definitions across studies introduces significant noise. The impact of differences in POMR definition can be dramatic; in the GlobalSurg analysis, 24 hours mortality was 1.6%, underestimating all-cause 30-day mortality (5.4%) by 70%.27 Similarly, in a New Zealand data set, in-hospital mortality underestimated 30-day mortality by about one-third.28 Third, most studies included here were retrospective, increasing the risk of information bias or incomplete reporting of mortality data, which may vary by income level. This information bias can be significant. A study in Uganda compared mortality from retrospective chart reviews, surgical logbooks and prospective data collection. Of the 16 deaths identified prospectively, retrospective chart reviews captured only six. Surgical logbooks performed better, capturing 99% of procedures and 15 out of the 16 deaths.29 Fourth, individual patient risk was not assessed in this analysis; it is possible that higher-income countries reported on the outcomes of older or more comorbid surgical patients. Fifth, many studies had small sample sizes with few mortalities, resulting in large variances in estimated POMR. Finally, high-income countries were not included in this analysis, narrowing the economic spectrum across which POMR was assessed. We also note that the strength of the relationship between POMR and economic variables is likely to vary by procedure. For procedures with low baseline risk, it may be more difficult to detect a meaningful difference in mortality by level of development.27
A clear recommendation to arise from this review is that whenever perioperative mortality data are reported, metadata describing the definition used and the quality of reporting should accompany them (box 1). Because POMR is a proportion (though termed a ‘rate’ in the literature), both the numerator and denominator should be clearly described. The numerator should be described specifically in terms of the time during which deaths accrue, with a preference for all-cause 30 day deaths where possible. Inpatient mortality misses many deaths.27 28 However, it is easier to collect than 30-day mortality, which requires a concerted effort to contact patients at 30 days following surgery. This challenge is the primary reason why The Lancet Commission on Global Surgery recommended inpatient perioperative mortality as a key surgical systems indicator.2 However, the ubiquity of cellphone technology and its utility in follow-up for surgical site infections in austere environments make it a promising tool for use in collecting POMR data.30 Thirty-day POMR seems to be a more robust indicator and it is less sensitive to the varying postsurgery discharge practices around the world. Nonetheless, in some contexts, reporting inpatient mortality will be necessary. In this case, the average length of stay should be reported and authors should specify whether outpatient procedures were included in the denominator. Including outpatient procedures can deflate POMR, as by definition, the outcome (‘inpatient mortality’) is unlikely to occur in an outpatient population (being limited to intraoperative deaths or deaths in the recovery room). In this review, we found that the denominator was most often defined as the number of surgical patients. Alternatively, the denominator can be defined as the number of procedures or number of admissions including a surgical procedure; the impacts on POMR of such subtle changes have been described elsewhere.28 Furthermore, the population under study should be clearly described, all consecutive patients included and the completeness of follow-up and reasons for any missing data described.
Critical elements for reporting perioperative mortality rates
Define the surgical population under study.
Report all relevant inclusion/exclusion criteria and report if all consecutive patients meeting criteria were included.
If multiple procedures are included, report case mix.
Report study design.
Report study perspective (retrospective, prospective or ambispective).
If retrospective, describe how all procedures/patients were identified and whether surgical logbooks, registries, or electronic medical records were used.
Describe methodology for any between-group comparisons.
State the timeframe during which deaths accrued: in-hospital (during index hospital stay alone), 30-day mortality or other.
If in-hospital mortality is used,
Report the mean length of hospital stay, standard deviation and range.
Report the proportion of included procedures being performed with same-day discharge (‘day surgery’).
State the denominator used: surgical patients, surgical procedures or admissions with a surgical procedure.
Report any loss to follow-up.
If the outcomes of all surgical procedures cannot be identified.
Report the proportion of missing data.
Report why the data are missing.
Report common surgical risk factors including age, comorbidities, functional status, urgency status and ASA.
If a validated risk-scoring system is available for the procedure under study, consider using and reporting it.
If risk-adjusted mortality is reported, also report crude rates and clearly describe adjustment methodology.
As the scope of analysis of POMR expands from the institutional to the national level, so too does the importance of precision in data collection and reporting. The gross national POMR has been advocated by several groups as a global indicator of surgical safety.2–4 The goal of this indicator is to provide a waypost for the improvement of safety in surgical systems. More specifically, it should indicate modifiable operative and postoperative factors that determine mortality, while preoperative factors and data factors are controlled (table 5). Others have argued that while POMR varies with case mix, the operative experience of a country is unlikely to change from year to year; policymakers can therefore monitor POMR over time to assess improvements in surgical safety. This argument relies on two premises: first, that the initial country-level POMR reviewed by a policymaker can be reasonably interpreted to motivate investment in surgical safety, and second, that case mix, definitions and quality of reporting remain stable over time to permit interpretation of changes in reported rates. An effort to collect POMR from ministries of health has been undertaken.31 While many countries did provide POMR, these data were difficult to interpret, as they varied in definition and case mix. It was not possible to assess whether a country was performing well, or poorly, compared with others based on the gross national POMR data provided. Even when definitions and methods of data capture are held constant, careful reporting of case mix remains important: an analysis by region in Brazil showed higher all-procedure POMR in wealthier regions, but when caesarean section was analysed in isolation, wealthier regions had lower POMR.32 We have shown here that POMR varies by orders of magnitude according to which procedures are being studied. Even within such broad categories as ‘emergency intraperitoneal surgery’ as studied by GlobalSurg, we have demonstrated that mortality rates vary widely according to which specific procedure or diagnosis is under study.
Known or potential factors influencing perioperative mortality rates
Based on these findings, we advocate for greater specificity in the standard definition of POMR to be used by hospitals and countries. A selection of indicator procedures might be chosen to cover the lifespan, such as surgery for gastroschisis, caesarean section, colon resection and repair of hip fracture. Each of these procedures is performed at all levels of HDI, is studied widely and has excellent science on how risk adjustment should be performed. The tradeoff encountered by focusing on POMR indicator procedures is wider CIs due to a lower number of events (compared with all-patient nationwide POMR). Again, we argue that wider CIs around indicators that are meaningful to policymakers at face value are preferable to narrower CIs around a gross indicator that is agnostic to case mix. Yet, to abandon the impetus to track all postoperative deaths might be short sighted. Robust surgical registries tracking all procedures have been established in low-income countries.33 An expansion of such efforts to all hospitals would allow for tracking of the outcomes of select global index procedures and locally important procedures, in addition to improving nationally representative surgical volume estimates. Other recommendations for the use of POMR to advance surgical safety are included in box 2.
Recommendations for improving surgical safety
Clinicians, care providers and hospitals
Promote the implementation of best practices, such as the WHO guidelines for safe surgery and other procedure-specific or context-specific evidence to decrease complications. Develop a local culture of safety with regular quality-of-care discussions.
Develop quality improvement networks across settings to work collectively to identify and implement strategies to improve safety and decrease perioperative mortality rate (POMR).
Invest in the technology and human resources required for the prospective collection and analysis of POMR data.
Researchers
Globally
Choose indicator procedures that are commonly performed across all settings, have a significant mortality risk, are representative of the burden of surgical disease across the population and have good existing science for risk adjustment.
Determine sample sizes for these procedures required to stably estimate gross and risk-adjusted procedure-specific POMR at the facility and country level.
Study these procedures across settings to estimate how differences in data collection methods and the definition of POMR influence estimates.
Conduct global studies to establish nationally representative estimates of POMR for each indicator procedure.
Advocate for investment in the technology and human resources required for reliable ongoing collection of POMR data.
Locally
Study indicator procedures in depth to develop local solutions to patient safety problems that can be scaled regionally, nationally or globally.
Ministries of Health:
Provide facilities with the administrative and financial support required to collect POMR data prospectively.
When higher-than-expected POMR is brought to the attention of the ministry, mobilise additional clinical and financial resources to augment the safety of operative and postoperative care.
While POMR is useful for assessing the safety of operative care, contextualising it within the broader suite of six surgical indicators proposed by The Lancet Commission on Global Surgery is critical.2 Specifically, juxtaposing surgical volume with POMR allows for an assessment of the quantity of care delivered and the safety thereof. Consider an individual with a typhoid intestinal perforation: our analysis would estimate a POMR of 20% in LMICs. This is still vastly preferable to the reported 70% mortality with non-operative management.34 Universal access to the operating room is a dominant determinant of public health, with surgical safety an important secondary determinant of outcome. This was made strikingly clear in the recently published African Surgical Outcomes Study.7 A sweeping cohort-based study providing complication and mortality data representative at the level of the continent, it showed that surgical patients in Africa have twice the in-hospital POMR of an international cohort despite a favourable risk profile. POMR was particularly elevated after an index complication. However, in the study, hospitals were only able to deliver 212 surgical procedures per 100 000 population per annum, well short of the 5000 per 100 000 target set by The Lancet Commission on Global Surgery. While working to improve safety, focus must be maintained on scaling up delivery and bolstering the surgical workforce in low-volume settings.
An important caveat to this discussion is that POMR may be less useful for surgical conditions in which patients do not consistently require a trip to the operating theatre. For example, numerous studies reporting deaths after trauma were excluded from this analysis as a specific operative numerator and denominator were not reported. Finally, measurement alone is not enough.35 While measuring POMR is indeed the first step towards reducing mortality rates, clinicians and policymakers must insist on deploying the resources and best practices required to prevent complications and rescue patients who experience them.
This study had limitations. First, given the high between-study heterogeneity within procedure types, the pooled POMR estimates should be interpreted with caution. Second, this review may be subject to publication bias. Studies of particularly high mortality may not have been submitted for publication in the interest of protecting institutional or surgeon reputation. Conversely, studies of low mortality may not have been deemed worthy of publication. Funnel plots are problematic in meta-analyses of proportions where the proportions are small.36 We were unsurprised to find that in this group of highly heterogeneous studies, constructing funnel plots, whether conventional funnel plots or those using study size versus log odds, failed to shed light on the file-drawer problem. Further, these results are most representative of mortality at academic medical centres and may not reflect mortality at smaller, more rural sites. Finally, this analysis included only studies published in English over a 6-year period.
Some conditions continue to cause high surgical mortality in LMICs, particularly in the paediatric population. Mortality data are commonly reported in the LMIC surgical literature but the quality of reporting varies widely: more than half of the studies did not provide a clear definition of the outcome. Given that mortality rates differ dramatically by the procedure or diagnosis under study, analysis of mortality rates for a select basket of surgical procedures might add validity to POMR and allow for constructive comparison of outcomes between sites and countries.
Acknowledgments
We thank The Lancet Global Health Commission on High Quality Health Systems in the SDG era for support in the conduct and publication of this work and Boston Children’s Hospital for providing research funding.
References
Footnotes
Handling editor Seye Abimbola
Contributors JNK, SLMG, MK and JGM conceived the study. JNK wrote the study protocol, reconciled duplicate data and ensured overall consistency in data extraction and drafted the manuscript. JNK, SLMG and MK developed the search strategy, completed searches and screened titles and abstracts. JNK, SA, AA, CF, AN, FYXL, CLP, TF, TM, SR, SS, IHM, AB and LP extracted data. JNK, CA, DL, RRY and MGS analysed the data. JNK, CA and RRY developed the figures and tables. All authors critically reviewed the manuscript and approve of its content.
Funding This study was funded in part by Boston Children’s Hospital.
Competing interests MS holds grant funding from the GE Foundation and the Damon Runyon Cancer Research Foundation, which had no bearing on this work.
Patient consent Not required.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement We include primary data alongside the manuscript as supplementary material. Additional data are available upon request; please contact the corresponding author.