Introduction In 2016, 2.6 million children died during their first month of life. We assessed the effectiveness of an integrated neonatal care kit (iNCK) on neonatal survival and other health outcomes in rural Pakistan.
Methods We conducted a community-based, cluster randomised, pragmatic, open-label, controlled intervention trial in Rahim Yar Khan, Punjab, Pakistan. Clusters, 150 villages and their lady health workers (LHWs), were randomly assigned to deliver the iNCK (intervention) or standard of care (control). In intervention clusters, LHWs delivered the iNCK and education on its use to pregnant women. The iNCK contained a clean birth kit, chlorhexidine, sunflower oil, a continuous temperature monitor (ThermoSpot), a heat reflective blanket and reusable heat pack. LHWs were also given a hand-held scale. The iNCK was implemented primarily by caregivers. The primary outcome was all-cause neonatal mortality. Outcomes are reported at the individual level, adjusted for cluster allocation. Enrolment took place between April 2014 and July 2015 and participant follow-up concluded in August 2015.
Results 5451 pregnant women (2663 and 2788 in intervention and control arms, respectively) and their 5286 liveborn newborns (2585 and 2701 in intervention and control arms, respectively) were enrolled. 147 newborn deaths were reported, 65 in the intervention arm (25.4 per 1000 live births) compared with 82 in the control arm (30.6 per 1000 live births). Neonatal mortality was not significantly different between treatment groups (risk ratio 0.83, 95% CI 0.58 – 1.18; p = 0.30).
Conclusion Providing co-packaged interventions directly to women did not significantly reduce neonatal mortality. Further research is needed to improve compliance with intended iNCK use.
- neonatal mortality
- lady health worker
- integrated intervention
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
What is already known?
There is a paucity of evidence on the effectiveness of integrated neonatal intervention packages that can be delivered by community health workers and implemented by women and families on improving neonatal health outcomes.
What are the new findings?
In this community-based, cluster randomised, pragmatic (effectiveness), open-label, controlled intervention trial, neonatal mortality rates were not significantly different between the intervention (25.4 per 1000 live births) and control group (30.6 per 1000 live births).
Caregiver implementation of the integrated neonatal care kit (iNCK) was effective at reducing the risk of omphalitis, which may predict or precede serious infection, and enabled caregivers to identify and take action to address fever, cold stress and hypothermia, symptoms that may indicate severe illness.
What do the new findings imply?
While the integration of evidence-based interventions for implementation by women and families is a promising idea that has several advantages, early uptake of some iNCK components was a challenge and the bundle of interventions did not translate into a statistically significant reduction in neonatal mortality.
Further research into the practical implications of the iNCK, including strategies to improve caregivers’ compliance with the intended use of the iNCK components, is necessary.
In 2016, an estimated 2.6 million neonatal deaths occurred worldwide, accounting for 46% of all the deaths among children under 5 years of age.1 The third Sustainable Development Goal (SDG3) sets a target that all countries should aim to reduce neonatal mortality rates (NMRs) to no more than 12 deaths per 1000 live births by 2030.2 To meet this target, the accelerated scale-up of community-based interventions that are effective at reducing neonatal deaths is imperative.3–6
With 46 neonatal deaths per 1000 live births, Pakistan has the highest NMR in South Asia and the world.1 In 2015, the leading causes of neonatal death in Pakistan were prematurity (39%), birth asphyxia and trauma (21%) and sepsis (17%).7 If the average annual rate of reduction in NMR remains constant, Pakistan will not achieve the SDG3 target before 2081. Evidence-based interventions to improve neonatal survival exist4 8; however, their coverage is low, especially in rural communities, where many births and neonatal deaths occur at home.6 While some newborn interventions have been bundled into packages,9 very few packages have been delivered by community health workers (CHWs) and even fewer have been rigorously evaluated. One notable exception was the training and evaluation of traditional birth attendants in rural Zambia in the management of common perinatal conditions that led to significant reductions in newborn morality, especially those in the first 24 hours of life.10 Given that multiple barriers prevent CHWs from accessing a newborn soon after birth,11 efforts are needed to engage pregnant women and families as implementers of newborn interventions.5 The delivery of newborn intervention packages by CHWs for implementation by women and families has potential to sustainably reduce neonatal mortality.4
We conducted a community-based, cluster randomised, controlled trial to determine the effectiveness of delivering an integrated neonatal care kit (iNCK), and educating pregnant women and their families on its use, through an existing cadre of lady health workers (LHWs) on neonatal mortality. In Pakistan, LHWs are an important link between the health system and the community; each LHW provides primary healthcare to about 200 households in rural areas and urban slums.12 LHWs delivered the iNCK and education on its usage to participants. The iNCK contains a clean birth kit (CBK), 4% chlorhexidine solution, sunflower oil emollient, a temperature indicator sticker (ThermoSpot), a heat reflective polyester blanket, and a reusable heat pack. LHWs who delivered the iNCK were also provided a hand-held electronic scale. Each iNCK component was selected on the basis of evidence that it reduces the incidence of neonatal morbidities,13–18 or has potential to provide early identification of danger signs,19–21 or to enable caregivers to manage danger signs until healthcare is reached.22
Study design and oversight
We conducted a community-based, stratified cluster randomised, pragmatic (effectiveness), open-label, controlled, parallel two-arm intervention trial in Rahim Yar Khan (RYK) District, Pakistan from April 2014 until August 2015. Clusters were defined as villages and their associated LHWs. The protocol included two phases of work, separated by 11 months, that differed in the timing and frequency of data collection visits. Results of the first phase, during which frequent visits to households to collect compliance and outcome data were conducted, are reported here. The study protocol for the trial’s first phase was previously published22 and was approved by the Research Ethics Board at The Hospital for Sick Children (REB No. 100042963) and the National Bioethics Committee, Pakistan (No.4-87/13/NBC-133/RDC/2629). An independent data and safety monitoring board reviewed biweekly progress reports and a blinded interim analysis covering a period between April 2014 and February 2015. The trial is registered with Clinicaltrials.gov (NCT02130856). Detailed study methods and protocol amendments (online supplementary table S1) are included in the online supplementary appendix.
Participants and procedures
All women in the third trimester of pregnancy within participating randomised clusters were considered eligible if they intended to stay in the study catchment area for at least 1 month after delivery. Participating LHWs identified pregnant women and notified the study team. A data collector visited pregnant women, explained the study and collected informed consent. The LHW delivered the iNCK and/or the standard of care12 (online supplementary panel 1). LHWs taught pregnant women how to use each iNCK component and were instructed to reiterate iNCK education at postdelivery visits. However, postnatal visits by LHWs were not incentivised or monitored by the study. LHWs were not financially compensated in this study. To encourage prompt birth notifications, a small monetary incentive was offered to the first person that reported the delivery to the study team. All liveborn newborns were prospectively followed.
Data collectors visited participants’ homes in both the intervention and control clusters as soon as possible after delivery, and on days 3, 7, 14 and 28. At the first visit, events surrounding delivery and the postnatal status of the newborn were documented. At subsequent visits, outcomes that arose since the previous visit were recorded. All questionnaires were administered as structured interviews. Newborns were weighed on the day of enrolment, and on days 7 and 28. Data collectors were trained to identify newborn danger signs (online supplementary appendix) and to refer cases to facilities. To minimise operational complexities while prioritising the collection of data as close to delivery as possible, births notified after day 3 were only visited on, or after, day 28; data on pregnancy outcome, iNCK use and newborn vital status were collected at these visits. In the event of neonatal death or stillbirth, a verbal autopsy was attempted.23
The iNCK contains a CBK (gloves, soap, clean plastic sheet, sterile blade and cord clamps), 4% chlorhexidine solution, sunflower oil emollient, a continuous temperature indicator (ThermoSpot), a polyester blanket and an instant heat pack (online supplementary panel 1). At the time of iNCK delivery, LHWs individually taught expectant mothers how to use each iNCK component. If present, other caregivers (ie, mother-in-law, father, etc) were also engaged in the teaching session. Expectant mothers were instructed to take the entire iNCK to the facility at the time of delivery. In cases of home delivery, mothers were taught to provide the CBK to the birth attendant. Pregnant women were taught to apply chlorhexidine to the umbilical stump once daily from day 1 to day 10, and to apply one ThermoSpot sticker to the skin over the carotid artery on day 1 and leave it in place until day 14. Women were taught the meaning of each sticker colour and the actions to be taken if ThermoSpot indicated fever, cold stress or hypothermia. Sunflower oil was to be massaged over the newborn’s body once daily starting from day 3 until day 28. Each iNCK cost approximately US$10 to procure and assemble; however, at scale, the components of the iNCK can be sourced and assembled for less than US$5. LHWs in intervention clusters were provided a hand-held scale and were instructed to weigh newborns at their first postdelivery visit and to refer low birthweight (LBW) babies (<2500 g) to a health facility.
The primary study outcome was all-cause neonatal mortality. Neonatal deaths were documented by interview with caregivers at any study visit. Secondary outcomes include cumulative incidence of omphalitis, omphalitis severity (ascribed on the basis of observed inflammation) and severe infection24 (defined as the presence of any of the following symptoms: convulsions; tachypnea (60 breaths/min or more); fever; severe chest indrawing; movement only when stimulated or no movement; or feeding poorly or not feeding).24 With the exception of participant-reported feeding behaviours, symptoms were directly observed or measured by a data collector. Other secondary outcomes include the number of cases of hypothermia and fever identified by caregivers (using ThermoSpot), the proportion of newborns weighed within 3 days of birth by a LHW, and the proportion of LBW births identified by LHWs. Participants reported whether their newborns were weighed by a LHW and if so, the recorded weight. All outcome measures were recorded and analysed at the individual level accounting for cluster allocation. Additional secondary outcomes, which will be reported elsewhere, include neurodevelopment at 12 months, health facility use and the willingness to pay for the iNCK.
The sample size of 75 clusters per arm was calculated based on an estimated crude birthrate of 25 per 1000 population, baseline NMR of 42 per 1000 live births and 35 live births per cluster during the study. These estimates were derived from survey data that were collected within RYK approximately 1.5 years before this trial launched (unpublished). We hypothesised a 40% reduction in all-cause neonatal mortality in the iNCK group compared with the control group. The magnitude of the anticipated effect size was in-part based on results from a clinical trial of chlorhexidine in Pakistan,16 in which the first application of chlorhexidine occurred by a traditional birth attendant and resulted in a 40% decrease in neonatal mortality. In addition to the estimated effect of chlorhexidine, we hypothesised that there would be a further additive mortality effect from the other iNCK components. With 90% enrolment of eligible mothers and up to a 10% loss-to-follow-up, and using a conservative intra-cluster correlation of 0.01 for NMR, 150 clusters (5250 newborns) were needed to detect a 40% reduction in mortality with at least 80% power.25
Stratification, randomisation and masking
To minimise contamination, randomisation occurred at the cluster level; however, data were recorded and analysed at the individual level, accounting for clustering. A scientist not directly involved in the study performed the cluster-stratified randomisation. Before randomisation, 157 villages were stratified into two groups: villages with 1 LHW or more than 1 LHW. Villages were not stratified based on location. To balance cluster size, one large village with five LHWs was excluded. In all, 150 clusters were randomly selected and allocated into either the iNCK (n=75) or standard of care (n=75) groups using a 1:1 allocation ratio and computer-generated numbers (Stata V.13). Study participants, LHWs and study team members were aware of group assignments. However, to reduce measurement bias, outcome data were collected by data collectors that were not involved in intervention delivery.
Primary analyses of the effect of the intervention on outcomes were conducted as complete-case (ie, participants for whom vital status was known at the end of the neonatal period), intention-to-treat (ITT), irrespective of iNCK compliance and without imputation for missing data. Risk ratios (RR) were calculated using log-binomial regression on individual-level data and a robust variance estimator was used to account for cluster randomisation. Tests of significance were two-sided and did not adjust for baseline covariates. Post-hoc, complete-case, ITT analyses of the effect of the intervention on fever-alone and newborn mortality stratified by place of delivery, and age of death were conducted while accounting for clustering as described above. Post-hoc, complete-case, per protocol analyses of the effect of the intervention on neonatal mortality were also conducted (online supplementary appendix). Several additional post-hoc stratified analyses were performed (online supplementary appendix). Stata V.13 was used for all analyses.
Patient and public involvement
Patients were not involved in the conceptualisation, design or conduct of this trial. The results of the trial will not be disseminated directly to participants.
Between April 2014 and July 2015, 5451 pregnant women were enrolled in the study (2663 in the intervention group and 2788 in the control group) (table 1, figure 1). iNCKs were received between 1 and 22 weeks before delivery (median of 5 weeks) (online supplementary table S3). Delivery and newborn outcomes were collected between April 2014 and August 2015. A delivery outcome was collected for 5370 (98.5%) women (figure 1). There was no difference in place of delivery by treatment group with a total of 2107 (39.2%) women delivering at home (table 1). 5286 live-born deliveries were captured (2585 in the intervention and 2701 in the control arm). 134 (2.5%) stillbirths were reported and the stillbirth rate did not differ between groups (table 1). A total of 4573 visits (86.5%) occurred within 3 days of delivery (online supplementary table S4). Newborns enrolled after the first 3 days of life were equally distributed between arms (online supplementary table S4). Neonatal outcomes were available for 5233 (99.0%) newborns, 2557 (98.9%) in the intervention arm and 2676 (99.1%) in the control arm. About 80% of women in the intervention arm received some post-natal information by an LHW on how to use the iNCK (online supplementary table S3). However, only 28.6% (n=506) of women received their first post-natal LHW visit on day 1 of life (online supplementary table S3).
Most caregivers (n=2049, 91.7%) in the intervention arm reported that a CBK was used at the time of delivery compared with 1177 (50.3%) in the control arm (table 2). Almost every participant in the intervention group reported use of chlorhexidine (n=2209, 98.9%), sunflower oil (n=2209, 98.9%) and ThermoSpot (n=2204, 98.7%). However, compliance to instructions on timing of use varied. Only 704 (31.9%) participants who used chlorhexidine and 624 (28.3%) who used ThermoSpot started use, as intended, on day 1. Most participants (n=2079, 94.1%) in the intervention arm first applied sunflower oil on day 3. ThermoSpot enabled caregivers to identify 182 cases of fever, 15 cases of cold stress and 11 cases each of moderate and severe hypothermia (table 2). In the control arm, 1388 (60.7%) participants reported that Dettol, a locally available antiseptic, was applied to their baby’s umbilical stump (table 2) and mustard oil was commonly used for newborn massage (n=2291, 99.0%) (table 2).
A total of 147 newborn deaths were reported, 65 in the intervention arm (25.4 per 1000 live births) compared with 82 in the control arm (30.6 per 1000 live births). The overall mortality risk was not significantly different between the two groups (RR 0.83, 95% CI 0.58 to 1.18; p=0.30) (table 3). NMRs also did not differ between treatment arms when stratified by age of death and place of delivery (table 3). In a post-hoc per protocol analysis, a general trend emerged whereby increasing compliance improved the efficacy of the kit (online supplementary tables S8, S9).
The risk of omphalitis, irrespective of severity, was 32% lower in the intervention arm compared with the control arm (RR 0.68, 95% CI 0.48 to 0.98; p=0.04) (table 4). The risk of moderate omphalitis was reduced by 62% (RR 0.38, 95% CI 0.15 to 0.94; p=0.04). There was no significant difference in the risk of mild (RR 0.72, 95% CI 0.50 to 1.03; p=0.07) or severe omphalitis (RR 0.52, 95% CI 0.05 to 5.74; p=0.60) between groups (table 4).
The risk of severe infection was not different between groups (RR 1.17, 95% CI 0.80 to 1.72; p=0.41) (table 4); however, the risk of fever was lower in the iNCK group compared with the control group (RR 0.64, 95% CI 0.47 to 0.87; p=0.004). The proportion of newborns born at home and weighed by a LHW was higher in the intervention arm compared with the control arm (RR 4.81, 95% CI 1.96 to 11.80; p<0.001). Among home births, a larger proportion of LBW babies were identified by LHWs in the intervention arm compared with the control group (RR 3.48, 95% CI 1.00 to 12.10; p=0.05) (table 4).
No adverse events were reported.
The primary aim of this study was to assess whether a package of six evidence-based neonatal interventions in conjunction with teaching, when delivered directly to pregnant women and families by LHWs, would reduce neonatal mortality. In fact, the provision of the iNCK to pregnant women and families did not significantly lower neonatal mortality compared with the standard of care in RYK, Pakistan.
The absence of a significant mortality effect may be attributable to several factors. First, while overall utilisation of the iNCK components was high, instructions regarding the timing of usage were not always followed. For example, while 99% of participants in the iNCK group used chlorhexidine, only about 30% of these participants first applied chlorhexidine on day 1, as was instructed. Application of chlorhexidine within the first 24 hours of life is important for improving newborn survival.15 17 Similarly, while 99% of participants used ThermoSpot, only 28% of these participants applied ThermoSpot on day 1. Since most newborn deaths happen within 24 hours of delivery, the ability to detect fever and hypothermia soon after delivery is imperative. Second, the effect of the iNCK may have been diluted by the use of similar interventions in control clusters. For example, approximately 50% of women in the control group reported use of a CBK at delivery. Similarly, about 60% of participants in the control group reported that Dettol was applied to their newborn’s umbilicus. Chloroxylenol, the antiseptic in Dettol, reduces bacterial burden but, based on animal studies, may not do so as effectively as chlorhexidine.26 Third, the relatively low proportion of home deliveries (39%) may have attenuated the effect of chlorhexidine on mortality. Evidence suggests that chlorhexidine has a larger effect on neonatal mortality in settings with higher proportions of home deliveries and higher NMRs27; however, it is also important to highlight that meta-analyses, which have included both home and facility births, have concluded that chlorhexidine reduces the risk of both omphalitis and death in both of these settings.14 Fourth, frequent home visits by study personnel may have acted like a co-intervention28 and thus, improved neonatal health in all study participants; the NMR in the control group (30.6 deaths per 1000 live births) was lower than the anticipated NMR (42 deaths per 1000 live births). Similarly, among participants that had zero home visits in the first week of life, the NMR was 29% lower in the iNCK arm compared with the control arm (RR 0.71, 95% CI 0.43 to 1.18). By contrast, among participants that had one or more home visits in the first week of life, NMR was only 5% lower in the iNCK arm compared with the control arm (RR 0.95, 95% CI 0.58 to 1.53) (online supplementary table S5). Finally, given that the average temperature in RYK ranged from 21°C (January 2015) to 43°C (July 2014) over the study period, the utility of the heater and blanket may have been diminished.
While the iNCK did not significantly reduce neonatal mortality, several findings support further investigation of the iNCK. First, existing community health infrastructure was leveraged to distribute the iNCK, demonstrating the feasibility of this platform for future programmes. Second, CBKs were more frequently used during home deliveries when provided directly to pregnant women in intervention clusters compared with pregnant women in control clusters (94.6% vs 17.6%). Third, caregiver utilisation of the iNCK was effective at reducing the risk of omphalitis and fever, both of which may predict or precede serious infection. Caregiver implementation of interventions is likely more sustainable and less costly than having CHWs conduct routine home visits to implement interventions. Fourth, ThermoSpot enabled caregivers to identify and act on cases of fever, cold stress and hypothermia, symptoms that may indicate severe illness. Fifth, providing a scale to LHWs increased the proportion of LBW babies identified; however, participant uptake for LBW referrals is unknown. LBW is a risk factor for neonatal mortality and early detection is important for referral and subsequent management. Sixth, mustard oil, for which there are documented adverse effects on epidermal structure and barrier function,29 was used by approximately 99% of participants in the standard of care arm. Newborn massage with sunflower oil offers a safer alternative to mustard oil that has documented benefits.29 While we are unable to report whether caregivers completely replaced the application of mustard oil with sunflower oil emollient in the intervention group, the greater than 98% uptake of sunflower oil in the iNCK arm suggests that there is potential for adapting an established cultural practice with one that is safer and has greater benefits.29 30 Finally, a general trend emerged whereby increasing compliance improved the efficacy of the iNCK.
There were some limitations to this study. First, since compliance data were self-reported, they may be distorted by social desirability bias. Second, gaps in the information collected during the trial prevent us from making inferences on how LHW engagement, acceptance of LHW referrals for LBW identification, barriers to timely LHW postnatal visits, LHW teaching quality and other process indicators may have influenced compliance and neonatal outcomes. Third, since villages were not stratified based on location, contamination may have occurred between clusters. However, data collected on the utilisation of iNCK components in control clusters suggests that contamination did not occur. Fourth, while the diagnosis of omphalitis was conducted by trained data collectors, we did not validate our diagnosis algorithm against a gold standard within this study population, photos were not taken of the cord to allow for post-hoc adjudication of infection, and inflammation, which was shown to have low sensitivity (12%) for community-based assessment of omphalitis in Nepal,17 was included as a sign within our diagnosis algorithm. Without real-time in-person parallel gold standard assessment,31 the validity of omphalitis diagnoses should be interpreted with caution. Finally, the effect size that was used to estimate the sample size (40%) and the fact that it was not realised, meant that statistical significance was not achieved. That said, the approximately 20% reduction in NMR that was estimated, while not statistically significant, may represent a genuine effect that is clinically meaningful and should not be discounted.
The integration of evidence-based interventions for implementation by caregivers has long been considered a promising means to improve neonatal survival.11 We demonstrated that, while the idea of integrating interventions, delivering packages by LHWs and engaging caregivers as implementers, has several advantages, it did not translate into improved neonatal survival. Further research into the practical implications of the iNCK, including strategies to improve caregivers’ compliance, is necessary.
The trial is registered with Clinicaltrials.gov, number NCT02130856, under the title ‘Newborn Kit to Save Lives in Pakistan’.
The trial protocol was previously published.22
Handling editor Douglas James Noble
Contributors SKM and ZAB conceptualised the study idea. SKM, LGP, AT, DGB, SS, SA, MH and ZAB played a role in the study’s design, planning and implementation. LGP and JS analysed the data. LGP wrote the first draft of the manuscript and led revisions. All authors read, contributed edits and approved the final version of the manuscript.
Funding This project was funded by Grand Challenges Canada (S4 0230-01), UBS Optimus Foundation (6793_UBSOF) and March of Dimes Foundation (#5-FY14-48). Baby Hero (https://babyhe.ro) further supported the study. SKM received support from the Canadian Child Health Clinician Scientist Program. The funders of the study had no role in study design, data collection, analysis and interpretation or writing of the report.
Competing interests None declared.
Patient consent for publication Not required.
Ethics approval Research Ethics Board at The Hospital for Sick Children (REB No. 100042963) National Bioethics Committee, Pakistan (No.4-87/13/NBC-133/RDC/2629).
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement Data are available upon reasonable request.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.