Article Text
PDF
Abstract
Introduction The Practical Approach to Care Kit (PACK) guide was localised for Brazil, where primary care doctors and nurses were trained to use it.
Methods Twenty-four municipal clinics in Florianópolis were randomly allocated to receive outreach training and the guide, and 24 were allocated to receive only the guide. 6666 adult patients with asthma or chronic obstructive pulmonary disease (COPD) were enrolled, and trial outcomes were measured over 12 months, using electronic medical records. The primary outcomes were composite scores of treatment changes and spirometry, and new asthma and COPD diagnosis rates.
Results Asthma scores in 2437 intervention group participants were higher (74.8%, 20.4% and 4.8% with scores of 0, 1 and 2, respectively) than in 2633 control group participants (80.0%, 16.8% and 3.2%) (OR for higher score 1.32, 95% CI 1.08 to 1.61, p=0.006). Adjusted for asthma scores recorded in each clinic before training started, the OR was 1.24 (95% CI 1.03 to 1.50, p=0.022). COPD scores in 1371 intervention group participants (77.7%, 17.9% and 4.3% with scores of 0, 1 and 2) did not differ from those in 1181 control group participants (80.5%, 15.8% and 3.7%) (OR 1.21, 95% CI 0.94 to 1.55, p=0.142). Rates of new asthma and COPD diagnoses, and hospital admission, and indicators of investigation, diagnosis and treatment of comorbid cardiovascular disease, diabetes and depression, and tobacco cessation did not differ between trial arms.
Conclusion PACK training increased guideline-based treatment and spirometry for asthma but did not affect COPD or comorbid conditions, or diagnosis rates.
Trial registration NCT02786030 (https://clinicaltrials.gov/).
- primary care
- respiratory disease
- educational outreach
- implementation research
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Summary box
What is already known?
Educational outreach to primary care nurses, to improve diagnosis and treatment of adult chronic disease with clinical guidance, has been proven effective in South Africa.
What are the new findings?
Similar outreach education to primary care nurses and doctors in Florianópolis, Brazil, increased initiation and alteration of asthma treatments, and use of spirometry for asthma, but did not change chronic obstructive pulmonary disease (COPD) management or rates of asthma and COPD diagnosis.
What do the new findings imply?
Practical Approach to Care Kit training is an effective method of improving management of adult asthma in this urban Brazilian setting.
Introduction
Asthma and chronic obstructive pulmonary disease (COPD) are major contributors to the burden of chronic illness in Brazil. The Global Burden of Disease Study 2016 ranked COPD as the eighth highest disease in Brazil in terms of disability-adjusted life years lost.1 Asthma was ranked 17th in terms of years lived with disability.1 Despite progress in tobacco control, in 2016 tobacco use was the fifth most important cause of disability-adjusted life years lost, especially through its effects on chronic respiratory disease.1 Epidemiological studies have found high rates of undiagnosed and untreated or inappropriately treated asthma and COPD in Brazil.2 3 WHO’s World Health Survey found that 23% of Brazilian adults aged 18 to 45 years reported wheezing in the last year, of whom only 12% had a doctor diagnosis of asthma.3 Comorbidity is increasing,4 with high and growing rates of chronic conditions like cardiovascular disease, diabetes and depression.
Provision of good-quality primary healthcare, including investigation, diagnosis and appropriate treatment of asthma, COPD and comorbid conditions, is a crucial part of the solution. Since 1998, Brazil increased provision of free primary care by municipalities through the Family Health Programme of the national Unified Health System.5 Brazilian municipalities that provided free inhaled corticosteroids (ICSs) for asthma experienced larger reductions in hospital admissions and deaths from asthma than those who did not,6 and those who provided more long-acting beta2 agonists (LABAs) had larger reductions in hospital admission rates for COPD.7 Programmes to improve asthma care in two cities, with physician education, and free ICS and LABA, also reduced hospital admissions.8 9
The present study evaluates an initiative to improve integrated primary care including for asthma, COPD and comorbid chronic conditions across a Brazilian city by adapting a programme that has been developed and delivered at scale in South Africa. The Practical Approach to Care Kit (PACK) programme was developed by the Knowledge Translation Unit (KTU) of the University of Cape Town Lung Institute, in collaboration with government health departments in South Africa.10 11 It has four components—a clinical decision support tool or guide, primary care worker training, health system strengthening, and monitoring and evaluation.12 13 PACK has been localised for, and is being used in, Nigeria,14 Ethiopia15 and Botswana.16
PACK was localised to the Brazilian context, and specifically for municipal primary healthcare clinics in the city of Florianópolis, between 2014 and 2016, with leadership by local primary care doctors mentored by the KTU.17 Florianópolis has a population of 486 000 and was the first Brazilian municipality to provide universal health coverage under the auspices of the national Family Health Strategy. Although it is one of the wealthiest cities in Brazil, with a large private health sector, a substantial proportion of its population has lower incomes and depends on free municipal primary care facilities. There are 48 municipal facilities, with ambulatory care delivered by pairs of family doctors and nurses, between one and seven (median 2.5) doctor–nurse pairs in each, and 750–8500 (median 2700) adults served by each facility. Both nurses and doctors manage adults with respiratory symptoms, but nurses are not authorised to prescribe corticosteroids or beta2 agonists, referring patients with asthma or COPD to doctors for initiation or changes of treatments.
The purpose of using PACK in Florianópolis was to improve the quality and equity of primary healthcare for adults, while expanding and redefining the clinical roles of doctors and nurses. Before the study, the Florianópolis city health department identified asthma, diabetes, hypertension, back pain and tuberculosis as priorities for quality improvement, noting, for example, that in 2016, over 60% of adults diagnosed with asthma had never received inhaled corticosteroids, 20% had also been diagnosed with COPD, 38% with hypertension or cardiovascular disease, and 12% with diabetes. Therefore, PACK’s emphasis on integrated diagnosis and management of multiple conditions was deemed appropriate. PACK training covered multiple conditions, but the current study focuses only on its effects on participants with asthma and COPD.
The objective of the trial was to evaluate the effects of PACK training on the diagnosis, investigation and treatment of asthma and COPD in adults attending Florianópolis municipal clinics. A parallel trial of the impact of the same PACK training on cardiovascular and diabetes care, including using PACK to expand the scope of nurses, was planned and is in analysis.18 This paper reports the impact of PACK educational outreach training on primary care of respiratory conditions during the first year after active implementation and is part of a Collection of papers on PACK.
Methods
Trial design
This was a pragmatic, parallel-group, superiority cluster randomised trial18 (figure 1 and figure 2). All but one of 49 municipal clinics in Florianópolis were included in the trial; a small mobile clinic was excluded. Outcomes were measured over two baseline and one follow-up period (figure 1). The follow-up period was the 12 months after initial training ended (figure 1). The first baseline period, defined in the protocol,18 was the 12 months before follow-up began, during which initial training was completed (baseline 1 in figure 1). The second and earlier baseline period, adopted during the conduct of the study, was the 12 months before training began (baseline 2 in figure 1). Baseline 1 was originally specified because we assumed that the intervention would have no effect before initial training had been completed.18 However, trainers observed that delivery of training was associated with immediate effects on asthma and COPD care, which was likely to bias participants’ baseline characteristics, and therefore also the estimates of effectiveness during follow-up. We therefore defined the second baseline period before training began (baseline 2). The follow-up period was 1 April 2017 to 31 March 2018 (figure 1). Baseline 1 period was 1 April 2016 to 31 March 2017. Baseline 2 period was 1 July 2015 to 30 June 2016.
Timing of interventions, data collection and follow-up periods.
CONSORT diagram of recruitment and follow-up in intervention and control clinics. COPD, chronic obstructive pulmonary disease.
Patient and public involvement
Patients and public were not involved in carrying out this study. However, Brazilian health professionals and health professional organisations were consulted in developing the PACK guide.
Randomisation
Clinics were grouped into six strata, defined by numbers of doctor–nurse teams in each clinic (1–2, 3–4 teams or ≥5 teams), and by their geographical location, which served as an indicator of socioeconomic position. A trial statistician (CL) randomly allocated clinics within each stratum to intervention and control arms in a 1:1 ratio using nQuery Advisor before the intervention began.
Blinding
Outcomes were extracted from routine electronic medical records and so recorded without participants’ input, thus blinding of patients was not necessary. Blinding of health professionals was not possible because of the nature of the intervention.
Study populations
Eligible participants were identified using International Classification of Disease (ICD-10) diagnostic codes in electronic medical records for each clinic visit, in a consolidated municipal database. Patients included were all those aged 18 years and over in March 2017, who attended a participating clinic during the first year of the follow-up (figure 2), with a clinical diagnosis of obstructive lung disease (ICD-10 codes 40–47) recorded in electronic medical records since 1 January 2010, when electronic medical recording began. This study population was subdivided into those with asthma (with or without COPD) and those with COPD (with or without asthma). An additional study population comprised all adults who attended participating clinics during 12 months after training ended, in whom the annual rates of new diagnoses of asthma and COPD were estimated (figure 2). No sampling was used.
Delivery of PACK in intervention and control group clinics
Both intervention and control clinics were provided with the PACK guide in May and June 2016, and were included in the health systems strengthening, and monitoring and evaluation components of PACK,17 but only intervention clinics received training during the period covered by this study. The trial therefore evaluates the effect of PACK training.
The PACK guide is an integrated, comprehensive clinical decision support tool for use during primary healthcare consultations.12 A global version of the guide (freely available at https://knowledgetranslation.co.za/pack/) provides an evidence-aligned and WHO guidance–aligned clinical approach to common symptoms, including cough, difficulty breathing, wheeze and chest pain in its first half and the remainder covers chronic conditions, including asthma, COPD, tuberculosis, cardiovascular disease and risk, diabetes and depression, and health promotion. The chronic respiratory disease section covers investigation, diagnosis and treatment of asthma and COPD, use of inhalers, spacers and peak flow meters. The Florianópolis version, comprising 103 pages, was provided in printed hard copy (from May 2016 onwards) and as an interactive PDF during the late stage of data collection (from November 2017 onward).17 This version of the guide, PACK Brasil Adulto—versão Florianópolis, was adapted to fit local needs and resources, and 49 local and national guidelines and protocols, and translated into Brazilian Portuguese.17 Local primary care professionals, medical specialists, health service managers and other stakeholders were involved in localisation. Unique features of the Florianópolis adaptation included the first use of a mentorship model to support localisation,10 guidance on smoking cessation, and expansion of PACK’s colour coding system to reflect nurse and doctor role definitions.
PACK training comprised educational outreach for primary care doctors and nurses on how to use the PACK guide, using clinical case scenarios.12 Training was provided in or near the primary care facilities where trainees worked, entailed short interactive group sessions of about 90 min which were repeated about weekly during initial training and fortnightly during maintenance training. Training sessions were led by facility trainers who worked in the same facility or within the local health system. More detail on the training model is provided in another paper in this Collection.13 Unique features of the training in Florianópolis included appointing interprofessional nurse–doctor pairs to deliver outreach sessions, embedding master trainers, responsible for training and supporting the facility trainers, within the Primary Healthcare Department, and a curriculum focused on locally identified priorities, including respiratory conditions, diabetes, hypertension, back pain and tuberculosis. Initial training in intervention clinics took place during 12 sessions over 6 months (figure 1). After a pause of 3 months, 14 maintenance training sessions were delivered over 12 months. Training was delivered to 160 doctors and nurses, all of whose responsibilities included asthma and COPD care. Three municipal strikes within the context of political upheaval interrupted smooth implementation.17 After initial training, the pairs of facility trainers visited each clinic monthly, and the master trainers continued to communicate with facility trainers using email and a WhatsApp group.
Primary outcomes
There were three primary outcomes. The first two represent key healthcare processes that in Brazil and elsewhere have been shown to be associated with better health outcomes in patients with asthma and COPD, reflect the quality and intensity of respiratory care, and are based on actions recommended in the PACK guide.6–9 19 20 The third primary outcome addresses the problem of underdiagnosis.2 3
For participants with asthma the composite score comprised points awarded for (a) first prescription of an ICS, or ICS+LABA combination (LABA+ICS), or a change in prescription: stepping up from short-acting beta2 agonist (SABA) to ICS or from ICS to LABA+ICS; or stepping down from LABA+ICS to ICS, or from ICS to SABA (scoring one point if at least one of these occurred); and (b) request for spirometry (one point). The asthma score is the sum of these points, and ranges from 0 to 2.
For participants with COPD, the composite score comprised points awarded for (a) a first prescription of SABA, ICS or ICS+LABA; or a change in prescription, stepping up from SABA to LABA or from LABA to ICS+LABA, or stepping down from LABA+ICS to LABA, or from LABA to SABA (scoring one point if at least one of these occurred) and (b) request for spirometry (one point). The COPD score is the sum of these points, and ranges from 0 to 2.
At clinic level, the diagnosis rate was defined as the ratio between numbers of new diagnoses of asthma or COPD in patients aged 18 years and over to the total numbers of patients aged 18 years and over attending each clinic during baseline and 12-month follow-up periods.
Secondary outcomes
Secondary outcomes were the disaggregated treatment and spirometry components of asthma and COPD scores, prescriptions to support tobacco cessation (nicotine replacement therapy, nortriptyline or bupropion), cardiovascular disease (ICD-10 I00–I99) diagnosed for the first time, diabetes mellitus (ICD-10 E10–E14) diagnosed for the first time, cardiovascular risk assessed (ie, blood pressure recorded, or cholesterol, glucose or ECG tests requested), depression (ICD-10 F32–F34) diagnosed for the first time and medication for depression (tricyclic and related antidepressants, selective serotonin re-uptake inhibitors or monoamine oxidase inhibitors) prescribed for the first time. Outcomes relating to cardiovascular disease, diabetes and depression were indicators of awareness and management of potential comorbidity in people with chronic respiratory disease. Clinical level ratios between numbers of hospital admissions for asthma or COPD, and total numbers of patients aged >18 attending each clinic during baseline and follow-up periods, were respiratory health indicators.
Data collection and management
Quantitative data on outcomes and baseline variables were extracted from the municipal health department’s electronic medical records. Clinical data (including coded symptoms, ICD-10 coded diagnoses, prescriptions and test requests) were routinely entered during each consultation by a doctor or nurse, and linked at city, clinic and patient levels. The database was actively managed and regularly interrogated by a member of the Primary Healthcare Department (MPdA).
Sample size and power
The sample size calculation for patients with asthma assumed, based on previous medical records, that about 2900 eligible patients with asthma would attend 48 participating clinics during the year of follow-up, with mean asthma scores of 0.43 (SD 0.50) in the control group and intra-clinic correlation (ICC) of 0.033. The sample size calculation for patients with COPD assumed that about 1400 eligible patients with COPD would attend participating clinics during the year of follow-up, with mean COPD scores 0.42 (SD 0.48) in control clinics and ICC of 0.055. This would provide 90% power to detect a 26% increase in mean asthma score (0.54 vs 0.43), and a 33% increase in mean COPD score (0.56 vs 0.42), with 5% significance. At clinic level, the mean annual rate of new diagnoses of asthma or COPD was 11 (SD 4.6) per 1000 patients aged >18 attending for any reason, providing 85% power to detect a 36% increase in rates of diagnosis (15 vs 11 per 1000 per year). With Bonferroni correction to the significance level to account for having three primary outcomes (p=0.05/3=0.017), the power to detect these differences as significant at the 1.7% level was 84%, 82% and 73%, respectively.
Statistical analysis
Statistical analyses were conducted to estimate the magnitude of effects by comparing outcomes between intervention and control groups, using Stata V.15 statistical software. Diagnosis rates in each clinic were compared at clinic level using linear regression. All other outcomes were compared at individual patient level, using regression models with robust adjustment for intra-cluster correlation of the outcome by clinic. Ordinal logistic regression was used for analyses with asthma and COPD scores as outcomes. Logistic regression was used for all other, binary, outcomes. Three sets of all analyses were carried out, first without adjustment for baseline values of the respective outcome, second with adjustment for baseline values recorded during baseline 1 and third with adjustment for baseline values recorded during baseline 2 (figure 1). The baseline values used for adjustment were mean values recorded in each clinic, instead of individual level values, so as to be able to include participants newly diagnosed during the follow-up period. All regression models included randomisation stratum as a covariate. Intra-cluster correlation coefficient for each outcome variable was estimated using one-way analysis of variance. We carried out subgroup analyses, to test whether effects differed between participants with newly or previously diagnosed asthma or COPD, by adding arm–subgroup interaction terms to the regression models. We also tested whether effects differed between subgroups of participants with both asthma and COPD and those with only asthma or COPD.
Ethics and research governance
Ethical guidance on cluster randomised trials and on use of medical records for research was adhered to.21 22 Identification of eligible participants and outcome measurement used electronic medical records without study-specific patient contact. It was not feasible to obtain patients’ consent to be randomised to intervention or control arms because randomisation and delivery of the intervention were at clinic level.
Patients were not asked for consent for their electronic medical records to be used for this research because it was not feasible. However, we adhered to the ethical principles for use of medical records without patients’ consent,22 as follows. The research had a clear public benefit. We obtained approval for the study from the lead doctors and nurses managing the programme. Use of the data for research did not influence decisions about individuals’ care. Only health department data managers had access to personal identifiers. Data with patient identifiers were held by the Florianópolis City Health Department as part of routine data management, and anonymised unlinked data were securely stored and analysed at the University of East Anglia.
Results
The trial participants comprised 6666 adults with a new or previous diagnosis of asthma or COPD who attended a participating clinic for any reason during 12 months after the end of initial training (figure 2). The median number of visits per participant during this period was 5 (IQR 2–9). The median number of participants in each control clinic was 115 (range, 34–504) and the median number in each intervention clinic was 133 (range, 43–364). Of the 6666 participants, 3355 (2633 with asthma and 1181 with COPD, including 459 with both) attended control clinics and 3311 (2437 with asthma and 1371 with COPD, including 497 with both) attended intervention clinics (figure 2, table 1). Two-thirds (67%) of participants were women, and the mean age at start of follow-up was 51.4 (SD 18.3) years. Participants with asthma were less likely than those with COPD to be men (29% vs 44%) and tended to be younger (mean ages 47.8 and 62.6 years, respectively) (table 1). These participants were identified among all 72 324 adults who attended control clinics and 81 750 who attended intervention clinics during the same period. All participants were included in the assessment of trial outcomes, either at individual level (for participants with asthma or COPD) or at clinic level (for assessment of rates of new asthma and COPD diagnoses among all attendees).
Baseline characteristics of participants* in intervention and control arms
The baseline characteristics of participants with asthma or COPD, or both, in intervention and control clinics were compared if they attended a participating clinic during either baseline 1 or baseline 2 periods (table 1, figure 2). Participants newly diagnosed during the follow-up period are excluded from these results because these data were mostly not available or applicable to them. During both baseline periods, participants with asthma and those with COPD in intervention clinics were slightly less likely to be men and had slightly higher mean ages than those in control clinics. They were also slightly more likely to have ever received prescriptions for ICS, SABA and LABA+ICS. Participants with asthma in intervention clinics were slightly more likely than those in control clinics to have treatment started or changed or spirometry requested during the baseline periods, resulting in higher asthma scores; these differences were greater during baseline 1 than during baseline 2. Participants with COPD had the same pattern of differences between intervention and control clinics in treatments and spirometry at baseline, resulting in higher COPD scores in intervention clinics. Differences in COPD scores were larger during baseline 1 than during baseline 2. Management of comorbid cardiovascular disease, diabetes and depression was similar in intervention and control clinics. Rates of new diagnoses of asthma and COPD were similar in intervention and control clinics during baseline 1 but were slightly lower in intervention clinics during baseline 2. Hospital admission rates were similar in intervention and control clinics.
Trial outcomes during the 12 months of follow-up are shown in table 2. Among participants with asthma, those in intervention clinics were more likely to have a start or change in treatment (19.0% vs 15.1%, p=0.012) and to have spirometry requested (11.0% vs 8.1%, p=0.012), resulting in higher asthma score (p=0.006). Among participants with COPD, those in intervention clinics were not more likely to have a start or change in treatment (10.7% vs 10.1%, p=0.699) or to have spirometry requested (16.1% vs 13.0%, p=0.053), resulting in no difference in COPD score (p=0.142). Among participants with asthma or COPD, or both, there were no differences in management of comorbidities or tobacco cessation medication, which, with the exception of cardiovascular risk assessment, were all less than 4%. Rates of new diagnoses of asthma and COPD, and of hospital admissions, did not differ between intervention and control clinics.
Follow-up values of outcome variables in intervention and control clinics
The magnitude of effects of the intervention on trial outcomes were estimated with and without adjustment for clinic level mean baseline values of the corresponding outcome variable (table 3). The OR of having a higher asthma score was 1.32 (95% confidence limit (CL) 1.08 to 1.61, p=0.006) in intervention clinics compared with control clinics, without adjustment for baseline. The corresponding adjusted OR was 1.15 (0.94 to 1.41, p=0.173) with adjustment for baseline values recorded in each clinic during baseline 1, and 1.24 (95% CL 1.03 to 1.50, p=0.022) with adjustment for baseline values recorded in each clinic during baseline 2. ORs for the two components of the asthma score (treatment and spirometry) were similar to those for the composite asthma score, except that the OR for start or change of treatment remained statistically significant at the 5% level with adjustment for baseline values recorded during baseline 1 (OR 1.21, 95% CL 1.01 to 1.45, p=0.041). In participants with COPD, ORs were slightly higher than one for all but one of the outcomes, but none of these was statistically significant at the 5% level. Management of comorbid cardiovascular disease, diabetes and depression, prescriptions for tobacco cessation, and rates of new asthma and COPD diagnosis, and of hospital admissions, did not differ between intervention and control clinics, with or without adjustment for baselines. Effect estimates did not differ between subgroups with newly or previously diagnosed asthma or COPD, or between subgroups with both asthma and COPD and those with only one condition (p>0.05 for interaction terms) (results not shown).
Effect estimates with and without adjustment for baseline values of outcome variables1
Discussion
The trial indicates that educational outreach training of primary care doctors and nurses to use the PACK guide for the management of respiratory diseases, compared with provision of the guide without training, was associated with small increases in initiation or change of treatment and use of spirometry for adults diagnosed with asthma. Conservatively using a 1.7% significance level, to account for having three primary outcomes, the difference in asthma score remains statistically significant (p=0.006). Similar patterns of outcomes and ORs were seen for participants with COPD, but these associations were not statistically significant. The intervention was not shown to affect the rate of new diagnoses of asthma or COPD, prescriptions for tobacco cessation, or the management of comorbid cardiovascular disease, diabetes or depression, all of which were very low with the exception of cardiovascular risk assessment which included blood pressure measurement.
When estimated effects on the primary endpoints were adjusted to account for clinical activity during baseline 1 (which included training for at least 8 months), the magnitude of these effects was reduced, and estimated effects on primary outcomes became non-significant. The latter adjustment, proposed in the original protocol,18 might however be excessive if, as the results suggest, training had begun to have effects during baseline one period (table 1). However, the OR for start or change of treatment in participants with asthma—the main component of the asthma score—was consistent despite either adjustment and remained statistically significant.
Interpretation of these results requires several considerations. The trial evaluated only the training component of the programme, and not the other components (PACK guide, health system strengthening and monitoring and evaluation), which were provided to both control and intervention clinics. However, access to the guide may indeed have influenced clinical practice in control clinics, as suggested by the 60% increase (0.330/0.206) in mean asthma scores and the 39% increase (0.281/0.202) in mean COPD scores, in control clinics from baseline 2 (table 1) to the follow-up period (table 2). These changes in control clinics reduced the trial’s scope for demonstrating additional improvements in intervention clinics due to training alone.
We have used this approach to evaluating the impact of PACK training in our previous trials with other versions of PACK, with small, consistent and generally positive results.23–26 The current trial demonstrates small but significant effects on improving management of at least one endpoint. As we have previously argued, pragmatic trials, with their potential for contamination despite cluster randomisation, unplanned co-interventions and other factors, when negative are of little help to health planners (other than in ruling out harm) but, when positive, provide compelling evidence for adopting a complex intervention, especially if the new method is well received by providers and recipients of care.27
The selection of participants and data collection methods need to be considered. Compared with our prior calculations, the actual sample sizes and statistical power were greater, but the differences in primary outcomes were smaller than anticipated. In contrast to our previous trials in low-income and middle-income countries, the relatively high rates of previous treatment among participants before training began (table 1) may have limited the scope for training to further increase initiation and changes of treatment. Almost half of participants with asthma and over 40% with COPD had already received some treatment, and over 40% of both groups had already received ICS, either alone or in combination with a LABA. These treatment rates are similar to those reported in surveys from Brazil as a whole but are still not optimal.28 29 In asthma, use of ICS and other controllers should be higher and so the increase in prescribing in the present study, although small, is gratifying. But for COPD, as Zimmermann Teixeira and colleagues report, the more common problem in Brazil is overtreatment with ICS for mildly severe COPD and undertreatment for severe disease.29 Thus, the relatively high use of ICS in primary care patients observed in Florianópolis, who might have milder disease compared with others receiving specialist care, may still provide room for improvement.
Our use of routine electronic medical records to identify and characterise eligible participants may have led to inclusion of some participants to whom trial outcomes were not relevant. Some may have been diagnosed with asthma or COPD years earlier but asymptomatic or well controlled during the trial, and thus did not need the investigations or treatments used as trial outcomes. We included participants newly diagnosed with asthma or COPD during the follow-up period because they would presumably be most in need of investigation or new treatments. Electronic medical records did not permit us to accurately assess participants’ respiratory health status, as respiratory symptom questionnaires and spirometry would have done, to identify individuals who most needed to start or change treatment or to evaluate health outcomes. Instead, we relied on process indicators of effective and improved management.
Other trial design issues relate to the nature and intensity of training. PACK training is performed on-site and in-service, and is continuous, being conducted in short sessions at fortnightly intervals. Since the guide is comprehensive and covers the the most common conditions managed in primary care facilities, it is possible that, within the trial’s training period, there was insufficient emphasis on the management of respiratory conditions to produce larger effects. The follow-up period might also be too short to detect changes in clinical practice. We will therefore continue to monitor outcomes after completion of this trial, for delayed effects, or changes in control clinics after they receive training.
This study setting had favourable features. Florianópolis is a leader in Brazil both in its primary care provision and in its electronic medical record system which provides considerable scope for evaluating practice innovations such as PACK. Electronic medical records enabled us to characterise clinical practices and identify and include all eligible patients who used municipal clinics in the entire city, thus enhancing generalisability and providing a large sample size at minimal cost. This follows our successful use of electronic medical records in randomised trials of PACK’s precursors in South Africa.24 25
This study contributes to implementation research on methods for improving primary respiratory care. The results support the growing evidence of the effectiveness of the training component of the PACK approach in which clinicians are introduced to customised, up-to-date, evidence-based, point-of-care clinical decision support.23–26 Thus, although the impact of training is not large nor consistent across asthma and COPD, within the context of the global implementation of PACK as a learning health system, the results add evidence that the training intervention is effective on a different continent and in a different socioeconomic and health system context. This trial does not explain how PACK works, or what element is most effective, but supports qualitative and quantitative evidence previously reported in more than 50 peer-reviewed publications.23 24 30 A qualitative process evaluation is under way. Early findings indicate that trainers, trainees and health officials were enthusiastic about PACK and that training stimulated a desire for continuing professional development. Attendance at training sessions was high, but staff turnover meant that supplementary training was needed for new staff. Training was felt to improve cooperation between doctors and nurses, while expanding nurses roles’ and confidence. Political changes in local government, and fiscal constraints arising from Brazil’s economic crisis, did not affect implementation during the study. The results of this trial are consistent with the most recent and comprehensive review of healthcare provider strategies to improve performance which advocates for combining training with group problem solving and supervision, both of which are built into the PACK implementation approach.31
The results support expanding nurses’ roles and strengthening nurse–doctor co-operation in asthma care. Nurses were not authorised to prescribed asthma or COPD medication or to request spirometry, but they were trained to refer patients whom they identified as needing these interventions to doctors in their primary care teams. Training doctors and nurses together aimed to align their clinical decision-making. These results add to previous evidence about interventions to promote interprofessional collaboration.32 33
In conclusion, this study shows that it was feasible to localise and implement PACK in municipal primary care services across a Brazilian city, and that PACK training led to improvements in asthma care within a year of completing initial training.
Abstract translation
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.Acknowledgments
The authors are grateful for the Florianópolis City Health Department for permission to carry out the study, to the doctors and nurses in clinics who participated in the training and using of the PACK guide; to Dr Tracy Eastman (Director of PACK Global Development at Knowledge Translation Unit and BMJ Publishing Group) for support with agreements, project management and quality assurance. This work was supported by the Florianópolis City Health Department which funded in-country localisation of PACK Adult, printing of the PACK guide, training and clinical support. Use of PACK Global Adult guide and associated materials was provided free of charge to Florianópolis City Health Department by BMJ Publishing Group on behalf of the Knowledge Translation Unit. Mentoring of the localisation of the guide and training materials by the Knowledge Translation Unit was funded by the Peter Sowerby Foundation (http://www.petersowerbyfoundation.com/) as part of development of a localisation toolkit for PACK.
Footnotes
Handling editor Seye Abimbola
Twitter @sonianatal
Contributors MOB, EDB, RS, AAC, MPdA, RZ, JZ, SN, CL and LRF conceived of and designed the study. EDB, MPdA, RZ, JZ, SN, RVC, CW, LA, DG-P and LRF contributed to development of the PACK Brasil Adulto—versão Florianópolis guide and training materials. MPdA collated the electronic medical record data and MOB carried out the statistical analysis. All authors contributed to writing the paper and approved the final manuscript.
Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests We have read and understood BMJ policy on declaration of interests and declare that CW, LRF, DG-P, LA, RVC and EDB are employees of the KTU. RZ and MPdA are employees of the City Health Department, Florianópolis, Brazil. JZ is an ex-employee of the City Health Department, Florianópolis, Brazil and a current holder of full-time PhD studentship from the Brazilian research agency CNPq. AAC reports grants, personal fees and non-financial support from GSK, personal fees and non-financial support from AstraZeneca, personal fees and non-financial support from Boehringer Ingelheim, personal fees and non-financial support from MEDA, personal fees and non-financial support from Novartis, personal fees and non-financial support from EUROFARMA, personal fees and non-financial support from CHIESI, personal fees and non-financial support from Boston Scientific, outside the submitted work. EDB reports grants to institution for clinical trials from Novartis, Boehringer Ingelheim, Merck, Takeda, GlaxoSmithKline, Hoffmann La Roche, Actelion, Chiesi, Sanofi-Aventis, Cephalon, TEVA and AstraZeneca and personal fees from ICON, Novartis, Cipla, Vectura, Cipla, Menarini, ALK, ICON, Sanofi Regeneron, Boehringer Ingelheim and AstraZeneca, outside the submitted work, and is a Member of Global Initiative for Asthma Board and Science Committee. RS reports grants for clinical trials, personal, institution fees and non-financial support from AstraZeneca, and personal fees and non-financial support from Novartis, Boehringer Ingelheim, CHIESI and EUROFARMA. Since August 2015, the KTU and BMJ have been engaged in a non-profit strategic partnership to provide continuous evidence updates for PACK, expand PACK-related supported services to countries and organisations as requested, and where appropriate license PACK content. The KTU and BMJ co-fund core positions, including a PACK Global Development Director, and receive no profits from the partnership. PACK receives no funding from the pharmaceutical industry. This paper forms part of a Collection on PACK sponsored by the BMJ to profile the contribution of PACK across several countries towards the realisation of comprehensive primary health care as envisaged in the Declarations of Alma Ata and Astana.
Patient consent for publication Not required.
Ethics approval The study was approved by the research ethics committee of the Federal University of Santa Catarina.
Provenance and peer review Not commissioned; externally peer reviewed.
Data availability statement No data are available.