Article Text
PDF
Abstract
Background Poor patient experience, including long waiting time, is a potential reason for low healthcare utilisation. In this study, we evaluate the impact of appointment scheduling on waiting time and utilisation of antenatal care.
Methods We implemented a pilot study in Mozambique introducing appointment scheduling to three maternity clinics, with a fourth facility used as a comparison. The intervention provided women with a return date and time for their next antenatal care visit. Waiting times and antenatal care utilisation data were collected in all study facilities. We assessed the effect of changing from first come, first served to scheduled antenatal care visits on waiting time and complete antenatal care (≥4 visits during pregnancy). Our primary analysis compared treatment facilities over time; in addition, we compared the treatment and comparison facilities using difference in differences.
Results We collected waiting time data for antenatal care from 6918 women, and antenatal care attendance over the course of pregnancy from 8385 women. Scheduling appointments reduced waiting time for antenatal care in treatment facilities by 100 min (95% CI −107.2 to -92.9) compared with baseline. Using administrative records, we found that exposure to the scheduling intervention during pregnancy was associated with an approximately 16 percentage point increase in receipt of four or more antenatal care visits during pregnancy.
Conclusions Relatively simple improvements in the organisation of care that reduce waiting time may increase utilisation of healthcare during pregnancy. A larger scale study is needed to provide information about whether appointment scheduling can be sustained over time.
Trial registration number NCT02938936.
- quality of care
- antenatal care
- maternal health
- health systems
- health policy
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Key questions
What is already known?
Long waiting time for care is a commonly reported problem in public health facilities in sub-Saharan Africa, and may reduce utilisation of healthcare.
This study is the first to evaluate the effect of an appointment scheduling intervention on both waiting time and completion of recommended care.
What are the new findings?
Appointment scheduling decreased waiting time for antenatal care by over 1 hour (100 min), and increased the per cent of women who completed four or more antenatal care visits during pregnancy.
What do the new findings imply?
Relatively simple improvements in the organisation of care that reduce waiting time may increase utilisation of healthcare during pregnancy.
Background
Antenatal care (ANC) represents a critical introduction to the continuum of maternal and newborn healthcare.1 High-quality ANC informs women about potential danger signs during pregnancy and provides treatment and prevention for illnesses that adversely affect infant health. With adequate ANC coverage, an estimated 283 000 lives could be saved annually.2 WHO guidelines published in 2002 recommended that women receive at least four ANC visits during pregnancy. In Mozambique, only 55% of pregnant women receive complete ANC (four visits over the course of their pregnancy), and only 13% of women start ANC in the first trimester of pregnancy.3 4 In 2016, new WHO guidelines recommending that women attend at least eight ANC visits during pregnancy replaced the earlier recommendation.5 In 2015 in Mozambique, only 3% of women obtained eight or more visits. Meeting these new coverage targets will require a better understanding of barriers to utilisation and the effectiveness of interventions to address these barriers.
It is increasingly recognised that high-quality healthcare, in addition to improved coverage of maternal and child health services, is necessary to achieve the Sustainable Development Goal’s target reductions in maternal and child mortality.6 The ongoing ‘quality revolution’7 in global health emphasises the need for successful health systems to deliver on various dimensions of quality, including providing patient-centred care, or care that is responsive to the preferences of users.8
Abundant evidence has shown that public clinics in sub-Saharan Africa are not organised around the preferences of patients9–15 in particular with respect to the amount of time spent waiting at facilities.16 In Mozambique, attending ANC typically involves arriving early in the morning only to spend most of the day waiting for care. Previous studies have shown that waiting time for ANC is perceived as a significant barrier to seeking care and is associated with decreased satisfaction with ANC.17–19 Long queues and the resulting crowded facilities may also decrease technical quality if health workers rush through key procedures.
Recent evidence demonstrates that comprehensively improving technical and non-technical quality can influence choice of delivery location.20 Furthermore, non-technical quality care (including patient responsiveness) has been shown to influence utilisation decisions.21 However, more evidence is needed to understand whether improving patient experience alone can drive changes in utilisation of care. We partnered with the Ministry of Health in Mozambique to conduct a pilot study of a scheduling intervention in three high-volume public health clinics in Mozambique with a fourth high-volume facility serving as a comparison. We examine the relationship between the introduction of the scheduling system and changes in waiting time and utilisation of ANC. We also examine the effect of the scheduling system on the quality of ANC, the study’s secondary outcome. While one previous study demonstrated that scheduling systems can reduce waiting times even in contexts of limited state capacity,22 our study is the first to analyse the relationship between introduction of a scheduling system and healthcare utilisation.
Local context: ANC scheduling
The large majority (almost 99%) of women in Mozambique receive ANC in public health facilities.4 Before the study intervention, women were assigned their next antenatal appointment 30 days from the date of their visit in public clinics, without any specified time. Pregnant women typically arrived early in the morning to wait for ANC and consultation order was determined by type of visit (first vs follow-up) and the order of patient arrival (first come, first served). Facility organisation varied; in some facilities, women coming for their initial ANC visit were seen first, while in others priority was given to follow-up visits.
Scheduling intervention design
The evaluation study took place between September 2016 and July 2017. All of the study health facilities were high-volume (ie, 21–40 ANC patients per day) public health facilities. In treatment clinics, patients receiving ANC were asked to select a return time on the date of their next appointment. Patients were informed that if they returned at their scheduled date and time they would be seen within 1 hour by clinic staff. Nurses recorded the appointment date and time on a scheduling card provided to patients and in an appointment book provided to facilities.
Theory of change
The intervention could decrease waiting time by more evenly distributing patient arrival throughout the day (figure 1). The intervention could increase utilisation if decreased waiting time makes it easier for patients to attend their appointment, if having a specific time makes the patient feel more responsible for returning on their scheduled date, or if the appointment serves as a signal that the health system is responsive to patients. Managing long patient queues may increase health worker stress. Therefore, the intervention could improve technical and non-technical quality by reducing health worker stress and improving the technical content and interpersonal quality of their communication with patients. Scheduled appointments might also increase visit duration, which could give nurses more time to complete recommended tests and counselling. Alternatively, appointment scheduling could decrease quality if nurses dislike the new system, or if needing to see patients at specific times increased health worker stress.
Intervention logic framework. ANC, antenatal care.
Study population
Scheduling interventions were implemented in three clinics. Two intervention clinics were located in urban Maputo (Boane and Malhangalene). A third intervention clinic, Quissico, located in rural Inhambane Province, was included to test scheduling in a rural environment where employment and transportation might differ. A fourth clinic, Machava II, located in urban Maputo, was used as a comparison. We selected clinics with high ANC volume and accessibility to a main road.
Methods
Study outcomes
The primary study outcomes were (1) waiting time for ANC as measured by patient-reported survey data collected by our study team, and (2) receipt of complete ANC defined as four or more ANC visits during pregnancy. The number of visits was obtained from administrative data contained in facility registers. The secondary outcomes were (1) an index of technical quality and (2) an index of non-technical quality of care measured using variables collected in survey data. Technical quality was measured using an index measuring self-reported receipt of the technical components of ANC recommended by the WHO for all ANC visits (abdominal examination, measurement of uterine height, provision of folic acid, provision of malaria prophylaxis and discussion of signs of pregnancy complications). Non-technical quality was defined by an index of patient satisfaction with interpersonal quality including an indicator for any experience of disrespect or abuse, as well as Likert scales for the communication skills, friendliness and respectfulness of health workers. Online supplementary table 1 describes the definition and data source for each outcome.
Supplemental material
Data sources
Waiting time data collection
Starting at 07:30, enumerators recorded the time that all ANC patients arrived, the time their consultation began and the time their consultation ended. Waiting time data were collected using an electronic application at baseline, and all subsequent rounds of waiting time data collection used paper forms. As many women arrive before 07:30, and the enumerator can only record information from one woman at a time, study enumerators also recorded the patient’s self-reported arrival time. Four consecutive weeks of baseline waiting time data was collected in all four study facilities with staggered start dates. Following the introduction of the scheduling intervention, waiting time was measured bimonthly for a period of 2 weeks in all intervention and control facilities. Finally, 4 weeks of data were collected at endline (round 5) (see figure 2 for a general timeline, the online supplementary appendix for detailed waiting time data collection procedures and the online supplementary table 2 for a detailed timeline).
Study timeline.
As the same nurses providing ANC also provide family planning and postpartum care, it is possible that ANC scheduling affected the amount of time health workers spent seeing other types of patients. To examine whether appointment scheduling for ANC had the unintended consequence of diverting resources away from other services, we tested whether scheduling appointments for ANC resulted in nurses spending less time with patients seeking family planning. To do this, enumerators collected waiting time from five randomly selected women who received family planning services during both baseline and endline data collection in the control facility and in Boane, one of the treatment facilities. Finally, enumerators also recorded the number of staff providing ANC on each day of waiting time data collection.
ANC and delivery exit interviews
We conducted baseline and endline exit surveys in Boane (T) and Machava II (C). We conducted ANC client exit interviews to obtain detailed demographic data and information on the quality of ANC from a sample of women attending the study clinics for ANC. We collected delivery exit interviews to obtain information on the location of all ANC visits during pregnancy from women who delivered at the health facility. Nearly all women obtained ANC at the same health facility during pregnancy, which gave us confidence that the administrative data we extract from clinic records provide a complete picture of ANC utilisation. ANC exit interviews recorded patient demographics and the self-reported content of, and satisfaction with, the ANC visit that occurred on the day of data collection. Delivery exit interviews recorded the self-reported content of, and satisfaction with, the most recent ANC visit before delivery. For ANC exit interviews, study enumerators recruited women attending ANC who were ≥18 years old and whose gestational age was between 16 and 22 weeks. For the delivery exit interviews, all women ≥18 years of age who delivered during the weeks of enrolment were invited to participate.
Administrative data collection
We recorded the dates of all ANC visits from all women whose first ANC visit took place between April 2016 and April 2017 from facility registers. We started the date range in April 2016 as a new ANC register, which tracks women over the course of pregnancy, began to be used by public health facilities in April 2016. We transcribed data from registers during the month of November 2017 for this study. As we wanted to be able to observe all visits during the course of pregnancy for all women included in the study, we restricted data collection to include any woman with a first visit between April 2016 and April 2017 (eg, a woman who began ANC in April 2017 when she was 2 months pregnant with an estimated delivery date in November 2017 would have all her visits recorded in the facility register).
We used these data to construct a variable measuring exposure to the scheduling system in the following way. We assume that women will have 40 weeks of pregnancy in which they may experience scheduled visits. Women whose entire pregnancy took place before the start of the intervention would be assigned 0 exposure weeks. Women whose pregnancy overlapped with the intervention would be assigned the number of pregnancy weeks remaining after the start of the intervention. Any woman whose entire pregnancy took place after the start of the intervention would be assigned 40 weeks of exposure.
Pre-post analysis within treatment facilities
Our main analyses are conducted with data only from treated facilities. In order to visualise changes in waiting time over the study period, we graphically present average waiting time in each of the five rounds of waiting time data collection in all of the study facilities. In this graph, the x axis measures study round by facility, and the y axis measures average waiting time pooling individual-level data from each facility’s data collection round. Facility-specific results are presented in online supplementary figure 1. We also graph the distribution of arrival times at baseline and in the four rounds of follow-up data collection after the start of the intervention. We then regressed waiting time on a post indicator variable identifying observations after the start of appointment scheduling and 4 day of the week dummy variables (regression equation 1 in the online supplementary appendix). We use self-reported arrival time since some patients arrived at the facility before the enumerator in the morning. We present several robustness checks including estimating waiting time with observed instead of self-reported waiting time, adjusting the waiting time outcome for censoring and accounting for clustering in SEs23 in online supplementary tables 3–5.
To check patients’ adherence to the new scheduling system, we calculated the difference between patient arrival time and the time of the scheduled appointment. To check providers’ compliance with the scheduling system, we calculated the difference between the patient’s appointment time and the time they were seen by a nurse.
To examine utilisation, we tested whether exposure to scheduling, defined as the number of weeks of pregnancy remaining after the start of the scheduling intervention, increased the likelihood that women obtained complete ANC (regression equation 2 in the online supplementary appendix). We used a generalised linear model for a binomial outcome with an identity link function. The model included facility fixed effects, and robust SEs. The results of this analysis using wild bootstrap SEs are presented in online supplementary table 3. To examine changes in the utilisation outcome over time, we also plot the percentage of women with complete ANC by month of the first ANC visit.
Difference-in-differences analysis in intervention and comparison facilities
To understand whether our findings were driven by changes unrelated to scheduling during the study period, we conducted a difference-in-differences analysis to compare the change in the study outcomes in the three intervention clinics with the change in the comparison clinic. We use difference-in-differences regression analysis to assess the effect of scheduling on waiting time for ANC, ANC utilisation, waiting time for family planning, and technical and non-technical quality of ANC. We present findings for these analyses excluding Quissico, the only rural health facility, in the online supplementary table 6. For the two quality outcomes, and the analysis of waiting time for family planning, we include only Boane (treatment) and Machava II (comparison) in the difference-in-differences analysis as data collection for these outcomes only took place in these two facilities. Waiting time and quality regressions used ordinary least squares and the utilisation regression used a generalised linear model for a binomial outcome with an identity link function. All analyses included a postvariable identifying observations after scheduling and an indicator of exposure to scheduling. An interaction term between these two variables was used to assess the effect of scheduling on the study outcomes (regression equations 3 and 4 in the online supplementary appendix). We also present findings from the same regression for the individual components of the quality scores in online supplementary table 7.
Human subjects approval and study registration
This study received human subjects approval from the authors’ institutes. The study has been registered at ClinicalTrials.gov.
Patient and public involvement statement
The study was informed by previous research showing that waiting time is perceived by patients as an important barrier to healthcare receipt in low-income countries. Patients were included in ANC and delivery care exit surveys but were not directly involved in the design of this study. Information on appointment scheduling and the results of this study may be distributed to patients by the Ministry of Health through media announcements.
Results
Table 1 displays baseline levels of facility and patient characteristics.
Health facility and patient characteristics at baseline
Scheduling system implementation
Appointment scheduling shifted the distribution of arrival times for ANC towards later arrival (figure 3). Before scheduling, 62% of women seeking ANC in treatment facilities arrived before 08:00, when the facility opened. During follow-up rounds, this percentage declined to 22% (figure 3). Forty-eight per cent of patients arrived before their hour-long appointment window (online supplementary figure 2). However, 58% of patients overall, and 51% who arrived on time, were seen by nurses after the end of their window (online supplementary figure 3).
Distribution of patient arrival times for antenatal care before and after scheduling. Source: Waiting time data collection rounds 1–5. White bars capture rounds 2–5.
The average of mean daily waiting time across the three facilities at baseline was 182 min. Average waiting time after scheduling ranged from 85 to 107 min, a decrease between 41% and 53% from baseline (figure 4).
Waiting time for antenatal care visits. Source: Waiting time data collected from 19 September to 18 November 2016 (round 1), 12 December 2016 to 20 January 2017 (round 2), 6 February to 10 March 2017 (round 3), 27 March to 28 April 2017, (round 4) and 22 May to 14 July 2017 (round 5).
Impact on utilisation
Pre-post analysis within treatment facilities
Our regression analysis, which controls for day of the week effects, shows that waiting time declined by 100.0 min after scheduling (95% CI −107.2 to −92.9, p<0.0001) (table 2, panel A). The decline in waiting time was largest in Boane (−144.8, 95% CI −156.9 to −132.8), where baseline waiting time was longest. The decrease in waiting time was more modest in Quissico (−47.1, 95% CI −56.0 to −38.3), the rural treatment facility with the shortest baseline waiting time. These results remain consistent when using observed waiting time and censored waiting time in place of self-reported arrival time (online supplementary tables 4 and 5).
Pre-post analysis examining change in waiting time and ANC utilisation among treatment facilities
We find that exposure to scheduling increased receipt of complete ANC by 0.004 percentage points each week in the pooled treatment facilities (95% CI 0.004 to 0.005, p<0.001) (table 2, panel B). This coefficient is equivalent to a 16 percentage point or 32% increase among women who were exposed to scheduling during all 40 weeks of pregnancy. The trend in complete ANC increased dramatically in treatment facilities after the start of scheduling but began to decline in January 2017 (online supplementary figure 4). Qualitatively similar results for waiting time and ANC utilisation from the same regressions using wild bootstrap SEs are presented in the online supplementary table 3.
Difference-in-differences analysis in intervention and comparison facility pair
We find that appointment scheduling decreased waiting time and increased ANC utilisation in our difference-in-differences analysis, confirming the results we found in the pre-post analysis (table 3, panel A). The results of these analyses are very similar after excluding Quissico, the intervention facility located in a rural area (online supplementary table 6). Furthermore, ANC scheduling did not affect waiting time for other services offered in the same health unit such as family planning (−0.94, 95% CI −37.64 to 35.76, p=0.515) (table 3, panel B).
Difference-in-difference analysis examining change in waiting time, ANC utilisation and service quality in all study facilities
Scheduling did not change the technical quality of ANC visits (−0.01, 95% CI −0.08 to 0.06, p=0.689) or non-technical quality of care (0.07, 95% CI −0.03 to 0.16, p=0.178) (table 3, panel B). Regression results for the individual components of the technical and non-technical indices are shown in online supplementary table 7.
Discussion
This study presents evidence that scheduling appointments reduced waiting time for ANC. The decline in waiting time was largest where baseline waiting time was longest (table 2). Despite concerns that even after scheduling, patients might continue to arrive early in the morning to guarantee a place in line, we found that most patients arrive before or during their scheduled time. We found that waiting time decreased more after the intervention in higher volume facilities, and that baseline waiting time was lower in the single rural health facility. While a larger sample would be needed to better understand heterogeneity in treatment effects, it may be that the intervention would be more effective in facilities closer to urban areas that are likely to have high patient volumes.
We estimate that scheduling increased receipt of complete ANC during pregnancy by 16 percentage points, a 32% increase. Though one previous study demonstrated that scheduling can reduce waiting time,22 our study provides the first evidence that appointment scheduling can increase service utilisation, suggesting that poor patient experience may be unpleasant and may contribute to poor health outcomes by decreasing utilisation.
We do not find evidence that reducing waiting times changes the technical and non-technical contents of an ANC visit. While it is reassuring that we do not find that exposure to a scheduling system reduced the likelihood of receiving key elements of care, our findings suggest that a more significant investment is needed to improve the content of ANC, and without this investment, changes in utilisation may not yield better health.
We find that the effect of the intervention on ANC utilisation decreases over time (online supplementary figure 4). This may be due to poor compliance among nurses who often saw patients over an hour after their scheduled visit hour. More evidence is needed to understand whether the potential benefits of the intervention attenuate over time and whether attenuation could be mitigated by better management and supervision of nurses to more closely adhere to scheduled times. Future research should use a larger trial to investigate whether appointment scheduling can be effectively supervised and sustained at a larger scale.
This study has several limitations. Though we observe no change in patient volume over the study period (online supplementary figure 5), it is possible that other changes occurred at the same time as our intervention, confounding our results. To address this concern, we conducted a difference-in-differences analysis. While this analysis is consistent with findings from our main specification, the comparison clinic had important baseline differences, including higher volume and a lower staff-to-patient ratio than the intervention clinics. Differences in baseline waiting time and patient volume between the facilities remain a limitation and we are unable to evaluate the assumption of parallel trends in the study outcomes because of a limited period of data collection prior to the intervention. Therefore, despite the inclusion of a comparison facility to control for changes affecting the study outcomes that were not due to the intervention, it is possible that the observed increase in ANC utilisation resulted from other changes in the treatment clinics after the start of the intervention.
Another limitation is that administrative records used to assess utilisation only document care that was obtained in that facility. While it is possible that women could have visited other facilities during their pregnancy, 96% of women responding to our exit survey report receiving all ANC at the same facility. Finally, our sample size for the quality outcomes is relatively small, and the quality outcomes are based on patient reports which may be upwardly biased if patients were worried that their responses will not remain confidential.24
Interventions that reorganise the process of care may have important unintended consequences, such as decreased resources to non-targeted services or adverse changes to intrafacility relationships or health worker motivation. We find no negative relationship between ANC scheduling and waiting time for family planning, another health service offered in the maternal and child health unit. We also find that scheduling did not adversely affect the technical quality of care provided by health workers. However, there are other potential negative side effects of scheduling that we cannot address. For example, in some health facilities, group counselling occurs before the start of ANC consultations. In future research, it will be valuable to consider the impact of scheduling on patient knowledge of key health information during pregnancy.
The quality of healthcare has recently taken central stage in the international health systems agenda with the 2018 publication of the Lancet Global Health Commission’s Report on High-Quality Health Systems,25 which aims to ensure that the quality of healthcare increases alongside global coverage targets set by the Sustainable Development Goals. Future interventions targeting healthcare quality should consider incorporating improvements in the management of patient flows as they may offer a low-cost, high-impact avenue for improving patient experience.
Conclusion
We demonstrate that relatively simple improvements in the organisation of care that reduce waiting time can increase utilisation of healthcare during pregnancy. Our evidence suggests that patient experience is an important consideration for its own sake, and it may play an important role in shaping utilisation patterns.
Acknowledgments
The authors thank all the participants for their participation in the study. The authors also thank Carla Alberto for her excellent research assistance and all of the study enumerators who worked to collect the data reported in this study.
Footnotes
Handling editor Seye Abimbola
Contributors MM and SS co-led the study design and supervised data analysis. MS, JD, AA, SC, ESG, SS and MM contributed to the study design. MS conducted data analysis and drafted the manuscript. All authors contributed to the interpretation of data, reviewed and approved the final version of the manuscript.
Funding This study was funded by the Abdul Latif Jameel Poverty Action Lab’s (J-PAL) Urban Services Initiative and the International Growth Center. MS was supported by the NIH training grant (T32 HD007338) and other NIH support (P2C HD041020).
Disclaimer The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests None declared.
Patient consent for publication Not required.
Ethics approval This study received human subjects approval from Harvard TH Chan’s Institutional Review Board (IRB16-0344), the London School of Economics Ethics Committee and from the Mozambican Ministry of Health’s Comité Institucional de Bioética do Instituto Nacional de Saúde. Study participants who completed interviews provided written consent. A waiver of consent was approved for the administrative data collected in this study as these data contained no individual identifying information and was considered minimal risk. This study was registered at ClinicalTrials.gov.
Provenance and peer review Not commissioned; externally peer reviewed.
Data availability statement Data are available upon reasonable request.