Figures
Abstract
Background
Mutuelles is a community-based health insurance program, established since 1999 by the Government of Rwanda as a key component of the national health strategy on providing universal health care. The objective of the study was to evaluate the impact of Mutuelles on achieving universal coverage of medical services and financial risk protection in its first eight years of implementation.
Methods and Findings
We conducted a quantitative impact evaluation of Mutuelles between 2000 and 2008 using nationally-representative surveys. At the national and provincial levels, we traced the evolution of Mutuelles coverage and its impact on child and maternal care coverage from 2000 to 2008, as well as household catastrophic health payments from 2000 to 2006. At the individual level, we investigated the impact of Mutuelles' coverage on enrollees' medical care utilization using logistic regression. We focused on three target populations: the general population, under-five children, and women with delivery. At the household level, we used logistic regression to study the relationship between Mutuelles coverage and the probability of incurring catastrophic health spending. The main limitation was that due to insufficient data, we are not able to study the impact of Mutuelles on health outcomes, such as child and maternal mortalities, directly.
The findings show that Mutuelles improved medical care utilization and protected households from catastrophic health spending. Among Mutuelles enrollees, those in the poorest expenditure quintile had a significantly lower rate of utilization and higher rate of catastrophic health spending. The findings are robust to various estimation methods and datasets.
Conclusions
Rwanda's experience suggests that community-based health insurance schemes can be effective tools for achieving universal health coverage even in the poorest settings. We suggest a future study on how eliminating Mutuelles copayments for the poorest will improve their healthcare utilization, lower their catastrophic health spending, and affect the finances of health care providers.
Citation: Lu C, Chin B, Lewandowski JL, Basinga P, Hirschhorn LR, Hill K, et al. (2012) Towards Universal Health Coverage: An Evaluation of Rwanda Mutuelles in Its First Eight Years. PLoS ONE 7(6): e39282. https://doi.org/10.1371/journal.pone.0039282
Editor: Maarten Postma, Groningen Research Institute of Pharmacy, United States of America
Received: February 27, 2012; Accepted: May 17, 2012; Published: June 18, 2012
Copyright: © 2012 Lu et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research was supported partially by funding from the Doris Duke Charitable Foundation (DDCF), grant number 2009057. More information about DDCF can be found at the following website: http://www.ddcf.org/. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. No additional external funding was received for this study.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Mutuelles de santé (Mutuelles) is a community-based health insurance program established by the Government of Rwanda (GoR) as a key component of the national health strategy on providing universal health care and reaching the health Millennium Development Goals (MDGs). Recent years have witnessed a global re-emergence of support for achieving universal health care [1]. Two major goals of universal coverage have been clearly outlined: to ensure access to care for those in need, and to provide financial risk protection by lowering catastrophic out-of-pocket health spending. Existing studies have shown that catastrophic health spending pushes households into poverty in both developed and developing countries [2]–[6]. Insuring underserved populations has been considered a useful means of improving access to care with financial risk protection. The existing evidence shows that in countries such as Mexico, China, Vietnam, Ghana, and Mali, government-sponsored or community-based insurance programs for uninsured populations improved access to curative care [7]–[13]. However, the results of studies on financial risk protection vary widely - the programs had little or no impact in Vietnam and China, [9]–[11] while Mexico's program had a significant effect in reducing household catastrophic health spending [7], [8]. In Mali and Ghana, the programs resulted in protection against potentially catastrophic expenditures related to hospitalization, but did not appear to have a significant effect on out-of-pocket expenditures for curative outpatient care [13].
This paper presents a case study on Rwanda, a small country in central east Africa with a population of 10 million in 2009 [14]. After the genocide in 1994, Rwanda has been making impressive progress in its social and economic development. The GDP per capita increased from 240 USD (constant 2009 USD) in 2001 to 510 USD in 2009 [14]. Nevertheless, Rwanda remains one of the poorest countries in the world, with about 57% of its population living below the national poverty line (0.45 USD per adult per day) and 37 percent living in extreme poverty (0.32 USD per adult per day) [15].
Before 1999, the majority of the population in Rwanda had no health insurance. The uninsured population had to pay for health services out-of-pocket. Facing limited resources, the GoR has been implementing Mutuelles since 1999 to provide affordable basic services, especially child and maternal care, to the uninsured population. A pilot program was implemented in three selected districts in 1999 and 2000. The success of the pilots motivated the local governments and communities to quickly adopt and expand the program nationwide. To standardize the main parameters of Mutuelles, such as the benefits package, enrollment fees, subsidization mechanisms, organizational structure, management systems, etc., the Mutuelles Health Insurance Policy was approved by the GoR at the end of 2004. Until it was fully implemented in 2006, there was variation and flexibility in scheme design across districts. In 2008, a law on the creation, organization, and management of Mutuelles was enacted, which further strengthened the strategy [16].
Approximately 50 percent of Mutuelles' funding is comprised of annual member premiums. The remaining half is obtained via transfers from other insurance funds, charitable organizations, NGOs, development partners, and the GoR. Providers are paid by Mutuelles directly, either through monthly capitation rates on a fee-for-service basis, or via (recently introduced) performance-based payments [17].
Mutuelles uses a policy of household subscription. Before 2007, the annual premium for a household with up to seven members varied across regions, ranging typically from 2,500 to 11,500 RWF (4.72 to 20.83 current USD). Since 2007, the annual premium has been 1,000 RWF (1.81 current USD) per member [16]. With the support from donors such as the Global Fund to Fight AIDS, Tuberculosis and Malaria, the enrollment fees for the poorest 16th percent of the population is exempt [18].
Enrolled households are affiliated to designated health centers. With referrals from the health center, members may obtain hospital services covered by Mutuelles. To mitigate adverse selection, enrollees must wait one month to utilize covered services. Before 2006, Mutuelles covered all services and drugs in the health center and limited services (such as C-sections and related hospitalization) in the hospital. After 2006, Mutuelles enrollees were entitled by law to a minimum service package (PMA) at the health center and a complementary service package (PCA) at the district hospital described in Table 1. In practice, the MoH estimates that only 30 percent of health centers provide the comprehensive list of activities [17].
Before 2006, copayments per visit to health center typically varied from 100 to 150 RWF (0.30 to 0.45 current USD) and cost up to 50% of the hospital fee. After 2006, copayments for a health center visit have been 200 RWF (0.36 current USD) and 10% of the hospital fee for hospital services [16].
To date, Rwanda is the only country in sub-Saharan Africa where more than 90% of the population is covered by community-based health programs [19]. To enhance cross-country learning and gather evidence for future policy-making in Rwanda, we conducted an empirical evaluation of Mutuelles' impact on universal health coverage. Existing empirical evaluation of Mutuelles' impact on universal health coverage is limited and subject to various issues. Most of them focused only on the relationship between Mutuelles enrollment and medical care utilization, and were based primarily on the data collected in the three pilot districts in 2000 [20], [21]. One study used the Rwanda Demographic and Health Survey (RDHS) in 2005 to examine the effect of Mutuelles on medical care utilization; however, it did not address adverse selection, an issue which could lead to inconsistent estimates of Mutuelles' impact [22]. Among all existing studies, only one examined the impact of Mutuelles on universal financial risk protection using the Integrated Living Conditions Survey (EICV) [23]. The study was limited to the year 2005/2006 and did not trace the change in catastrophic health spending after the establishment of Mutuelles. When calculating household out-of-pocket health spending, the study did not include household payments on vaccination or transportation to health facilities. The EICV 2005/2006 collected household spending on medical services with a 12-month recall period and a 2-week recall period. The study used a 2-week measure for spending on outpatient services and 12-month measure for spending on inpatient services. No explanation was given as to why the measures were chosen. A previous publication on 43 developing countries showed that estimates of spending on inpatient services are very sensitive to the choice of recall period [24]. In addition, the study did not make the effort to deal with endogenous household expenditure, an important confounder included in the study. Issues aforementioned raise concerns of the consistency and accuracy of the estimates generated from these studies.
Using two nationally and geographically representative population surveys: (1) the Integrated Living Conditions Survey in 2000 and 2005/2006; and (2) the Rwanda Demographic Health Survey in 2000, 2005, and 2007/2008, our paper provides the first systematic quantitative analysis of Mutuelles' impact on universal health coverage in its first eight years of implementation. Methodological issues that hampered previous Mutuelles studies, such as selection bias in utilization analyses, estimating household out-of-pocket health spending, and endogenous household expenditure in financial risk protection, have been addressed with various statistical methods.
Methods
Our study takes a comprehensive approach and is executed at multiple levels over an 8-year period. We traced the temporal trends of child care, maternal care, average annual household out-of-pocket health spending, percentage of households with catastrophic health spending, and Mutuelles enrollment at the national level; we ascertained the relationship between child/maternal care coverage and Mutuelles coverage at the provincial level; and we examined the impact of Mutuelles enrollment on financial risk protection at the household level and on medical care utilization at the individual level. For the individual utilization analysis, we focused on three populations: the general population; under-five children with diarrhea, fever, or acute respiratory infection (ARI); and women who gave birth in the survey years.
Data Sources
The Integrated Living Conditions Survey and the Rwanda Demographic Health Survey are the only two household surveys conducted at the national level in Rwanda. They have been used frequently for providing national and regional evidence to policy makers in the country. Both surveys are cross-sectional. Households included in the two surveys are selected from the same sample cells. The EICV collects data every five years on household expenditures, consumption, demographic and socioeconomic characteristics, information on health insurance status, self-reported illness, medical care utilization, self-reported out-of-pocket health spending on medical services, etc. The survey is conducted over a 12-month period to address seasonality issues. The available data includes the EICV from 2000 and 2005/2006. Seventy-five percent of the households were interviewed in 2006, and we will refer to the survey as EICV 2006.
The RDHS collects information from women on child health and care, maternal health and care, socio-demographic indicators, health insurance, and a number of other health indicators. Since more than 90 percent of the interviews were conducted in 2008 for the RDHS 2007/2008 survey, we will refer to it as RDHS 2008. To increase the sample size for the child and maternal care analyses, we pooled RDHS data from 2005 and 2008 and used them in the regression analyses. Tables 2 and 3 present the total sample size of the surveys and the number of individuals and households included in our analyses.
The sampling method and questionnaires of RDHS are standardized over time, enabling the construction of time-series data at the provincial level for analyzing the relationship between Mutuelles coverage and child/maternal care coverage. Before 2006, there were 12 provinces in Rwanda. In 2006, the 12 provinces were reorganized into five regions. The RDHS 2008 includes a variable indicating the previous provinces, which allowed us to generate information for the 12 provinces in 2008. We excluded Kigali city and its surrounding rural areas since the population in those areas have a different socioeconomic profile from populations in other provinces. Ten provinces were included in the provincial-level study. Each panel had a total of 30 observations over 2000, 2005, and 2008.
Study Samples and Variables
To study the impact of Mutuelles on universal health coverage, we included in our analysis only individuals and households that were either without any health insurance or were covered only by Mutuelles. We excluded those with other health insurance plans. We studied the impact of Mutuelles on protecting households from financial risk among Mutuelles-insured households and uninsured households. For medical care utilization, we restricted the regression analyses to those who reported being sick in the two weeks prior to the surveys for the general population, under-five children, and to women with deliveries in the survey years. We did not include the utilization of preventive care, such as vaccination for children. Free vaccination has been provided to all children in Rwanda regardless their health insurance status. Together with a strong community health network and media education, free vaccination has contributed to the high rate of vaccination coverage in Rwanda. For example, in 2005, about 97 percent of children age 12–23 months received BCG vaccine (Baccille Calmette Guérin vaccine) and about 95 percent of children received DTP3 vaccine (diphtheria, tetanus and pertussis vaccine) [25]. The high percentage of immunization coverage demonstrates little variation in preventive care utilization.
(1) Variables for analyzing the impact of Mutuelles on individual medical care utilization among general population (EICV 2006).
To investigate how enrolling in the Mutuelles insurance program influenced an individual's utilization of medical care when they were ill, we constructed an outcome variable indicating an individual using medical services when he or she was ill in the previous two weeks of the survey. Medical services included inpatient care, outpatient consultation, and medical tests and exams. In 2006, about 31.6 percent of individuals who reported an illness in the previous two weeks of the survey used medical care. We excluded those who had other types of insurance (6.4 percent) and kept 6,334 individuals in the study.
A dummy variable “Mutuelles coverage” was created to represent participation in Mutuelles. Socio-demographic variables included age, gender, household size, rural residence, schooling of the household head, and household expenditure quintiles. Dummy variables “no schooling”, “primary school or less” and “higher than primary school” referred to household heads with no schooling, less than or equal to primary schooling, or above primary schooling, respectively. “No schooling” served as the reference group in the analysis. Five dummy variables indicated household expenditure quintiles where quintile five (the highest expenditure) was the reference group. Two dummy variables “time to health center” and “time to hospital” indicated travel time of more than 1 hour to the nearest health center and more than 2 hours to the nearest hospital. “Radio ownership” was created to measure the effect of public health education, which is usually conducted through radio programs in Rwanda.
A dummy variable “severity of the illness” was constructed, indicating whether or not an individual who self-reported illness had to stay in bed due to the severity of the illness. Another dummy variable “disability” indicated whether or not a person suffered from any kinds of disabilities at the time of survey. To control for heterogeneity of health systems-related variables across districts, we constructed district dummy variables and included them in the regression analyses.
(2) Variables for analyzing the impact of Mutuelles on individual medical care utilization among under-five children and women with delivery (pooled RDHS 2005 and 2008).
The outcome variable “childcare” indicates whether a child under-five received medical care when having acute respiratory illness (ARI), fever, or diarrhea. For a woman who delivered a child in the survey year, we constructed an outcome variable indicating whether or not she had skilled-birth attendance during the delivery.
Independent variables included Mutuelles coverage, age and gender of the household head, age and schooling level of the child's mother (0 = no schooling, 1 = otherwise), wealth quintiles, rural residence, and radio ownership. A year indicator was constructed (1 = year 2008, 0 = year 2005) to address unobserved confounders that may vary between the two years.
(3) Variables for analyzing the effect of Mutuelles on financial risk protection (EICV 2006).
Using EICV 2006, an outcome variable was constructed to study the impact of Mutuelles on protecting households from financial risk: a dummy variable indicating a household with catastrophic health spending. We used the definition of catastrophic health spending proposed by the World Health Organization: a household has catastrophic health spending if its annual out-of-pocket health expenditure exceeds 40 percent of annual capacity to pay, where capacity to pay is measured by household expenditure excluding spending on basic subsistence needs. The basic subsistence needs is calculated as the average annual food expenditure of households whose food share is in 45th and 55th percentile [3].
A household's annual out-of-pocket health payment includes its spending on medical care and travel to health facilities. The data for outpatient and inpatient care, medicine, lab tests, and transportation were collected for a recall period of two weeks in the EICV 2000 and 2006, and a recall period of 12 months in the EICV 2006. It has been found that the choice of recall period may significantly affect the measurement of household health spending [24]. To ensure comparability of the estimates between 2000 and 2006, we used 2-week measures for household health spending on outpatient and inpatient care, medicine, lab tests, and transportation to health facilities. We derived annual estimates for these items by timing 26. Spending on vaccinations in the last 12 months was also included in the total household out-of-pocket health spending.
Independent variables included Mutuelles coverage, age, gender, and schooling of the household head, household size, rural residence, expenditure quintiles, and two dummy variables “time to health center” (1 hour) and “time to hospital” (2 hours). We also constructed dummy variables for households with under-five children, the elderly (age over 60), and household members with disability, since these variables may have been related to the needs of medical care.
Household economic status was measured by household total expenditure. The items included in the total expenditure calculation were education spending, housing spending, health spending, food spending (including self-made products and excluding alcohol, cigarettes, restaurants), spending on durable goods, agriculture, and other items.
We used the total expenditure of a household to measure its economic status. This rendered the expenditure variables endogenous since health spending was included in the calculation of household total expenditure. We dealt with this issue by using the housing area per household member as an instrument for household total spending. The housing area will not be a valid instrument if houses are sold to finance health care. Households in Rwanda rarely sell their homes. To check whether housing area was an effective instrument for household total expenditure, we conducted an F-test to determine whether the R-squared value from an unrestricted regression on household total spending (including housing area per capita as the instrumental variable) was significantly higher than that from a restricted regression (excluding housing area) suggested by Staiger and Stock [26]. The F-test value was 115 with a p-value of 0.001, indicating that housing area per capita is not a weak instrument. The correlation between the instrumented expenditure and expenditure variables was 0.70.
(4) Variables used in provincial-level analysis.
For provincial level analyses, we constructed two outcome variables: “maternal care coverage” (skilled-birth attendance) and “child care coverage”, which measure the percent of target populations that obtain medical care when in need. The percentage of the population enrolled in Mutuelles was an independent variable. Other possible confounders were percentage of children's mothers/women with some schooling (versus no schooling), percentage of the studied population in the poorest wealth quintile, and time-invariant provincial fixed effects.
Statistical Analyses
(1) Multiple level analyses.
At the national level, we tracked the trends of Mutuelles coverage, average annual household out-of-pocket health spending, percentage of households with catastrophic health spending, under-five child care and skilled-birth attendance coverage, and child and maternal mortalities between 2000 and 2008. We also presented the likelihood of using medical care and incurring catastrophic health spending for both Mutuelles enrollees and uninsured populations across household expenditure quintiles after controlling for possible confounders.
At the provincial level, we used random-effects models (based on the Hausman test) with Huber-White robust standard errors to examine the relationship between Mutuelles coverage and child/maternal care coverage.
At the household level, we used logistic regression to estimate the impact of Mutuelles on the likelihood of a household incurring catastrophic health spending.
At the individual level, we used logistic regression models to estimate the impact of Mutuelles on medical care utilization among the three target populations when ill.
(2) Addressing selection bias in utilization analyses.
Selection bias is a major concern when analyzing the impact of Mutuelles on medical care utilization: households may self-select into the Mutuelles due to observable or unobservable characteristics that may be correlated with medical care utilization. For example, households with members who are in poorer health are more likely to join the program, and they may use more medical care, holding all other things equal. The existence of selection bias may lead to an over-estimated impact of Mutuelles on individual medical care utilization.
To address the issue, we first examined whether Mutuelles enrollees were more likely to be sick or need care than the uninsured population. Table 4 shows that for the general population, about 17.8 percent of Mutuelles enrollees (95% confidence intervals between 17.1% and 18.5%) reported illness in the two weeks prior to the survey. Among the uninsured population, about 20.9 percent of individuals (95% confidence intervals between 20.3% and 21.5%) reported an illness, which was significantly higher than the Mutuelles enrollees. For under-five children and women, there was no significant difference in reported illness and delivery between uninsured individuals and Mutuelles enrollees. This suggests that Mutuelles enrollees were not more likely to have an illness or need care than the uninsured individuals.
We then examined the existence of selection bias due to observable characteristics by investigating the determinants of joining the Mutuelles program. Table 5 presents the logit regression results on the likelihood of a household participating in Mutuelles using EICV 2006. We found the following significant predictors of participating in Mutuelles: households in rural areas, heads of household with more than primary schooling, household size, radio ownership, and time to the nearest health center. Compared to households in the lowest expenditure quintile, households in the 3rd and higher expenditure quintiles were more likely to join Mutuelles.
To mitigate possible selection bias due to observable household characteristics, we constructed matched datasets with the propensity score matching (PSM) method to ensure that the observed characteristics of the control (uninsured population) and treatment (Mutuelles enrollees) groups were as similar as possible after being matched [27], [28]. The closeness of the two groups was measured by the difference in means of observable variables for the two groups. If the means of these variables were not statistically different from each other, the two groups were close enough to be matched. Following previous studies [9], [29] we used kernel matching that allows for more than one comparison unit to be matched with one treatment unit.
For utilization analysis among the general population with the EICV 2006 data, the matching variables included age, gender of the individual, schooling level of the household head, rural residence, household size, expenditure quintiles, travel time to the nearest health center and hospital, radio ownership, severity of the reported illness, and individuals with disability. The unmatched data included 6,334 individuals who reported illness in the prior two weeks, and the matched dataset included 5,435 individuals reported illnesses.
For utilization analysis among under-five children with ARI, fever, and diarrhea, with pooled data from the RDHS 2005 and 2008, matching variables included age and gender of the household head, mother's age and schooling, rural residence, wealth quintiles, and radio ownership. The unmatched datsaset included 4,633 under-five children who reported an illness. The matched dataset included 4,421 children under-five who had illness.
For utilization analysis among women with child delivery in 2005 and 2008, the matching variables included age and gender of the household head, women's age and schooling level, rural residence, wealth quintiles, and radio ownership. The unmatched dataset included 1,855 women who had delivery in the survey years. The matched dataset included 1,766 women who had delivery in the survey years.
The mean differences in matched variables between the uninsured population and Mutuelles enrollees for the three populations are presented in the Supporting Information section (Tables S1, S2, S3, and S4). They were not statistically significant at the 0.05 level, indicating that selection bias from the observed characteristics was substantially reduced in the matched data.
We examined the existence of selection bias due to unobserved factors using a two-stage residual inclusion (2SRI) method recommended by Terza et al [30]. In the first stage, we ran a logit regression on Mutuelles affiliation and obtained the residuals. In addition to random errors, the residuals may represent unobserved factors affecting household decisions of joining the program. In the second stage, we ran a logit regression on medical care utilization and included the residuals as a predictor. If the coefficient of the residuals is statistically significant, that indicates the existence of unobserved factors that are both correlated with Mutuelles' enrollment and medical care utilization. With the exception of under-five children, the coefficients of the residuals were not statistically significant at the 0.05 level (Table 6), indicating that we may not reject the null hypothesis of exogenous Mutuelles variable when conducting analyses for the general population, and women with delivery. To check the sensitivity of the findings, we produced a set of regression results for medical care utilization among the three populations using the Instrumental Variables (IV) method.
An ideal instrumental variable should be closely correlated to a household's participation in the Mutuelles program, but has no relationship with the decision to use medical care, conditional on other covariates. Local governments played an important role in establishing and promoting Mutuelles, and a household's decision to participate in Mutuelles was affected by public campaigns. We constructed a measure of “cluster insurance rate” for each observed household: the average rate of Mutuelles enrollment by cluster, using all of the household's Mutuelles status information in the cluster other than the insurance for the observed household. In the first stage, we included this variable in the logit regression to analyze the determinants of Mutuelles' affiliation and obtained the predicted probability of participating in Mutuelles for each household. In the second stage (medical care utilization analysis), we replaced the Mutuelles coverage variable with the predicted probability of participating in Mutuelles. In this way, we obtained the impact of Mutuelles on outcome variables with the IV method. We checked whether or not the “cluster insurance rate” was a weak instrument. Take analysis of medical care utilization among the general population using the EICV 2006 as an example. In the first stage, the coefficient of the instrument was positive (2.802) and significant at the 0.001 level. This suggests that the instrument was directly related to a household's enrollment in Mutuelles. A likelihood ratio test was used to evaluate the difference between the nested models. The chi-squared value (377.93) was statistically significant at the 0.001 level, suggesting that the instrument was not weak in predicting a household's likelihood of participating in Mutuelles. We repeated the same procedure for under-five children and women with deliveries. We present regression results for the three target populations generated from the unmatched data, matched data, and matched data with IV method.
To be consistent with the utilization analyses, we also checked the sensitivity of the regression results for catastrophic health spending analysis with matched data and IV methods.
Results
Summary statistics of variables
Tables 7, 8, 9, and 10 provide summary statistics for variables used in individual utilization analyses (for general population, women with delivery, and under-five children) and household financial risk protection analyses. Information is provided for both the unmatched and matched data that excluded outliers after matching.
In the unmatched data of EICV 2006 that includes 6,334 individuals who reported an illness in the previous two weeks, about 36 percent of them were Mutuelles enrollees. 30 percent of the sampled population used medical care. In the matched dataset with 5,435 individuals who reported illnesses, the coverage of Mutuelles is about the same as that of the unmatched data.
About 31 percent of the matched data used medical care (Table 7).
Table 8 shows that, with the pooled data (including unmatched and matched) from the RDHS 2005 and 2008, about 50 percent of the under-five children were Mutuelles enrollees.
About 29 percent of sick children received medical care. Table 9 shows, with pooled data from the RDHS 2005 and 2008, about 56 percent of women who had deliveries were Mutuelles enrollees. About 60 percent of the deliveries had skilled birth attendance.
With household data (both unmatched and matched) from EICV 2006, Table 10 shows 40 percent of households were covered by Mutuelles and about eight percent of total households had catastrophic health spending. Table 11 presents summary statistics for aggregated variables used in the panel data analyses at the provincial level.
Impact of Mutuelles on medical care utilization
At the national level, the percentage of the population covered by Mutuelles rose from about one percent in 2000 to 85 percent in 2008. During the same period, medical care utilization for under-five children with ARI, diarrhea, or fever increased from 13 percent in 2000 to 33 percent in 2008, and the utilization of skilled-birth attendants rose from 39 percent in 2000 to 67 percent in 2008 (Figure 1). Table 12 shows that among under-five children who reported having ARI, diarrhea, or fever, and women who had a delivery, Mutuelles enrollees reported significantly higher rates of medical care utilization than the uninsured in the survey year. The difference between years was statistically significant. Between 2000 and 2008, under-five child mortality, infant mortality, and maternal mortality also declined drastically and are lower than the average estimates in the sub-Saharan countries (Table 13).
The trends are between 2000 and 2008. The data is taken from the Rwanda Demographic and Health Survey in 2000, 2005, and 2008. Error bars represent 95% confidence intervals (CI). * Estimate is based on a study by Schneider and Diop in 2004 [20]. ** Estimate is from Community Based Health Insurance in Rwanda (http://www.cbhirwanda.org.rw/) [16].
Table 14 shows that at the provincial level, Mutuelles coverage had a positive and significant effect on child care and maternal care coverage after adjusting for possible confounders such as the percentage of population in the lowest wealth quintile, mothers' or women's schooling level, and the time-invariant unobserved characteristics of the provinces.
Table 15 presents the logistic regression results generated from the unmatched data, matched data, and matched data with IV method for utilization analysis among the general population that reported illnesses in the two weeks prior to the survey. The findings on Mutuelles are consistent across the three datasets: Mutuelles enrollees were more likely to use medical services than those without any insurance after controlling for other factors. The odds of using medical care increased by 2 for Mutuelles enrollees.
In addition to Mutuelles coverage, significant predictors of medical care utilization included self-reported severity of illness, age, household size, expenditure quintiles, travel time to health center, and radio ownership. For example, those who reported severe illnesses were about three times more likely to use care. Compared to individuals in the highest expenditure quintile, individuals in other quintiles were less likely to use care. Individuals with shorter travel time to the nearest health facilities were more likely to use care.
Figure 2 presents the likelihood of using care for Mutuelles enrollees and the uninsured population across expenditure quintiles after controlling for possible confounders using EICV 2006. In each expenditure quintile, the probability of using care among Mutuelles enrollees was significantly higher than that among uninsured individuals. Among Mutuelles enrollees, those in the lowest expenditure quintile had the lowest probability of using care when ill.
The numbers are generated from a regression analysis of medical care utilization among the general population using the Integrated Living Conditions Survey (EICV) 2006. Error bars represent 95% confidence intervals (CI).
Using pooled data from the RDHS in 2005 and 2008, Table 16 shows that among under-five children that reported diarrhea, fever, or ARI in the two weeks prior to the survey, Mutuelles enrollees were more likely to use medical care. The results of Mutuelles impact are consistent across unmatched data, matched data, and matched data with IV methods. Other significant predictors included “Year 2008” (2005 as reference), wealth quintiles, and radio ownership. For example, holding everything else constant, children in 2008 were more likely to obtain care than children in 2005 when they were ill.
Table 17 shows that among women who delivered children in the survey years, Mutuelles enrollees were more likely to use skilled-birth attendance. The results of Mutuelles impact are consistent across the unmatched data, matched data, and matched data with IV methods. Other significant predictors included wealth quintiles, women's age and schooling level.
Impact of Mutuelles on household financial risk protection
Between 2000 and 2006, the average Rwandan annual household OOPS (in 2000 RWF) fell significantly from 16,883 to 7,967 RWF (in 2000 RWF) (Figure 3), while the percentage of households incurring catastrophic health spending fell significantly from 11.9 percent to 7.7 percent (Figure 4). In 2006, the average annual household OOPS for Mutuelles holders (5,744 RWF) was significantly lower than that of the uninsured households (8,755 RWF) (Figure 3). The percentage of the Mutuelles households with catastrophic spending (5.1 percent) was significantly lower than that (10.5 percent) of uninsured households (Figure 4).
The data is taken from the Integrated Living Conditions Survey (EICV) 2000 and 2006. Error bars represent 95% confidence intervals (CI).
The data is taken from the Integrated Living Conditions Survey (EICV) 2000 and 2006. Error bars represent 95% confidence intervals (CI).
Table 18 shows that after controlling for possible confounders, Mutuelles households were less likely to incur catastrophic health spending. Other significant predictors of catastrophic health spending included the presence of disabled household members and under-five children, instrumented expenditure quintiles, and household size. For example, households in the lowest expenditure quintile were about 8 to 10 times more likely to incur catastrophic health spending. The results are robust to various datasets and estimation methods.
Figure 5 shows that in each expenditure quintile, Mutuelles households had a significantly lower probability of incurring catastrophic health spending than the uninsured households after controlling for observed confounding factors using EICV 2006. Among Mutuelles households, households in the lowest quintile had the highest probability of experiencing catastrophic health spending.
The numbers are generated from a regression analysis of household incurring catastrophic health spending, using the Integrated Living Conditions Survey (EICV) 2006. Error bars represent 95% confidence intervals (CI).
Discussion
This study utilizes the available nationally-representative surveys in Rwanda and traces the evolution of Mutuelles coverage and its relationship with child and maternal care from 2000 to 2008, as well as household catastrophic health payments from 2000 to 2006. Using statistical models, it examines the two most important expected results of Mutuelles at the individual and household level: an increase in using care and a reduction in the incidence of catastrophic health spending. The evidence suggests that at the individual level, Mutuelles improved medical care utilization among the general population, under-five children, and women with child delivery. At the household level, Mutuelles protected households from catastrophic health spending. At the provincial level, we found a positive effect of Mutuelles coverage on child and maternal care coverage. These findings are robust to various estimation methods and datasets. At the national level, we observed an increase in medical care coverage accompanied by a decrease in OOPS and percentage of households with catastrophic health spending. It seems plausible that the increase in medical care coverage contributed to major improvements in child mortality and maternal mortality during the same period. Currently, Rwanda is one of the few African countries that stand a chance of reaching the targets of health MDGs [31].
Even with this impressive progress, there is still room for improvement. The utilization rate for curative care is still low for under-five children with acute illnesses (33 percent in 2008). In addition, like many other developing countries, one of the major challenges faced by the GoR is how to ensure that the poorest benefit equally from Mutuelles. Findings presented in this paper demonstrate that although Mutuelles coverage has substantially increased service utilization and reduced the risk of catastrophic health spending for Mutuelles enrollees, Mutuelles enrollees in the poorest quintile still had significantly lower rates of utilization and higher rates of experiencing catastrophic health spending than Mutuelles enrollees in higher quintiles. The Mutuelles copayments may have prevented indigent enrollees, who live under the extreme poverty line of $0.32 per day, from seeking needed care, or placed a heavy economic burden on them when care was sought. The GoR proposed a new version of the Rwanda Community Based Health Insurance Policy in 2010. One of its major components is to reduce copayments for the poorest enrollees [32]. Our future study is to investigate how eliminating Mutuelles copayments for the poorest will affect the finance of health care providers, improve health care utilization, and reduce catastrophic health spending for the poorest.
The strengths of this study include (1) providing a comprehensive picture of Mutuelles' impact on universal health coverage in its first eight-year implementation by taking advantage of all available nationally-representative data, (2) addressing the aforementioned methodological issues, and (3) examining the robustness of the findings using various datasets and methods. One limitation is that the evaluation of Mutuelles' impact on medical care utilization focuses on curative care only. In addition, due to insufficient data, we were not able to measure the impact of Mutuelles on health outcomes, such as child or maternal mortality.
The Rwanda experience offers valuable lessons to other low-income countries that are in a similarly challenging situation. The fast expansion of the Mutuelles program and high rates of enrollment suggests a strong societal consensus in equal opportunity for everybody to access health care with financial protection. The government played a crucial role through increased financial investment in the health sector, successful legislation of the entitlement of basic care for uninsured population, and an intensive nationwide campaign. The positive results of the Mutuelles program in promoting medical care utilization and financial risk protection suggests that the community-based health insurance scheme can be an effective tool for achieving universal health coverage, together with other policy instruments [33].
Supporting Information
Table S1.
T-tests of mean differences in variables from the matched data for general population who reported illnesses (EICV 2006).
https://doi.org/10.1371/journal.pone.0039282.s001
(DOC)
Table S2.
T-tests of mean differences in variables from the matched data for under-five children who reported illness (pooled RDHS 2005 and 2008).
https://doi.org/10.1371/journal.pone.0039282.s002
(DOCX)
Table S3.
T-tests of mean differences in variables from the matched data for skilled-birth attendance (pooled RDHS 2005 and 2008).
https://doi.org/10.1371/journal.pone.0039282.s003
(DOCX)
Table S4.
T-tests of mean differences in variables from the matched data at the household level (EICV 2006).
https://doi.org/10.1371/journal.pone.0039282.s004
(DOCX)
Acknowledgments
We thank Michael Rich for his suggestions at the beginning of the project; and Huihua Liu for his research assistance.
Author Contributions
Participating discussion at the beginning of the work: BC PB LH. Conceived and designed the experiments: CL KH MM AB. Analyzed the data: CL BC JLL. Contributed reagents/materials/analysis tools: CL BC AB. Wrote the paper: CL BC PB LH KH MM AB.
References
- 1. WHO (2005) Sustainable health financing, universal coverage and social health insurance. World Health Assembly Resolution 58.33. Geneva: World Health Organization.
- 2. Himmelstein DU, Warren E, Thorne D, Woolhandler S (2005) MarketWatch: Illness And Injury As Contributors To Bankruptcy. Health Affairs W5: 63–73.
- 3. Xu K, Evans DB, Kawabata K, Zeramdini R, Klavus J, et al. (2003) Household catastrophic health expenditure: a multicountry analysis. The Lancet 362: 111–117.
- 4. van Doorslaer E, O'Donnell O, Rannan-Eliya RP, Somanathan A, Adhikari SR, et al. (2006) Effect of payments for health care on poverty estimates in 11 countries in Asia: an analysis of household survey data. Lancet 368: 1357–1364.
- 5. Xu K, Evans DB, Carrin G, Aguilar-Rivera AM, Musgrove P, et al. (2007) Protecting Households From Catastrophic Health Spending. Health Affairs 26: 972–983.
- 6. Leive A, Xu K (2008) Coping with out-of-pocket health payments: empirical evidence from 15 African countries. Bulletin of the World Health Organization 86: 849–856.
- 7. Galárraga O, Sosa-Rubí SG, Salinas-Rodríguez A, Sesma-Vázquez S (2009) Health insurance for the poor: impact on catastrophic and out-of-pocket health expenditures in Mexico. The European Journal of Health Economics 11: 437–447.
- 8. Knaul FM, Arreola-Ornelas H, Méndez-Carniado O, Bryson-Cahn C, Barofsky J, et al. (2006) Evidence is good for your health system: policy reform to remedy catastrophic and impoverishing health spending in Mexico. Lancet 368: 1828–1841.
- 9. Lu C, Liu Y, Shen J (2012) Does China's Rural Cooperative Medical System Achieve Its Goals? Evidence from the China Health Surveillance Baseline Survey in 2001. Contemporary Economic Policy 30: 93–112.
- 10. Wagstaff A, Lindelow M, Jun G, Ling X, Juncheng Q (2009) Extending health insurance to the rural population: An impact evaluation of China's new cooperative medical scheme. Journal of Health Economics 28: 1–19.
- 11. van Doorslaer E, O'Donnell O, Rannan-Eliya RP, Somanathan A, Adhikari SR, et al. (2007) Catastrophic payments for health care in Asia. Health Economics 16: 1159–1184.
- 12. Gnawali DP, Pokhrel S, Sié A, Sanon M, De Allegri M, et al. (2009) The effect of community-based health insurance on the utilization of modern health care services: Evidence from Burkina Faso. Health Policy 90: 214–222.
- 13. Chankova S, Sulzbach S, Diop F (2008) Impact of mutual health organizations: evidence from West Africa. Health Policy and Planning 23: 264–276.
- 14.
World Bank (2011) World Development Indicators. Washington, DC: World Bank.
- 15.
World Bank and Ministry of Health (2009) Rwanda: A Country Status Report on Health and Poverty. Kigali, Rwanda: World Bank and Ministry of Health.
- 16.
Community based health insurance in Rwanda website. Available: http://www.cbhirwanda.org.rw.
- 17.
Antunes AF, Saksena P, Elovainio R, Mathauer I, Kirigia J, et al. (2009) Health Financing Systems Review of Rwanda: Options for universal coverage. Geneva: World Health Organization and Republic of Rwanda Ministry of Health.
- 18. Kalk A, Groos N, Karasi JC, Girrbach E (2010) Health systems strengthening through insurance subsidies: the GFATM experience in Rwanda. Tropical Medicine & International Health 15: 94–97.
- 19. Twahira A (2008) Sharing the burden of sickness: mutual health insurance in Rwanda. Bulletin of the World Health Organization 86: 823–824.
- 20.
Schneider P, Diop F (2005) Community-based health insurance in Rwanda. In: Preker AS, Carrin G, editors. Health Financing for Poor People: Resource Mobilization and Risk Sharing. Washington, DC: World Bank.
- 21. Schneider P, Hanson K (2006) Horizontal equity in utilisation of care and fairness of health financing: a comparison of micro-health insurance and user fees in Rwanda. Health Economics 15: 19–31.
- 22. Sekabaraga C, Diop F, Soucat A (2011) Can innovative health financing policies increase access to MDG-related services? Evidence from Rwanda. Health Policy and Planning 26: ii52–ii62.
- 23. Saksena P, Antunes AF, Xu K, Musango L, Carrin G (2011) Mutual health insurance in Rwanda: Evidence on access to care and financial risk protection. Health Policy 99: 203–209.
- 24. Lu C, Chin B, Li G, Murray CJL (2009) Limitations of methods for measuring out-of-pocket and catastrophic private health expenditures. Bulletin of the World Health Organization 87: 238–244.
- 25.
IRIN Africa (2010) RWANDA: Maternal and child health on the right track. Available: http://www.irinnews.org/Report/91259/RWANDA-Maternal-and-child-health-on-the-right-track.
- 26. Staiger D, Stock J (1997) Instrumental Variables Regression with Weak Instruments. Econometrica 65: 557–586.
- 27. Heckman JJ, Ichimura H, Todd PE (1997) Matching as an econometric evaluation estimator: evidence from evaluating a job training programme. The Review of Economic Studies 64: 605–654.
- 28. Imbens GW (2004) Nonparametric estimation of average treatment effects under exogeneity: a review. Review of Economics and Statistics 86: 4–29.
- 29. Wagstaff A, Yu S (2007) Do health sector reforms have their intended impacts? The World Bank's Health VIII project in Gansu province, China. Journal of Health Economics 26: 505–535.
- 30. Terza JV, Basu A, Rathouz PJ (2008) Two-stage residual inclusion estimation: addressing endogeneity in health econometric modeling. Journal of Health Economics 27: 531–543.
- 31.
United Nations (2010) The Millennium Development Goals Report 2010. New York: United Nations.
- 32.
Rwanda Ministry of Health (2010) Rwanda National Health Insurance Policy. Kigali, Rwanda: Rwanda Ministry of Health.
- 33. Basinga P, Gertler PJ, Binagwaho A, Soucat ALB, Sturdy J, et al. (2011) Effect on maternal and child health services in Rwanda of payment to primary health-care providers for performance: an impact evaluation. Lancet 377: 1421–1428.