Introduction Since the Alma-Ata Declaration 40 years ago, primary healthcare (PHC) has made great advances, but there is insufficient research on models of care and outcomes—particularly for low-income and middle-income countries (LMICs). Systematic efforts to identify these gaps and develop evidence-based strategies for improvement in LMICs has been lacking. We report on a global effort to identify and prioritise the knowledge needs of PHC practitioners and researchers in LMICs about PHC organisation.
Methods Three-round modified Delphi using web-based surveys. PHC practitioners and academics and policy-makers from LMICs sampled from global networks. First round (pre-Delphi survey) collated possible research questions to address knowledge gaps about organisation. Responses were independently coded, collapsed and synthesised. Round 2 (Delphi round 1) invited panellists to rate importance of each question. In round 3 (Delphi round 2), panellists ranked questions into final order of importance. Literature review conducted on 36 questions and gap map generated.
Results Diverse range of practitioners and academics in LMICs from all global regions generated 744 questions for PHC organisation. In round 2, 36 synthesised questions on organisation were rated. In round 3, the top 16 questions were ranked to yield four prioritised questions in each area. Literature reviews confirmed gap in evidence on prioritised questions in LMICs.
Conclusion In line with the 2018 Astana Declaration, this mixed-methods study has produced a unique list of essential gaps in our knowledge of how best to organise PHC, priority-ordered by LMIC expert informants capable of shaping their mitigation. Research teams in LMIC have developed implementation plans to answer the top four ranked research questions.
- primary health care
- developing countries
- research gaps
- financing healthcare: low and middle income countries
- models of care
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
- primary health care
- developing countries
- research gaps
- financing healthcare: low and middle income countries
- models of care
What is already known?
Well-organised primary healthcare is essential healthcare that forms an integral part of national health systems.
Limited research is available from low-income and middle-income countries (LMICs) to inform decisions on implementing or improving primary healthcare models.
What are the new findings?
Gaps in published evidence on priority areas for primary healthcare research identified by the expert panel are confirmed through systematic literature reviews.
What do the new findings imply?
There is a need for research in LMICs on achieving holistic team-based full scope of care, appropriate referral, public–private partnerships, and coordination across policy and its practical application.
The 1978 signing of the Alma-Ata Declaration called for the worldwide strengthening of primary healthcare (PHC), predominantly in low-income and middle-income countries (LMICs),1 and this is still needed today. Ideally, PHC incorporates community-based services covering health promotion, prevention, acute and chronic care management, through to palliative care and rehabilitation, delivered to individuals and families.2 However, in many countries, the initial implementation of Alma-Ata was a set of vertical programmes that targeted particular populations,3 rather than designing comprehensive people-centred ‘horizontal’ services, delivered by multidisciplinary teams.4 Characteristics of effective PHC include accessibility, affordability, and acceptability for people in all stages and ages of life.5 It works alongside other social sectors including education, welfare, housing and public works to address the social determinants of health.6 The Declaration also emphasised the importance of individual and community engagement in the organisation of PHC, including supporting people in self-care and self-management.1 The Astana Declaration of October 2018 reinforces the role of PHC and primary care (PC) services in achieving the aims of universal health coverage and the Sustainable Development Goals. It calls for governments to provide strong health systems, for communities to be empowered to enhance health and well-being, and alignments of stakeholders for effective support of national health policies.7
A crucial component for modern PC delivery is a community-based medical workforce, known as family physicians, with postgraduate training for first point of medical care.4 These physicians take a holistic approach in caring for individuals and their families in the community and treat patients of all ages as their first contact for healthcare.8 They often work with teams of nurses, midwives and allied health professionals, deliver health promotion and prevention and other PHC services, and connect to other social and community welfare services, in addition to care and management of acute and chronic illness.9 In many rural and remote areas, PC is delivered by a non-physician workforce, with a family doctor based in a regional hospital acting as consultant.
Forty years later, PHC has strengthened and PHC research has advanced. However, this has been disproportionately focused on high-income countries (HICs),10 11 and most governments have been slow to recognise the importance of PHC research, even in HICs.12–14 Research priority setting exercises do occur in LMICs, but tend to be led by governments and international organisations, and have few implementation plans following the exercise.15 On the Alma Ata Declaration’s 30th anniversary, WHO revealed some cases of exemplary PHC in LMIC, but also highlighted the underdeveloped nature of PHC in many parts of the world.16 17
Analysis of 20 case histories of PHC from around the world has identified four common factors that have a positive impact on PHC research—development of academic departments and appointment of professors of family medicine; directed resources and funding; collaboration between different institutions, disciplines and settings; and the breadth and diversity of research conducted, to reflect the scope of PHC.18 PHC research grew where these factors were available; comparably, an absence of one or more of these themes was identified as a barrier to building research capacity.
High-quality research is needed to guide policy. Policy-makers often make decisions which fail to translate into effective change. The voice of healthcare providers and clinical academics has been absent in much PHC policy to date, and yet is of immense value if initiatives are to have traction at a community level. Over the past four decades, family medicine has evolved into a unique academic discipline within the broader PHC landscape. There are now departments of family medicine in many medical schools, often also extending into PHC.8 PHC research has grown, and Index Medicus introduced Subject Heading ‘Primary Health Care’ (including Family Medicine) in 2010. Indexed journals that focus on general practice, family medicine and primary healthcare are now allocated to this subject.19 However, specialised bioscience agendas still dominate research. Many LMICs are still just establishing family medicine as a specialty, and have not achieved the same research capacity as some HICs, so PHC research in LMIC is particularly lacking.
As part of a larger funded project to ascertain the PHC research gaps in LMIC and develop research implementation plans,(ref BMJ GH Intro paper) we aimed to identify and prioritise the knowledge needs of PHC practitioners and researchers about how PHC can be organised, and different models of care for PC delivery.
To produce a list of 16 prioritised research questions relevant to the needs for evidence on PHC in LMIC.
To produce a ‘gap map’, showing areas where there is existing evidence for questions perceived to be knowledge gaps, and where there are major gaps in evidence regarding questions about PHC organisation.
To prepare research implementation plans for the top four research questions identified.
Prioritised research questions development
The study was conducted through our professional networks including the World Organization of Family Doctors (WONCA), the Robert Graham Center, the American Board of Family Medicine, and the Canadian Besrour Centre. The study involved a modified-Delphi panel consisting of PHC self-identified experts (family physicians, academics and policy-makers) from LMICs. Engaging clinical and academic staff working in PHC sectors is vital, as they understand the context of their own settings.20 The Delphi method is an iterative technique in which surveys are answered sequentially and anonymously by a diverse number of relevant experts, with summarised feedback to enable consensus.21 The World Bank list of economies was used to determine LMICs.22 We aimed for a diverse sample, with representation from LMICs in six global regions: Africa; Asia Pacific; South Asia; Latin America and the Caribbean; Eastern Mediterranean; Europe.
Invitations were sent to participants through our networks, enhanced by ‘snowballing’ (allowing invitees to disseminate the details to others whom they deemed eligible).23 We used a sampling matrix to ensure diverse representation in gender, age, residing country, location (rural or urban), role and discipline, and years of experience. Inclusion criteria were PHC practitioners or researchers residing and working in a LMIC with self-defined experience relevant to provide opinions on the key area of PHC national or regional organisation. The limited time available precluded survey translations, hence an exclusion criterion was insufficient fluency in written English. People of LMIC origin now living and working in a HIC were excluded. WONCA LMIC leaders piloted round 1 prior to panel circulation to ensure that it was comprehensible to participants with English as a second language, as well as quick and easy to respond to.24 Modifications were made in response to their feedback.
The timeline to recruit the expert panel and conduct three rounds of Delphi was 3 months. The aim of the first round was qualitative—to generate as many research questions as possible. The subsequent two rounds followed a modified Delphi technique, providing anonymised summaries of panellists’ responses between rounds to facilitate group convergence.
Respondents meeting inclusion criteria were recruited as panellists in January 2018. The survey was delivered by Qualtrics, a web-based survey tool. To protect the identity of panellists, participant demographics were limited to residing region and country; rural or urban; age (range); gender current role(s) (practitioner including type, academic, policy-maker); and years of experience. Ethical approval for the study was obtained from the University of Auckland Human Participants Ethics Committee (Ref 020630).
In round 1, participants were asked to generate research questions about gaps in knowledge of organisation of PHC relating to workforce, models of care, use of teams, scope of care, transitions of care and government policy. Enrolled panellists were sent invitations to the survey through individual links. Using a general inductive thematic approach, questions generated by the panellists were collated and coded into domains, categories and subcategories.25 The first 25 respondent replies were coded by two independent researchers and Cicchetti-Allison kappa coefficient calculated to check for reliability. Data were sorted by codes, collapsed and synthesised to lists of questions for the key area. Where similarities emerged in questions from multiple participants, investigators worked towards consensus in creation of a combined and representative question for round 2.
In round 2, all enrolled participants were invited to rate each question to determine the importance within their county using a four-point Likert scale. The question lists were presented to each participant randomly to prevent response bias from the order of presentation. Agreement of the participants’ responses was calculated, determined by mean score. Collated responses were ordered in degree of importance, and the top 16 research questions were selected.
In round 3, the research questions again were randomly presented, and panellists were asked to rank these 16 research questions within Qualtrics by order of importance for their country, to establish the top four. SAS V.9.3 (SAS Institute, Cary, North Carolina, USA) was used to perform statistical analyses.
The funder (Ariadne Labs through the Bill and Melinda Gates Foundation) is concurrently funding similar research priority setting exercises on PHC quality and safety, and on policy and governance. Some of the questions relating more to these areas than PHC organisation were removed. Our team was separately conducting the same exercise for PHC financing, and one of the top-ranking questions in this area fitted better into PHC organisation, so was shifted. The four highest-ranking questions relating to PHC organisation were selected for the subsequent formulation of research implementation plans.
Patient and public involvement
Patients were not involved in this study. The aim was to identify and prioritise the knowledge needs of PHC practitioners, researchers and policy-makers in LMICs. The study involved considerable input from, and co-design with, professionals from LMICs, but patient participation in this context was not appropriate.
Scoping literature review
Literature reviews were conducted to test whether there was already a LMIC literature base for the research questions generated by the panel. Thirty-six searches were conducted, one for each question. We constructed a two-dimensional coding matrix using the Primary Health Care Performance Initiative (PHCPI) conceptual framework for one axis and the dimensions of PHC organisation identified through coding the questions generated in round 1 by the panel for the other axis. The coding matrix was designed to search for specific answers to the generated questions. A selection of the searches was conducted by two researchers independently to reduce researcher bias and check for coding consistency.26
The search was completed using a string of terms for PHC and LMICs since 2003, MeSH and/or text words [tw]/or title and abstract words [tiab] relating to the specific domain or subdomain from the coding matrix.
Inclusion criteria were studies conducted in LMICs within the last 15 years in PHC or family practice, with MeSH or key terms related to the questions of interest. Commentaries were excluded. Searching over a limited period is an accepted technique for conducting rapid reviews.27 The studies were screened for relevance, and those not meeting the inclusion criteria were excluded by reviewing the title, followed by the abstract and, lastly, the full paper if necessary.
We used PubMed through Eppi-Reviewer 4 literature management software with shared review to conduct the search. Using our matrix, selected articles relevant to the question were coded for two axes. Seven global regions (Europe, Eastern Mediterranean, Asia Pacific, South Asia, Africa, North America, South America) and a list of all LMICs were included as filters for the map.
A gap map does not answer specific research questions, but rather provides a broad overview of existing evidence. Our map was created to determine whether there is existing evidence on the questions generated by our panellists. It required development of a coding framework of the interventions and outcomes of interest.26 The PHCPI framework and the generated research questions informed our selection of domains, categories and subcategories for our conceptual framework. Once all selected articles were coded, Eppi-Reviewer 4 software providers created our gap map, which displays a visual heat map of available evidence and the gaps related to the 36 research questions.
Research implementation plans
Panellists were invited to submit expressions of interest to prepare an implementation plan for a specific LMIC for one of the top four questions. Researchers were selected based on their known track record in PHC research and their capacity to develop a research team. Their submitted draft plans were used at a workshop run by members of the research team at the WONCA Europe conference in Krakow, Poland in May 2018. During the workshop, small groups of researchers critiqued the plans and provided feedback which was supplied to those preparing the plans to help refine them.
Prioritised research questions
There were 141 Delphi panellists enrolled in the study from 50 LMICs from all global regions. Asia Pacific and the Eastern Mediterranean (ie, North Africa and the Middle East) were relatively under-represented. Seventy (50%) completed round 1 with a broad range of demographic characteristics (table 1). Numerous participants held more than one role. Some health practitioners also indicated they were academics or policy-makers; others explained that they held all three positions.
Independent coding of the first 25 survey responses showed a high degree of consistency with a Cicchetti-Allison kappa coefficient weight κ=0.879 (95% CI 0.7345 to 1.000) p value <0.0001 (almost perfect agreement). In the final LMIC dataset, 744 valid generated questions or responses were coded. Round 2 was completed by 84 (60%) of the enrolled participants (see table 1). All 36 questions including the top 16 when ratings were summed are shown in table 2. Round 3 was completed by 68 (48%) of enrolled participants. One of the top ranked questions in our parallel financing of PHC project (‘How can the public and private sectors work more collaboratively to improve and integrate PHC coverage and prevent segmentation of the services?’) was moved here. The research team subsequently discussed the general feasibility of the questions to be answered and moved some to higher priority.
The final top four ranked questions are:
1. What are the factors to be considered and negotiated for successful referral from primary to secondary care and back?
2. How should care be horizontally integrated and coordinated among the multidisciplinary PHC team?
3. How can the public and private sectors work more collaboratively to improve and integrate PHC coverage and prevent segmentation of the services?
4. How can different stakeholders (eg, policy-makers, health system managers, health workforce organisations, academic institutions and communities) support and assist the primary healthcare workforce and successful team functioning?
Figure 1 shows the flowchart for the literature review.
Two hundred and sixty-three articles met the inclusion criteria, which were coded according to the matrix for the two axes, plus region and country for the filters (references included as online supplementary appendix 1). All regions of the world were represented, with the most studies in Africa (93), followed by Latin America and the Caribbean (60), Asia/Pacific (47), South Asia (18), Europe (18) and lastly Eastern Mediterranean (13) (figure 2).
The gap map was created through Eppi-Reviewer (Gapmap MOC). A static version is displayed in figure 3. The interactive web-based map presents both a heat map and a bubble map, with LMIC and global region filters. It enables viewing of all studies in a cell by clicking on the bubble.
Research implementation plans
It is clear that there are significant gaps, and the questions generated by our panellists have not been previously answered. Country-specific research implementation plans were developed for the top four questions (table 3).
Summary of results
The number and diversity of our LMIC panellists, and their responses across our three rounds of question generation, rating and ranking, exceeded our expectations. There were many common themes in the questions submitted, and the following two rounds produced four questions. Three examine the ways PHC may be better integrated—vertically with secondary care, horizontally with other community-based services, and between the private and public sectors. The fourth looks at the overall system and ways political, academic and community agencies may work together to support PHC. The literature reviews confirmed a lack of evidence around these topics in LMIC.
A number of themes in the literature review related to optimal team-based care, access to and geographical distribution of PC services, integration and coordination between primary and secondary care, and what PHC should incorporate. The results also present degree of alignment with the Framework for Integrated People-Centered Health Services, which advocates that all people have access to health services that are coordinated around their needs, respects their preferences, and are safe, effective, timely, affordable and acceptable.28
The research questions generated have a strong focus on the position of PHC in the health system, and its relation to hospitals and secondary care specialists. This may signal the challenges faced to prioritise PHC in health systems traditionally centred on hospital care. While some district hospitals, especially in LICs, may deliver PHC services, these tend to be first contact and community-focused care. For example, family physicians may work out to of the district hospitals and see patients at community clinics who have been triaged by nurses. It is important to acknowledge this reality, but also keep track of the importance of horizontal links of PHC to other community-based sectors that impact on population health.10 The new Astana Declaration 40 years calls for a move beyond how health services have been traditionally structured, to how health services need to be organised to advance health equity and support people to actively participate in the maintenance of their health status.7 29 Insight into the most important health problems in the population under care should inform the development of PHC. Such insight would be relevant for a number of the research questions that were generated, for example, in relation to practice priorities, the interface of PHC and hospital care, or teaching and training. Often, exploring health problems in the PHC setting has been the first step to successful PHC research.30
Strengths of the study
The rapid recruitment of a diverse range of PHC experts from across LMIC indicates the strong interest in the PHC sector in LMIC for research into health service delivery and systems to inform practice and policy. Our use of the same panel for assessing both organisation and financing knowledge gaps added rigour because the development of effective PHC organisation and models of care cannot be isolated from mechanisms of funding. A sister paper presents the findings for the latter, but evidence from WONCA comparative studies on PHC policy implementation31–34 highlights the need for an integrated coherent approach.
Our consistent use of a bottom-up approach, with questions generated by stakeholders and the searching for possible evidence already available for their prioritised questions, was a further strength. We have used researchers in LMICs who know their own contexts to develop implementation plans relevant to their own country or region’s needs and resources. And within the constrained funding time, it was also possible to generate four pilot plans for research implementation. This commitment and speed of proposal development by LMIC research teams supports our opinion that the bottom-up approach is more likely to lead to research acceptable to front-line practices. It may also offer policy-makers policy-relevant options that translate into effective change. This study therefore contributes to potential reforms on the most urgent needs in local contexts.
The large number of initial research questions and significant gaps in LMIC literature suggest a broader evidence gap in LMIC, but our process highlights bottom-up prioritisation with our use of Delphi processes enabling maintenance and development of consensus.35 WONCA’s rich network of PHC relationships made it possible to recruit a robust response within tight time constraints. It also made it possible to recruit LMIC leaders for the development of derivative study proposals, another ‘bottom-up’ approach.
A further strength was the robust qualitative methodology which achieved a high degree of inter-rater coding reliability and which supported an iterative Delphi approach which produced prioritised research questions.
Limitations of the study
We were restricted by time and resources to conducting our surveys in English, and the majority of African panellists came from Anglophone countries. Most panellists were family physicians with a specific medical emphasis on issues they experience and are concerned about—these may or may not reflect the concerns of other PHC professionals, such as nurses or community health workers. Time constraints limited our ability to disseminate our panel invitation widely through other networks. We note, however, that in round 2, only two proposals mentioned family physicians specifically, and only one of these reached round 3.
We were unable to conduct the literature reviews as robustly as we would have liked, given the time constraint. Studies were mostly screened based on the abstract, those lacking an abstract were excluded and there was an English language bias. Only the PubMed database was searched and no grey literature.
Clearly the evidence gap is very real, and there is no robust body of literature that answers our proposed priority questions. Research is needed in LMICs that focuses on models of PHC. This should be done as widely as possible, evaluating different countries and settings, so that findings are transferable. There may be a lack of PHC services in many countries, but this should shift as countries seek to undertake to deliver strong PHC for universal health coverage. As implementation occurs, the four key questions—achieving holistic team-based full scope of care, appropriate referral, public–private partnerships, and coordination across policy and its practical application—can be researched in the field and lessons learnt. Methods of quality improvement and action research may be applicable in live settings, and funding needs to follow these experiments in healthcare delivery. Health in LMICs depends on PHC and the efficient allocation of scarce resources—this seminal exercise is uniquely suited to inform global funders and health systems on the next steps needed to create evidence towards the effective organisation of PHC.
We gratefully acknowledge Drs Asaf Bitton, Director and Lisa Hirschhorn, Senior Advisor of Primary Health Care, Ariadne Labs for their support and assistance with this study. We also wish to acknowledge David Peiris and his team at the George Institute for Global Health whose work informed our coding matrix, and to thank them for sharing their material with us and recommending use of Eppi-Reviewer 4. The bid for this work was made with the agreement of WONCA World Executive. Members Dr Henry Lawson, Regional resident for Africa; Professor Kanu Bala, Regional president for South Asia; and Dr Inez Padula, regional President for South America, supported the original bid. We also wish to acknowledge the lead researchers of the four implementation plans and their teams: Dr Sandro Rodrigues, School of Medicine, Federal University of Goiás, Brazil; Professor Shabir Moosa, Department of Family Medicine, University of Witwatersrand, South Africa; Professor Sherina Mohd-Sidik, Universiti Putra Malaysia, Malaysia; and Dr Aboi Madaki, Department of Family Medicine, University of Jos, Nigeria.
Handling editor Seye Abimbola
Contributors FG-S: led the proposal, study design and research implementation; conducted qualitative analysis, oversaw other analyses, drafted initial paper and revised. AB: involved in developing the proposal on which this article is based, is on the core project team, helped advise on methods development and contributed to consecutive versions of the article. MC: conducted qualitative data analysis, refined qualitative coding process and edited publication documents. RDWF: made substantial contributions to study design, data collection, qualitative and quantitative data analyses, and to the draft and critical revision of the manuscript. AH: involved in the bid for the work on which this article is based, is on the core project team, had input to methods development and commented on consecutive versions of the article. MK: involved in the bid for the work on which this article is based, is on the core project team and had input to all versions of the article. RP: involved in developing the proposal on which this article is based, is on the core project team, helped advise on methods development and contributed to consecutive versions of the article. KR: participated in initial discussions about the project and in two teleconferences, and provided input into the documents. CvW: involved in the bid for the work on which this article is based, is on the core project team and had input to all versions of the article.
Disclaimer This publication is based on research funded by Ariadne Labs through Brigham and Women’s Hospital, which is the recipient of a Bill and Melinda Gates Foundation grant. The findings and conclusions contained within are those of the authors and do not necessarily reflect positions or policies of the Bill and Melinda Gates Foundation.
Competing interests None declared.
Patient consent for publication Not required.
Ethics approval University of Auckland Human Participants Ethics Committee (ref. 020630).
Provenance and peer review Not commissioned; externally peer reviewed.
Data availability statement All data relevant to the study are included in the article or uploaded as online supplementary information.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.