Health technology is increasingly recognised as a feasible method of addressing health needs in low and middle-income countries (LMICs). Primary Care 101, now known as PACK (Practical Approach to Care Kit), is a printed, algorithmic, checklist-based, comprehensive clinical decision support tool. It assists clinicians with delivering evidence-based medicine for common primary care presentations and conditions. These assessment and treatment guides have been adopted widely in primary care clinics across South Africa. This paper focuses on the process of designing, developing, and implementing a digital version of the clinical decision support tool for use on a tablet computer. Lessons learnt throughout its development and pilot implementation could apply to the creation of electronic health interventions and the digitisation of clinical tools in LMICs.
- Other diagnostic or tool
- public Health
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0
Statistics from Altmetric.com
Primary Care 101 (PC101), now called PACK (Practical Approach to Care Kit), is an effective point-of-care clinical decision support tool for primary care in health systems in low-income and middle-income countries.
Digital delivery of medical content has potential benefits for healthcare workers, patients and health systems.
The development and implementation of electronic PC101 across four primary care clinics in South Africa has demonstrated its feasibility and has flagged challenges for its further development and scaling.
The field of electronic health (eHealth) is growing rapidly, especially in low and middle-income countries (LMICs).1 With technological advances becoming increasingly accessible across the world, health systems are turning to digitisation to improve efficiency and quality of care.2 The Knowledge Translation Unit (KTU) at the University of Cape Town has led the development and implementation of a digital clinical decision support tool. This tablet-based eHealth intervention was designed for use by clinicians caring for adult ambulatory patients in LMIC settings.
This paper provides insight into each stage of this process: digitising a hard copy clinical decision support tool, training nurses without prior eHealth experience and implementing the tool in everyday clinical practice in four primary care clinics in the Western Cape province of South Africa. Lessons learnt throughout these experiences and future steps for its development, evaluation and implementation will be described.
The Practical Approach to Care Kit programme
The PACK (Practical Approach to Care Kit) programme is a comprehensive health systems intervention designed for LMICs that comprises four ‘pillars’: a clinical decision support tool called the PACK guide,3 an implementation strategy,4 and health systems strengthening and monitoring and evaluation components.
Developed by the KTU, this programme has undergone four generations of expansion, evaluation and improvement: Practical Approach to Lung Health in South Africa (PALSA), PALSA Plus, Primary Care 101 (PC101) and PACK.5–8 Beginning with the management of tuberculosis and respiratory care in the PALSA guide, PC101 and the PACK guides now include comprehensive coverage of all important primary care conditions in adults. PC101 (later renamed by the South African Department of Health to be Adult Primary Care) forms a central clinical component of the South African National Department of Health’s primary care improvement initiative and policies.9 Usage of the programme as PACK has also spread beyond South Africa’s borders to other LMICs including Botswana, Brazil, Nigeria and Ethiopia.10–13
The PACK guide and its predecessors are designed for nurse-led primary care clinics but provide for use for all front-line primary care clinicians, including doctors. Based on algorithms and structured lists, the PACK guide is a 120-page document, printed in full colour on high-quality paper and is spiral-bound. The current version of PACK addresses 40 or more common presenting symptoms and more than 20 chronic conditions in adults. These include infectious diseases, chronic diseases of lifestyle, chronic respiratory diseases, mental health, reproductive health, musculoskeletal conditions, epilepsy and palliative care.3 It contains over 2300 diagnostic, screening and management recommendations based on current best evidence and relevant guidelines. Four pragmatic randomised control trials evaluating the guides confirmed substantial improvements over non-guideline-based care (PALSA) and then modest but consistent benefits on several process and health outcomes (PALSA Plus, PC101).5–8
Addressing demand for a digital clinical decision support tool
While the potential advantages of digitisation have been clear since the inception of the PACK programme, several factors catalysed the decision to pilot an electronic version. Technological advances contributed to an increased availability of user-friendly hardware and software, reduced prices for tablets, and therefore improved feasibility for an electronic clinical decision support tool in underserved health systems. In addition, the political environment has recently been receptive to technological innovation. The South African Department of Health has outlined its national strategy for developing eHealth and lists 10 strategic eHealth priorities—one of which is the ‘Applications and Tools to support healthcare delivery’.14
There were several aspects of the printed PC101 guide that had been identified as limitations. In the Western Cape, where the PC101 programme was developed and initially evaluated, evolving local policy necessitated annual updates of the guide. Printing the guides and coordinating their delivery every year are costly and time-consuming. Once printed, the content was soon out of date. Having an electronic version would allow for the implementation and dissemination of crucial updates before its annual revision. In addition, users of the printed guide required practice to navigate it quickly during a clinical consultation, and an interactive, electronic version offered the potential to improve user experience.
Developing the tool
In January 2012, the KTU partnered with the Medical Device Innovation Platform of the South African Medical Research Council to develop a tablet adaptation of PC101. The PC101 guide was used as it was the version of the guide in use at the time. A design thinking approach was adopted in order to ensure that the tool was optimised for user needs. Prototyping, a key component of the design thinking process, was essential for gauging user feedback, exposing unanticipated challenges and evaluating project feasibility.15 The tool’s development was separated into two iterations: version 1 (electronic PC101 [e-PC101]) and version 2 (electronic PACK [e-PACK]). Version 1 (e-PC101), the focus of this paper, is an adaptation of the PC101 guide. Version 2 (e-PACK), which is currently in development, is an adaptation of the paper version of the PACK guide. It will incorporate the feedback elicited from the development and piloting of e-PC101, and will be evaluated in Nigeria and Brazil.11 12
Partitioning the tool’s development into two iterations allowed for its agile development, ensuring that user feedback collected from the implementation of version 1 could be incorporated into the design of version 2.16 Keeping objectives modest for the development of version 1 allowed for the collection of valuable feedback without the costs required to build a fully operating electronic clinical decision support tool. A comparison of versions 1 and 2 is provided in table 1.
A team of clinician guideline developers, graphic artists, information technology specialists and project management administrators identified a series of objectives to guide the development of e-PC101. Objectives included determining appropriate software development vendors, identifying best practices in digitisation and piloting the tool to gather feedback (table 2).
A challenge that the KTU encountered while producing e-PC101 was the knowledge gap between the KTU staff and commercial software developers. Selecting a vendor to develop e-PC101 required a nuanced understanding of the relative advantages and disadvantages of coding languages, frameworks and content delivery platforms. This experience highlights the importance of bridging the fields of guide development and electronic content delivery by involving interdisciplinary advisors in the creation of eHealth applications.17
Training nurses to use a digital clinical decision support tool
Seventeen nurses were trained to use e-PC101 during two 1-day workshops, with no distance education or follow-up training. A designated staff trainer employed by the KTU facilitated training at the nurses’ place of work. The case-based training revolved around applying e-PC101 to index cases—hypothetical scenarios that reflect common clinical encounters. This represents a significant departure from the traditional model of training for primary care health workers, where didactic training is provided off-site and out of context with little attempt to integrate with the clinical setting.
The tablet contained no applications other than e-PC101. Each nurse was provided with a bag for transporting the tablet within the clinic and to and from home. The training programme focused on establishing competency in several domains, including navigation of the device, usability during practice, safety and security, and integration in the health facility.
Throughout the training process, several insights became apparent. While all nurses owned cellphones, few used the technology to assist during clinical consultations. This can be attributed to a number of factors, including nurses’ ownership of standard cellphones rather than smartphones, unstable wireless connection in rural clinics and a lack of confidence in using mobile technology.
Initial training in the use of e-PC101 appears to provide an adequate introduction to the digital tool despite a general prior lack of mastery of mobile technology. All users reported that they were successfully able to use the digital version, and none felt overwhelmed or stressed at the prospect of incorporating the tool in the clinic. Nurses felt that e-PC101 was a practical tool that could feasibly become integrated in their workflow. However, nurses noted that since e-PC101 would enforce a more detailed, time-consuming examination of patients, this would lead to the challenge of balancing comprehensive clinical assessments with heavy clinic demands. In addition, nurses expressed concern about the amount of time and resources necessary to train all healthcare workers to use e-PC101 and that a general lack of self confidence in technological competency might be an obstacle to scaling up.
Implementing a digital guide
The initial implementation of e-PC101 was conducted over a 2-month period in 2014 across four clinics in the Eden District of South Africa. e-PC101 was loaded onto 10 Samsung GT-P5200 32-gigabyte tablets for use by nurses.
Permission was obtained from the Provincial Government of the Western Cape (Department of Health), and all nurses were provided with comprehensive written information about the purpose of the study. Methodology for data collection is provided in online supplementary file 1.
After the 2-month pilot period, discussions with nurses were held to solicit feedback and gauge the feasibility of scaling e-PC101. Nurses’ reflections on the effectiveness and feasibility of e-PC101 were overwhelmingly positive. The nurses reported using e-PC101 extensively during consultations. Most nurses found that the digitised version was more effective and that they were able to read the material easily on the tablet. There was consensus among nurses that e-PC101 would benefit their practice. One group of nurses grew so attached to the intervention that they expressed reluctance to return the tablet after the pilot ended and even offered to purchase their own devices. Nurses emphasised how critical e-PC101 was to their clinical workflow by suggesting that their employer should obtain the digital tool even before official distribution was formalised. When comparing the e-version with the printed guide, all but one nurse indicated that they found e-PC101 faster, more intuitive and ultimately more helpful. Some nurses described a short adjustment period during which additional time was necessary to learn to use the platform. Besides their impression of quicker consultations and more tool-adherent care, e-PC101 improved their confidence. Using tablet technology made nurses feel professional, self-confident and knowledgeable. Nurses also noted that patients were intrigued by the new device, asking about its purpose and showing excitement about the use of new technology in their care. This mirrors experiences in which the introduction of novel health information technology has increased health workers’ confidence and satisfaction.18 19
In terms of functionality, nurses reported that they often searched within a page for certain words, zoomed to enlarge the text, used the ‘return’ button, swiped to turn pages, and made use of both the calendar and calculator applications. Features that were seldom used included highlighting and annotation. Participants indicated that highlighting and note-taking functions might be used more frequently once they had their own permanent tablet with e-PC101. The overall user interface was received as intuitive and time-saving. The battery was able to last throughout each working day, requiring only overnight charging. A significant limitation noted was that unstable wireless connectivity could limit regular updating of content. Nurses did not find the evidence updating processes as advantageous as expected. Instead, the rapid navigation of content during clinical consultations was the greatest perceived benefit.
Nurse feedback emphasised the need for improved security of the device from theft. Nurses across all clinics expressed concern about the safety of using expensive mobile technology in clinical settings. Many nurses explained that they hid the tablet under sheets of paper as a precautionary measure. One nurse said that “The fear of stealing it from the room was horrible,” while another said that she initially refused to take the tablet out of the room, but eventually, “the anxiety disappeared.” Several participants suggested security features for the tablet, including a locked box that could house the tablet, or mounting the tablet permanently on the clinic wall. Other suggestions included adding features for printing, flagging newly updated content, expanding content to include paediatric populations, and adding more multimedia content such as video.
The way forward for electronic Primary Care 101
The findings of our limited pilot of e-PC101 support the hypothesis that digitising the PACK guides could help facilitate practical, streamlined, evidence-based healthcare.
Consultations have been initiated with the South African national and provincial departments of health as well as the private health sector regarding further implementation of e-PC101. Health workers and managers in the Western Cape have expressed interest in obtaining an electronic version of the guide to expedite distribution of the annual revision.
PACK is currently in high global demand, with many countries expressing interest in adopting the programme for their primary care services.20 To facilitate dissemination and implementation, a partnership has been established with the BMJ Publishing Group to develop and test tools to help spread PACK cost-effectively. For example, a linkage with BMJ Best Practice permits ready access to current guideline recommendations to inform the annual process of updating PACK guides. PACK in an electronic format in different LMICs could be easily updated, without the cost and delays involved in printing revised versions.
Because the demand to rapidly introduce novel eHealth interventions is often steered by political economic pressures and an appetite for innovation, there has been a documented absence of rigorous validation prior to widespread implementation.21 22 Further formal evaluation is needed to assess the effectiveness of e-PC101 over the hard copy version. In addition to measuring the quantitative impact of the tool, its features and outcomes should also be compared with other clinical decision support tools designed for LMICs.23 24
The KTU believes that digital guides like e-PC101 have the potential to improve quality of care in under-resourced health systems by systematising the comprehensiveness and thoroughness of the clinical examination and history, and by streamlining the process whereby new evidence is available for front-line clinicians. The introduction of a complex eHealth intervention in an LMIC has distilled several challenges and opportunities regarding design priorities, effective training and security protocols. Feedback for improved features provided by front-line nurses has been considered and incorporated into a second iteration. Front-line nurses with no previous experience with digital health tools felt that the 2-day workshop was sufficient training for practical use of the tool.
The lessons learnt throughout this process will inform the continued development and evaluation of this LMIC clinical decision support tool.
Dr Anthony Bunn of the SA MRC as funding lead, Dr Beverly Draper (project manager), Dr Catherine Draper (protocol development), Gill Faris (training programme design) Dr Giovanni Milandri (for advice on application development), Kerry Abramowitz (for graphic design), Dr Renette Crous, the District Manager and nurses from the four clinics who participated in the pilot.
Handling editor Seye Abimbola
Contributors MY performed the analysis of results and drafted the paper. VT contributed to the development of the device. PM and VT performed the field testing. MZ, LF, RVC and EDB were involved in the concept and design of the evaluation and the analysis of results. All authors contributed substantially to the drafting and revision of the manuscript and approved the final version.
Funding Financial support for this project was received from Medical Device Innovation Platform of the South African Medical Research Council and from the University of Cape Town Lung Institute.
Competing interests MY and MZ declare no competing interests. LF and RVC are employees of the University of Cape Town Lung Institute. VT is an ex-employee of the University of Cape Town Lung Institute. PM was an employee of the University of Cape Town. EDB is a part-time employee of the University of Cape Town Lung Institute, and reports personal fees from ICON, Novartis, Cipla, Vectura, Menarini, ALK, Sanofi Regeneron, Boehringer Ingelheim and AstraZeneca, and grants to his institution for clinical trials from Novartis, Boehringer Ingelheim, Merck, Takeda, GlaxoSmithKline, Hoffmann-La Roche, Actelion, Chiesi, Sanofi-Aventis, Cephalon, TEVA and AstraZeneca. All EDB’s fees and clinical trials are for work outside the submitted work. EDB is a member of the Global Initiative for Asthma Board and Science Committee. Since August 2015 the KTU and BMJ have been engaged in a non-profit strategic partnership to provide continuous evidence updates for PACK, expand PACK-related supported services to countries and organisations as requested, and where appropriate licence PACK content. The KTU and BMJ cofund core positions, including a PACK Global Development Director, and receive no profits from the partnership. PACK receives no funding from the pharmaceutical industry. This paper forms part of a Collection on PACK sponsored by the BMJ to profile the contribution of PACK across several countries towards the realisation of comprehensive primary healthcare as envisaged in the Declaration of Alma Ata, during its 40th anniversary.
Patient consent for publication Not required.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.