Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

At-home self-collection of saliva, oropharyngeal swabs and dried blood spots for SARS-CoV-2 diagnosis and serology: Post-collection acceptability of specimen collection process and patient confidence in specimens

  • Mariah Valentine-Graves,

    Roles Conceptualization, Data curation, Formal analysis, Project administration, Writing – review & editing

    Affiliation Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America

  • Eric Hall,

    Roles Formal analysis, Writing – review & editing

    Affiliation Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America

  • Jodie Lynn Guest,

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliation Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America

  • Elizabeth Adam,

    Roles Data curation, Formal analysis, Writing – review & editing

    Affiliation Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America

  • Rachel Valencia,

    Roles Data curation, Formal analysis, Writing – review & editing

    Affiliation Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America

  • Kaitlin Shinn,

    Roles Formal analysis, Writing – review & editing

    Affiliation Emory University School of Medicine, Atlanta, Georgia, United States of America

  • Isabel Hardee,

    Roles Formal analysis, Writing – review & editing

    Affiliation Emory University School of Medicine, Atlanta, Georgia, United States of America

  • Travis Sanchez,

    Roles Conceptualization, Data curation, Supervision, Writing – review & editing

    Affiliation Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America

  • Aaron J. Siegler,

    Roles Conceptualization, Writing – review & editing

    Affiliation Department of Behavioral Sciences and Health Education, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America

  • Patrick Sean Sullivan

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Supervision, Writing – original draft

    pssulli@emory.edu

    Affiliation Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America

Abstract

Background

Options to increase the ease of testing for SARS-CoV-2 infection and immune response are needed. Self-collection of diagnostic specimens at home offers an avenue to allow people to test for SARS-CoV-2 infection or immune response without traveling to a clinic or laboratory. Before this study, survey respondents indicated willingness to self-collect specimens for COVID-related tests, but hypothetical willingness can differ from post-collection acceptability after participants collect specimens.

Methods

153 US adults were enrolled in a study of the willingness and feasibility of patients to self-collect three diagnostic specimens (saliva, oropharyngeal swab (OPS) and dried blood spot (DBS) card) while observed by a clinician through a telehealth session. After the specimens were collected, 148 participants participated in a survey about the acceptability of the collection, packing and shipping process, and their confidence in the samples collected for COVID-related laboratory testing.

Results

A large majority of participants (>84%) reported that collecting, packing and shipping of saliva, OPS, and DBS specimens were acceptable. Nearly nine in 10 (87%) reported being confident or very confident that the specimens they collected were sufficient for laboratory analysis.There were no differences in acceptability for any specimen type, packing and shipping, or confidence in samples, by gender, age, race/ethnicity, or educational level.

Conclusions

Self-collection of specimens for SARS-CoV-2 testing, and preparing and shipping specimens for analysis, were acceptable in a diverse group of US adults. Further refinement of materials and instructions to support self-collection of saliva, OPS and DBS specimens for COVID-related testing is needed.

Background

The global SARS-CoV-2 pandemic has resulted in explosive patterns of transmission in most countries [1,2]. Control programs, where they have been successful, have relied largely on a combination of testing people for SARS-CoV-2 infection, quarantine, and social distancing [3].The United States, which as of this writing comprises 4.25% of the world’s population and accounts for 31% of global diagnoses of COVID-19 disease, has struggled to launch an effective screening program for the virus [4]. After early failures of government-developed testing kits [5], private laboratories were allowed more flexibility to expand testing platforms [6]. However, overall testing capacity remains well below the levels needed to inform decisions about relaxing social distancing programs: public health officials estimate that a US national capacity of at least 1 million tests per week is required [7], and current capacity is less than a quarter of that for PCR testing [8].

There are a number of barriers to expanding testing [9]. Since the beginning of the epidemic, barriers have included supply chain constraints for rigid swabs [10], shortages of personal protective equipment needed for healthcare workers collecting invasive specimens [11], limited transport media for swab-based specimens, and limited laboratory reagents for testing specimens [6].Further, there is limited willingness of people to travel into a laboratory or clinic to be tested for SARS-CoV-2 infection [12].Responding to these challenges calls for the development of alternative specimen collection processes that produce high-quality specimens, are acceptable to a broad segment of the population for screening purposes (i.e., not only for diagnostic testing of those suspected of having COVID-19), and minimize the need for personal protective equipment (PPE) for collection.

The iCollect study recruited 159 US adults for a study of the acceptability and sufficiency of at-home self-collected samples for SARS-CoV-2 PCR and immune response testing. We have previously documented the study protocol [9] and demonstrated that specimens collected at home are considered suitable by telehealth clinicians and sufficient by laboratorians [13].After participants self-collected specimens, we asked them to rate the acceptability of the self-collection process, and of packaging and shipping specimens, and we asked participants for recommendations on how to improve the specimen self-collection process. Here, we describe the participant-reported acceptability of self-specimen collection and participant suggestions to improve the self-collection and shipping process.

Methods

The methods for the iCollect study have been previously described [9]. Briefly, participants were recruited from databases of participants in previous Emory University studies who had agreed to be recontacted for future research studies and from networks of symptomatic and at-risk individuals. Participants were also recruited into the original study through online advertisements (for example, through Facebook).Participants were required to be at least 18 years of age and reside in the United States or Puerto Rico to participate. Participants were consented online [14] and all participants who consented were mailed a home collection kit that included supplies and instructions to collect three specimens: a saliva specimen for SARS-CoV-2 polymerase chain reaction (PCR) and antibody testing, an oropharyngeal swab (OPS or “throat swab”) for PCR testing, and a dried blood spot (DBS) card for antibody testing. Participants collected specimens during a telehealth session with a healthcare provider on a HIPAA-compliant video conferencing service. Specimens were returned to the central study laboratory in a provided mailer and tested in the central laboratory. Participants were compensated $50 in Amazon credit for their time. The study was reviewed and approved by our institution's human subjects research review committee.

Following specimen collection, the clinicians asked participants for suggestions about how to improve the collection instructions or process. Participants were also administered an online survey that collected data on the acceptability of the collection of the three specimen types, the process of packing and shipping the specimens, and how confident the participants were that they had collected the specimens adequately to be accurate as diagnostic specimens. Participants were also asked three open-ended questions in the online survey to gather qualitative data on suggestions for improvement of the specimen collection instructions. Specifically, they were asked to document suggestions to improve the clarity of instructions to collect or pack each specimen type. We analyzed the data by describing Likert scale scores (1–5, where 1 was very unacceptable and 5 was very acceptable) proportions for acceptability of specimen collection and packing/shipping and medians and interquartile ranges for each acceptability item. We used Kruskal-Wallis tests [15] to describe differences in median acceptability across different demographic groups (i.e., gender, age, race/ethnicity, education). We used a Bonferroni-type correction to set an experiment-wise p alpha of 0.05, considering the 16 comparisons planned in the analysis [16].We also combined the very acceptable and acceptable responses to make a dichotomous measure of acceptability (i.e., acceptable or very acceptable was categorized as “acceptable”, and all other responses were considered neutral/not acceptable). We used the same process to evaluate data on the confidence of participants that their specimen was suitable for COVID-related testing.

Telehealth observers recorded verbal participant feedback on the process, including participant suggestions of how to improve collection and shipping materials and instructions. Two coders independently read through all participant comments and created themes; they then worked together to develop a codebook that was used to independently code the data. A thematic analysis was conducted [17] seeking to assess emergent themes regarding challenges and areas for improvement for the self-collection and return shipping process. The summarized comment themes, examples and frequencies by specimen type are presented in a tabular format.

Results

Of 159 participants who consented to be in the study, 153 participants provided at least one self-collected specimen, and 148 (97%) completed the post-collection survey for at least one specimen type and provided data on the acceptability of the specimen collection methods and packing/shipping. Six participants returned no specimen. Most participants were female (59%), non-Hispanic white (70%), and had at least some education beyond high school (97%); median age was 38 years (IQR: 27–49). Most surveys were completed within two days of the specimen collection (100, 68%), with 23 completed on the same day (16%), 46 on the first (31%), and 31 on the second (21%) day after the collection. A total of 82 participants provided 135 responses (some containing more than one code or theme) to open-ended survey items with suggestions for improving the specimen collection process. Fifty comments were provided for the DBS collection (34% of those submitting DBS specimens), 53 for saliva collection (35% of those submitting a saliva specimen), and 32 for throat swab collection (21% of those submitting a throat swab specimen).

Acceptability of the collection of all three specimen types was high (>84%, Fig 1).Over 90% of participants rated the DBS collection, and packaging and mailing processes, as very acceptable or acceptable, and 84–86% of participants rated the saliva specimen and throat swab as very acceptable or acceptable. Few participants reported aspects of the collection as unacceptable or very unacceptable: packaging (3%), DBS collection (4%), saliva collection (5%), and throat swab collection (5%). 6%-11% of participants were neutral on acceptability of these components. The median acceptability rating for the DBS specimen was 4 (scale: 1–5, where 5 is very acceptable) and the median acceptability for saliva and throat swab were 5 (Table 1).The median acceptability of the return shipping process was 5 (data not shown in Table).There were no significant differences in the median acceptability of any specimen type or the packaging process by gender, age, race, ethnicity, or education (data not presented).

thumbnail
Fig 1. Acceptability of at-home collection, packaging and mailing specimens for SARS-CoV-2 related testing, United States, April 2020.

https://doi.org/10.1371/journal.pone.0236775.g001

thumbnail
Table 1. Acceptability of at-home self-collection of dried blood spot, saliva and oropharyngeal swab specimens for SARS-CoV-2-related testing after specimen collection, by gender, age, race/ethnicity, and education, United States, April 2020.

https://doi.org/10.1371/journal.pone.0236775.t001

Most participants (87%) reported feeling confident or very confident in the submission of their self-collected specimens for laboratory testing (Fig 2). There were no differences in the median confidence in specimen collection by age, race/ethnicity, or education (data not presented).

thumbnail
Fig 2. Overall participant confidence in at-home self-collection of saliva, oropharyngeal swab and dried blood spot specimens for SARS-CoV-2-related testing after specimen collection, United States, April 2020.

https://doi.org/10.1371/journal.pone.0236775.g002

We identified a number of key themes from participant suggestions, and each was given a code: specimen collection instructions, specimen collection diagrams, kit packaging, device complexity, specimen contamination potential, missing kit materials, and kit shipping (Table 2). Comments categorized as specimen collection instructions were most common (n = 98 comments) and were so coded if they described a lack of clarity in the wording or structure of the instruction guide. This included concerns about imprecise or overly technical wording of instructions, inconsistent terminology, lack of sequential ordering of steps, lack of appropriate detail, and inaccessible font type and size. If specifically describing difficulties or suggestions related to the images in the instruction guide, comments were categorized as specimen collection diagrams. Thirty comments related to kit packaging detailed difficulties finding the instructions, devices, or supplies inside the kit due to how materials were packaged or organized. Common suggestions within this category were to color code all materials to match the instruction guide, clearly separate and label the three specimen types, and place the instruction guide on top of all other kit materials. Comments in this category were less common and were typically about needing more diagrams, more detail with the diagrams and inconsistencies between the images and written text. Twenty comments about device complexity detailed difficulties with the collection process due to physical characteristics of the specimen collection devices and offered suggestions to improve clarity of instructions to help participants identify kit components. The saliva device and the DBS collection lancets were described most frequently as being unfamiliar or complex. Comments about specimen contamination potential were uncommon (n = 9) and related to perceived contamination of the samples during testing due to either the design of the devices or the instructions. In particular, a few participants were concerned with contaminating the OP swab by touching or dropping it before collection. They were also concerned with contaminating the DBS card by touching the paper directly. Four comments related to missing kit materials described one or more of the components of the kit missing during testing due to packing error. The participants in this category described missing shipping materials, lancets, or biohazard bags. The final category of kit shipping included only two responses related to opportunities to clarify the procedure for packaging and return shipping the kit. More comments were made about saliva specimen collection (Table 3: n = 72) than about DBS collection (n = 69) or throat swab collection (n = 42).

thumbnail
Table 2. Themes of observations from participants after self-collecting saliva, oropharyngeal swabs and dried blood spot cards for SARS-CoV-2-related testing, United States, April 2020.

https://doi.org/10.1371/journal.pone.0236775.t002

thumbnail
Table 3. Frequency of themes from participants after self-collecting saliva, oropharyngeal swabs and dried blood spot cards for SARS-CoV-2-related testing, United States, April 2020.

https://doi.org/10.1371/journal.pone.0236775.t003

Discussion

We performed a mixed-methods assessment of the acceptability of three self-collected specimen types for COVID-19 related testing and the confidence of participants in their ability to collect these specimens after they had completed a self-collection process. Our results indicate high acceptability for all three specimen types and high confidence in self-collected specimens. Despite the high overall acceptability of specimen collection, we also identified areas for improving the clarity of instructions and ease of use for devices. These suggestions can be used to further refine the kit and instruction process to improve usability and to decrease potential errors in specimen collection.

We have previously reported that, in hypothetical willingness to use at-home specimen collection kits for COVID-19 infection and immune response, testing was high (saliva collection: 88% willing; throat swab: 83% willing) among participants in a different, large online sample of US persons. In that study, like the present study, willingness did not vary by race/ethnicity or sex.[18] Younger respondents reported a lower willingness to self-collect an oropharyngeal swab in that study. [18] Further, respondents in the same online study reported high willingness to use home-collection kits to receive COVID-19-related testing for their clinical care (92% reported willingness to use self-collection of saliva and 88% reported willingness to self-collect a throat swab for clinical care).[12] Willingness to use saliva collection and throat swabs for clinical care in that study did not differ by age groups, race/ethnicity, COVID-19 stigma score, COVID-19 knowledge score, or COVID-19 symptomatology. The consistency in the hypothetical willingness to use these methods for research or clinical care, and the acceptability of their use after using the kits, is notable.

For HIV self-specimen collection systems, hypothetical interest in use was reported to be high before tests became commercially available, but uptake was quite low after they reached the market. [19,20] In the present study, the acceptability of saliva and throat swab collections were higher after participants used them than self-reported hypothetical willingness to use such collection devices in a previous survey. Although a number of factors will eventually influence utilization [21], these data suggest promise for eventual use if these collection methods are made available in the US.

Overall, about half of participants did not provide suggestions to improve the specimen collection process. Of those who did, nearly two-thirds of recommendations were for improvements to the written instructions or diagrams, which can be implemented with minimal redesign of kit components. Our observations of the participants using these kits was the first step in a multi-phased process of developing kits for broader use. We have used this staged process in the past to develop home-use kits for collection of DBS specimens and for home testing devices.[22,23] The data collected from these participants who used a pre-pilot version of the kits will be used to refine instructions. In the case of our PrEP@Home project, we also developed a video (https://vimeo.com/138977095) to illustrate the key steps of the process and to draw attention to potential errors in self-collection that were observed in the pilot phase. In this case, we will use the data from participant suggestions to clarify instructions, redesign the user experience in terms of the assembly and order of kit components, take steps to minimize touching of the DBS card before specimen collection, and include more explicit instructions for packaging and returning the kit. With these modifications in place, we will re-pilot the usability of the modified kit to test the impact of the modifications.

The feedback of the participants is interpreted in light of the evaluation of the specimen quality by clinicians and laboratorians.[13] The specimens collected by these same participants were judged by clinicians to be suitable for laboratory testing (saliva: 97%; throat swab: 96%) and were found to have adequate nucleic acid for RNA PCR diagnostic testing (saliva: 100%; throat swab: 99%).[13]. Comparing the three measures in terms of the assessment of sufficiency of specimen collection, participants had the lowest confidence in the adequacy of their specimen collections; healthcare providers observing the collection and laboratorians processing the specimens were more confident in the sufficiency of the specimens.

Our study has important limitations. Our participants represent a convenience sample, and it is likely that they are a biased sample and may over-represent people interested in COVID-19-related testing generally, or people concerned about their own SARS-CoV-2 infection status. It is unclear how these biases might impact the results of our self-evaluation of acceptability of specimen collection. Further, the lay opinions of participants about their confidence in the sufficiency of specimens they collected may be naive since they were not selected for healthcare or laboratory expertise. However, the results of clinician observation and laboratorian assessment supported their views of the sufficiency of their samples; the triangulation of these three assessments lends credence to the potential sufficiency of self-collected specimens for COVID testing.[24] We did not test specimen collection in children; children might play an especially important role in propagating epidemics because they may be more likely to be asymptomatic while infectious. Future research should assess the feasibility of self-collection of specimens by older children and parent-collected specimens for younger children.

The United States is in dire need of options to increase screening for SARS-CoV-2 infection and immune experience, and survey data suggest that people might be more willing to collect specimens at home for research and clinical purposes than to travel into labs or clinics to provide specimens.[12,18] At-home self-collection offers possibilities to reduce the exposure of people in need of screening to others by not requiring travel to test; to reduce the need for PPE for invasive screening tests; to offer options for screening of populations without symptoms who might be unwilling to travel to a clinic for testing. Next steps in this development process include modification to kit instructions and assembly, addition of instructions for shipping, development of video instructions (emphasizing areas of lack of clarity or participant concern), and reassessment of kit usability and performance with another group of participants observed by a telehealth clinician in an intended use environment (e.g., home collection).

References

  1. 1. Rothan HA, Byrareddy SN. The epidemiology and pathogenesis of coronavirus disease (COVID-19) outbreak. J Autoimmun ElsevierPaperpile; 2020 May;109:102433. pmid:32113704
  2. 2. Sohrabi C, Alsafi Z, O’Neill N, Khan M, Kerwan A, Al-Jabir A, et al. World Health Organization declares global emergency: A review of the 2019 novel coronavirus (COVID-19). Int J Surg ElsevierPaperpile; 2020 Apr;76:71–76. pmid:32112977
  3. 3. Wu Z, McGoogan JM. Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in China: summary of a report of 72 314 cases from the Chinese Center for Disease Control and Prevention. JAMA American Medical Association; 2020;323(13):1239–1242.
  4. 4. del Rio C, Malani PN. COVID-19—New Insights on a Rapidly Changing Epidemic. JAMA American Medical Association; 2020 Apr 14;323(14):1339–1340.
  5. 5. Dyer O. Covid-19: US testing ramps up as early response draws harsh criticism. BMJ 2020 Mar 23;368:m1167. pmid:32205342
  6. 6. Sharfstein JM, Becker SJ, Mello MM. Diagnostic Testing for the Novel Coronavirus. JAMA [Internet] 2020 Mar 9; pmid:32150622
  7. 7. Guest JL, Del Rio C, Sanchez T. The Three Steps Needed to End the COVID-19 Pandemic: Bold Public Health Leadership, Rapid Innovations, and Courageous Political Will. JMIR Public Health Surveill 2020 Apr 6;6(2):e19043. pmid:32240972
  8. 8. Stein R, Wroth C, Hurt A. U.S. Coronavirus Testing Still Falls Short. How’s Your State Doing? NPR [Internet] 2020 May 7 [cited 2020 May 24]; Available from: https://www.npr.org/sections/health-shots/2020/05/07/851610771/u-s-coronavirus-testing-still-falls-short-hows-your-state-doing
  9. 9. Sullivan PS, Sailey C, Guest JL, Guarner J, Kelley C, Siegler AJ, et al. Detection of SARS-CoV-2 RNA and Antibodies in Diverse Samples: Protocol to Validate the Sufficiency of Provider-Observed, Home-Collected Blood, Saliva, and Oropharyngeal Samples (Preprint) [Internet].
  10. 10. Patel R, Babady E, Theel ES, Storch GA, Pinsky BA, St George K, et al. Report from the American Society for Microbiology COVID-19 International Summit, 23 March 2020: Value of Diagnostic Testing for SARS-CoV-2/COVID-19. MBio [Internet] 2020 Mar 26;11(2). pmid:32217609
  11. 11. Ranney ML, Griffeth V, Jha AK. Critical Supply Shortages—The Need for Ventilators and Personal Protective Equipment during the Covid-19 Pandemic. N Engl J Med 2020 Apr 30;382(18):e41. pmid:32212516
  12. 12. Siegler AJ, Hall E, Luisi N, Zlotorzynska M, Wilde G, Sanchez T, et al. Willingness to seek laboratory testing for SARS-CoV-2 with home, drive-through, and clinic-based specimen collection locations. medRxiv [Internet] Cold Spring Harbor Laboratory Press; 2020; Available from: https://www.medrxiv.org/content/medrxiv/early/2020/05/10/2020.05.06.20093005.full.pdf
  13. 13. Guest JL, Sullivan PS, Valentine-Graces M, Valencia R, Adam E, Luisi N, et al, ZSuitability and Sufficiency of telehealth clinician-observed participant-collected samples for SARS-CoV2 testing: the iCollect Cohort Pilot Study [Internet]. JMIR Public Health and Surveillance. JMIR Public Health and Surveillance 6.2 (2020): e19054.
  14. 14. Hall EW, Sanchez TH, Stein AD, Stephenson R, Zlotorzynska M, Sineath RC, et al. Use of Videos Improves Informed Consent Comprehension in Web-Based Surveys Among Internet-Using Men Who Have Sex With Men: A Randomized Controlled Trial. J Med Internet Res 2017;19(3):e64. pmid:28264794
  15. 15. Breslow N. A generalized Kruskal-Wallis test for comparing K samples subject to unequal patterns of censorship. Biometrika Oxford Academic; 1970 Dec 1;57(3):579–594.
  16. 16. Bland JM, Altman DG. Multiple significance tests: the Bonferroni method. BMJ 1995;310(6973):170. pmid:7833759
  17. 17. Vaismoradi M, Jones J, Turunen H, Snelgrove S. Theme development in qualitative content analysis and thematic analysis. Sciedu Press; 2016; Available from: https://nordopen.nord.no/nord-xmlui/bitstream/handle/11250/2386408/Vaismoradi.pdf?sequence=3
  18. 18. Hall EW, Luisi N, Zlotorzynska M, Wilde G, Sullivan P, Sanchez T, et al. Willingness to Use Home Specimen Collection Test Kits for SARS-CoV-2 Testing for Research [Internet].JMIR Preprints 2020.Available at: https://preprints.jmir.org/preprint/19471.
  19. 19. Colfax GN, Lehman JS, Bindman AB, Vittinghoff E, Vranizan K, Fleming PL, et al. What happened to home HIV test collection kits? Intent to use kits, actual use, and barriers to use among persons at risk for HIV infection. AIDS Care 2002 Oct;14(5):675–682. pmid:12419117
  20. 20. Greensides DR, Berkelman R, Lansky A, Sullivan PS. Alternative HIV testing methods among populations at high risk for HIV infection. Public Health Rep 2003;118(6):531–539. pmid:14563910
  21. 21. Andersen RM. Revisiting the behavioral model and access to medical care: does it matter? J Health Soc Behav 1995;1–10.
  22. 22. MacGowan RJ, Chavez PR, Gravens L, Wesolowski LG, Sharma A, McNaghten AD, et al. Pilot Evaluation of the Ability of Men Who Have Sex with Men to Self-Administer Rapid HIV Tests, Prepare Dried Blood Spot Cards, and Interpret Test Results, Atlanta, Georgia, 2013. AIDS Behav 2018 Jan;22(1):117–126. pmid:29058163
  23. 23. Siegler AJ, Mayer KH, Liu AY, Patel RR, Ahlschlager LM, Kraft CS, Fish R, Wiatrek SE, Sullivan PS. Developing and Assessing the Feasibility of a Home-based Preexposure Prophylaxis Monitoring and Support Program. Clin Infect Dis 2019 Jan 18;68(3):501–504. pmid:29982304
  24. 24. Thurmond VA. The point of triangulation. J Nurs Scholarsh 2001;33(3):253–258. pmid:11552552