Article Text

Download PDFPDF

Disclosures of funding sources and conflicts of interest in published HIV/AIDS research conducted in developing countries
  1. Robert Klitzman1,2,
  2. Lisa Judy Chin3,
  3. Hoda Rifai-Bishjawish4,
  4. Kelly Kleinert1,
  5. Cheng-Shiun Leu2
  1. 1Columbia University College of Physicians and Surgeons, New York, New York, USA
  2. 2Columbia University Mailman School of Public Health, New York, New York, USA
  3. 3HIV Center for Clinical and Behavior Studies, New York State Psychiatric Institute and Columbia University, New York, New York, USA
  4. 4Columbia University School of Law, New York, New York, USA
  1. Correspondence to Professor Robert Klitzman, College of Physicians and Surgeons, Mailman School of Public Health, Columbia University, 1501 Riverside Drive, Unit 15, New York, NY 10032, USA; rlk2{at}columbia.edu

Abstract

Objectives Disclosures of funding sources and conflicts of interests (COI) in published peer-reviewed journal articles have recently begun to receive some attention, but many critical questions remain, for example, how often such reporting occurs concerning research conducted in the developing world and what factors may be involved.

Design Of all articles indexed in Medline reporting on human subject HIV research in 2007 conducted in four countries (India, Thailand, Nigeria and Uganda), this study explored how many disclosed a funding source and COI, and what factors are involved.

Results Of 221 articles that met the criteria, 67.9% (150) disclosed the presence or absence of a funding source, but only 20% (44) disclosed COI. Studies from Uganda were more likely, and those from Nigeria were less likely to mention a funding source (p<0.001). Of articles in journals that had adopted International Committee of Medical Journal Editors (ICMJE) guidelines, 56% did not disclose COI. Disclosure of funding was more likely when: ≥50% of the authors and the corresponding author were from the sponsoring country, the sponsor country was the USA, and the articles were published in journals in which more of the editors were from the sponsoring countries.

Conclusions Of the published studies examined, over a third did not disclose funding source (ie, whether or not there was a funding source) and 80% did not disclose whether COI existed. Most articles in ICMJE-affiliated journals did not disclose COI. These data suggest the need to consider alteration of policies to require that published articles include funding and COI information, to allow readers to assess articles as fully as possible.

  • Conflict of interest
  • developing world
  • disclosure
  • HIV infection and AIDS
  • research funding

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Disclosures of funding sources and conflicts of interests (COI) in published peer-reviewed journal articles have recently begun to receive some attention, but many critical questions about these activities remain. Readers' knowledge of authors' funding and COI are important because these may bias results. Indeed, a number of studies has shown that industry-sponsored studies tend to favour the sponsor.1 2 COI can occur in a variety of ways. A researcher may have financial or personal relationships with individuals or organisations that can bias his or her actions. Between a quarter and a third of academic investigators have some form of financial interest, such as consultant fees, honoraria and patent royalty payments.2 3 Yet documentation of COI often remains poor. For instance, a recent audit conducted by the Office of the Inspector General for the Department of Health and Human Services showed that the National Institutes of Health was unable to provide an accurate account of financial COI reports it had received from its extramural grantees during fiscal years 2004–6.4

Concerns about funding and COI have led to calls for authors to disclose funding sources and COI in journal articles. In 2001, the International Committee of Medical Journal Editors (ICMJE), a body of general medical journal editors that establishes guidelines on the format of manuscripts submitted to their journals, revised its guidelines on COI disclosures in manuscripts. Under the guidelines, authors are responsible for disclosing personal and financial relationships that might bias their work, and to ‘state explicitly whether potential conflicts do or do not exist’.5 COI disclosure has also become an important issue with various government agencies, such as the Centers for Disease Control and the Institute of Medicine.6 7

The proportion of peer-reviewed biomedical journals that have a COI disclosure policy has been increasing. While McCrary et al8 in 2000 and Krimsky and Rothenberg9 in 2001 showed that 43% and 15.8% of journals, respectively, had COI disclosure policies, Cooper et al10 in 2006 and Rowan-Legg et al11 in 2009 showed that the proportion had increased to 93%.

Disclosures of financial interests in a published study can impact readers' perceptions of the study. Declaration of competing interests has been found significantly to lower readers' level of interest, and perceptions of the importance, relevance, validity and believability of a published article.12 Readers rated an article's importance, validity and believability lower when it had a ‘financial interest’ compared with a statement that no financial interest was declared.13

However, researchers may not self-report COI fully or accurately. Indeed, ‘the potential for conflict of interest can exist whether or not an individual believes that the relationship affects his or her scientific judgement’.5 Individuals may fail to observe the effects of COI on their work. For instance, Chimonas et al14 has shown that physicians understand COI, but rationalise their interactions with pharmaceutical representatives. Physicians are influenced in their prescribing practices by relationships with pharmaceutical companies, while self-reporting that no such influence exists.15 Therefore, self-reported funding and COI disclosures by authors may not be wholly accurate. Weinfurt et al16 and Okike et al17 have shown inconsistencies in COI reporting practices by authors. For instance, of physicians at a large meeting, over 20% failed to report COI for directly related payments and 50% for indirectly related payments.17 Authors may also disclose a COI in an oral presentation at a professional meeting, but fail to do so in a journal publication that follows from the presentation, or vice versa. Bhattacharyya and Lin18 found that of 153 journal publications published 2 years post-presentation, 25.5% contained disclosure discrepancies.

Only a handful of studies have examined the extent of disclosures of COI, and even fewer reports have explored disclosures of sources of funding, and these reports have only looked at a few medical specialities. Of 1534 original oncology articles in eight journals in 2006, only 29% reported COI.19 Among 12 gastroenterology journals, funding was disclosed in 19–99%, with only one journal having funding source (either the presence or absence of one) disclosed in over 90% of its published articles.20 Overall, 31% of the articles in this study failed to report funding source and 54% failed to report COI. Of these 12 journals, 11 had COI policies and 10 had policies requiring authors to disclose funding sources. In the journals that had policies, we calculated, using the authors' published data, that 24% and 52% of the articles failed to disclose funding and COI, respectively. This suggests that while the existence of a policy was significantly associated with higher rates of disclosures of funding (p<0.001) and COI (p<0.001), a sizeable proportion of authors still failed to disclose in these journals with disclosure policies.

Mention of sources of funding, in addition to COI, is extremely important in articles to enable readers to assess for themselves, as best they can, whether the authors' self-reporting of COI appears correct—that is, whether results reported may be biased in any way because of either funding sources or self-reported COI. Conceivably, an author may report industry funding (eg, honoraria for speaking engagements), but then not mention any COI, nor report that no COI exist.

Moreover, COI are not always wholly objective, but may be complex and involve subjective judgements. For example, definitions of what constitutes a ‘related’ payment17 and what is ‘relevant’ in COI disclosure policies can be open to interpretation.21 Accurate reporting of funding and COI can thus let readers decide for themselves the appropriate level of trust and suspicion they should have in reading and assessing the article's findings and claims. Currently, this information may be seen by editors, but not readers, who then do not know if any funding or COI exist. Given growing concerns about COI, this dearth of data on the reporting of funding and COI is troubling.

Increasingly, research is being conducted in the developing world, but these issues have not been examined in these contexts. In a Medline search, we found only one paper, which was in Spanish and examined only one Chilean medical journal,22 but no published studies in English that examined rates of disclosures of funding and COI in articles presenting research conducted in the developing world. These issues are critical in these countries because, arguably, in resource-poor countries, money may have even more of an impact. Key questions thus remain—for example, how often funding sources and COI are disclosed in articles reporting on research conducted in the developing world; when such reporting does or does not occur; whether disclosures of funding and COI differ between countries and types of research, and if so, how; and what other factors, if any, are involved.

Therefore, given the burgeoning research in the developing world, and these critical unanswered questions, we decided to explore these areas—in particular, how often articles reporting on research conducted in four developing world countries disclosed funding sources and COI and what factors are associated with such disclosures. We choose to focus on HIV, because it is a crucial area of medical research in both developed and developing countries, as the pandemic affects approximately 30–36 million people worldwide.23 We chose India, Thailand, Nigeria and Uganda for this analysis because they have among the highest HIV prevalence in their respective geographical regions and the largest numbers of US-sponsored HIV clinical trials.24

Methods

We conducted a Medline search for all articles published in 2007 that met the following criteria: the research concerned HIV, and the research was sponsored by a developed country, but was carried out in one of the four aforementioned developing countries. We limited the search to papers with human subjects in English. From the search, we included all articles that were available online through our university medical library, which holds 117 264 serials (http://www.columbia.edu/cu/lweb/about/). We included only original research articles of studies involving human subjects, and excluded review articles, meta-analyses, letters, communications, brief reports, case reports, retrospective chart reviews, news articles and data obtained from public databases (ie, data collected for purposes other than research, such as state records and national epidemiological surveillance programmes). As this research did not involve human subjects, it was exempt from institutional review board (IRB) review at our institution. According to 45 CFR 46, the established code of human subject research regulation in the USA, the country in which we work, studies only require IRB review if they involve human subject research. These regulations define human subject research as involving a ‘living individual about whom an investigator…conducting research obtains (1) data through intervention or interaction with the individual, or (2) identifiable private information’. For this study, we did not interact with the authors of the published papers in any way, or collect any private information. Rather, we simply conducted a literature review, relying on publicly available, published articles. Moreover, we did not identify individuals in any way whatsoever.

Two research assistants, closely supervised by the senior author, independently coded the articles meeting the inclusion criteria. First, they each independently coded a sample of 10 articles, consisting of at least two articles from each country. They then developed a coding manual, and subsequently coded 10 more articles independently and compared the results, revising the manual as necessary. They coded additional sets of 10 articles independently, comparing results and discussing any disagreements until they reached complete consensus. All articles were then recoded using the final codebook. The articles were coded for factors in categories related to ethical characteristics (ie, mention of informed consent, financial and non-financial compensation and COI); study characteristics (ie, the type of intervention, the study being a clinical trial or not, and the study involving more than minimal risk or not); study population (ie, the study involving vulnerable populations); funding characteristics (ie, the source of funding being mentioned or not); authorship characteristics (ie, the percentage of sponsor authors is ≥50%, country of corresponding author and name of sponsor country); and journal characteristics (ie, the location of the journal editor and the journal being affiliated with ICMJE or not). To explore potential differences among countries, we assessed rates both between all countries in a four-way analysis and between each country compares with all other countries.

In this analysis, we chose mention of funding source or COI (ie, whether the article mentioned or did not mention the presence or absence of a funding source or a COI, respectively) as the primary outcome variables. We used χ2 tests to examine the association between mention of funding sources (or COI) with other characteristics of the article. We employed logistic regression analyses to identify further important associations of mention of funding sources. All variables associated with mention of funding source at p<0.10 in the χ2 tests were entered in the logistic regression model.

Results

As shown in table 1, of the 590 articles found on Medline searches, 221 (37.5%) met the inclusion criteria.

Table 1

Articles sampled meeting inclusion criteria

As illustrated in table 2, overall, of 221 articles, 150 (67.9%) disclosed the presence or absence of a funding source, but only 44 (20%) disclosed COI. Four-way analysis by country showed that there were significant differences in disclosures of funding source by country (p<0.001). Individual country analyses showed that studies from Uganda (vs all other countries) were more likely to mention funding source (p<0.001) and that studies from Nigeria (vs all other countries) were less likely to do so (p<0.001). There was a trend for studies from Nigeria to be less likely to mention COI.

Table 2

Disclosures of funding source and COI by country (n=221)

Table 3 summarises associations between disclosures of funding or COI versus independent variables that reflect ethical and other characteristics of the published studies. Disclosures of funding and COI were associated with each other as a trend (p=0.010). Disclosure of funding was associated with articles having: 50% or more sponsor authors (83% vs 57.9%, p<0.001), corresponding author from the sponsor country (83% vs 49.5%, p<0.001), USA as the sponsor country of research study (p<0.001), and the journal having editors from sponsor countries (p<0.001). Disclosure of funding sources was correlated as a trend with the published study being a clinical trial (85% vs 33.8%, p=0.085), and the journal being ICMJE-affiliated (80.6% vs 65.4%, p=0.075). COI disclosure was associated with the study being biomedical rather than psychosocial (24.4% vs 12.8%, p=0.034) and the journals being affiliated with ICMJE (44.4% vs 15.1%, p=0.001), and was correlated as a trend with the published research being a clinical trial (35% vs 18.4%, p=0.076).

Table 3

Relationship between disclosure of funding and COI with other characteristics of articles (n=221)

Given that articles from Nigeria were less likely to disclose, and those from Uganda were more likely to disclose, we analysed these data further, and found that studies conducted in Nigeria, compared with those in other countries, were more likely to be psychosocial (64.7% vs 34.2%, p=0.001) and less likely to be clinical trials (0% vs 10.7%, p=0.046).

We entered the variables that were associated significantly or as a trend with disclosure of funding (country where the research was conducted, mention of COI, study being a clinical trial or not, percentage of sponsor authors, country of corresponding author, sponsor country of research study, journal's compliance with ICMJE guidelines and journal editor's location) into a logistic regression model. As country was a categorical variable, we created an indicator variable using Nigeria as the reference group. As shown in table 4, the country where the study was conducted was shown to be significant, and mention of COI and the USA being the sponsoring country of research showed a trend in significance in predicting disclosure of funding. For COI, as a limited number of variables were significantly associated with disclosure of COI, we did not perform a logistic regression analysis.

Table 4

Logistic regression model for associations between article characteristics and mentioning of funding source (n=218)

Discussion

More than a third of the published studies we examined did not disclose funding source (ie, whether there was a funding source or not) and 80% did not disclose COI (ie, whether or not there was a COI). Disclosure of funding source was associated with the country where the research was conducted. Funding disclosure was also more likely when: 50% or more of the authors were from the sponsoring country; the corresponding author was from the sponsoring country; the sponsor country was the USA and the article was published in a journal in which more of the editors were from sponsored countries. These findings may reflect the possibility that research in which sponsoring countries is involved is more likely to involve funding. However, research without funding should, arguably, also list the fact that no funding was involved, rather than failing to state in any way whether funding was or was not present. Researchers from sponsoring countries may also be more concerned about funding and potential COI, as a result of increased training and sensitisation about these issues.

Disclosure of COI was significantly associated with the type of study intervention (biomedical vs only psychosocial), and the journal listing itself as complying with ICMJE guidelines. Still, importantly, most articles in journals affiliated with ICMJE guidelines did not in fact disclose COI.

The fact that a third of the sampled published articles did not disclose funding and 80% did not disclose COI is of concern. In comparison, Bhargava et al20 found among 12 gastroenterology journals that 33% and 58% of articles did not disclose funding sources and COI, respectively, and Weinfurt et al16 found that 71% and 83% of articles on coronary stents did not include statements concerning funding source and COI, respectively. Jagsi et al19 found that 71% of articles in oncology did not report COI. The rates of non-disclosures of COI we found were thus higher than those in studies of articles on gastroenterology and oncology. Rates of non-disclosure of funding sources were comparable to those found in gastroenterology articles, but lower than rates of non-disclosures of actual funding (ie, statements that no funding existed) among articles on stents, as the study by Weinfurt et al16 reported simply whether articles stated that funding existed or not. The study by Weinfurt et al16 did not differentiate between articles that stated that ‘no funding was involved’ compared with those that made no statement as to whether funding was present or not. However, some of the articles that did not state that funding existed may have in fact had no funding. Therefore, if the articles had stated that fact, the frequency of non-disclosure would have decreased, possibly making it more comparable with the rate in our data. In all, the rates of non-disclosure of COI that we found in articles reporting on research in the developing world were higher than rates found among articles on oncology and gastroenterology—most of which we assume reported on research conducted in the developed world.

It is possible that some of the non-disclosing articles in our sample also did not involve funding. However, given the potential for biased study findings, disclosing that there was in fact no funding or COI, if that is the case, is crucial to assure readers that the study results are indeed impartial. It is also troubling that although ICMJE-affiliated journals have adopted guidelines on disclosing COI,5 most of the articles we examined, even in these journals, do not mention COI, and almost a fifth do not disclose funding.

Importantly, ICMJE guidelines still do not necessarily provide the reader with these critical pieces of information regarding funding and COI. Rather, access to this information may be limited only to the journal editors. For an article that does not mention funding or COI in any way, the reader still does not know whether no funding or COI exist, or if one or either of these features may exist, but have simply been disclosed to the journal editors and not to the readers. Given the importance of this information for assessing the authors' findings, such ambiguity is very troubling.

Moreover, to date, over 800 journals have signed up to the ICMJE guidelines, but this represents only 6% of all active biomedical journals in the world.5 Of the articles examined in the present study, only 16% of these articles are in ICMJE-affiliated journals.

The data here thus suggest the importance of giving serious consideration to the possible alteration of journal and ICMJE policies to require that funding and COI information be included in all published articles themselves, to allow readers to assess the article as fully and appropriately as possible. Although one could potentially argue that these suboptimal rates of disclosures concern merely compliance with policies, these data highlight how current policies—at least of ICMJE-affiliated journals—are inherently flawed in that they permit this ambiguity. Therefore, the present study highlights the need for articles reporting on studies that did not receive any funding to state that fact (ie, that no funding was involved), in order to eliminate any ambiguity about whether such funds (and thus of the possibility of COI) were present or absent.

This study has several potential limitations. We examined individual articles rather than journals. However, these data, suggesting relatively low rates of disclosures of funding and COI, are consistent with the handful of earlier studies that have been done—that is, of articles on oncology19 and gastroenterology.20 We did not contact each journal individually. However, previous research has shown that 93%11 of journals have COI policies, but that most articles in journals that have COI policies or have adopted ICMJE guidelines do not report COI.19 20 Weinfurt et al16 also found that among articles on coronary stents in ICMJE-affiliated journals, 66% and 75% did not disclose funding source and COI, respectively. Our data, too, show that even among articles in journals that have policies (ie, have officially signed up to the ICMJE guidelines), 19.4% did not disclose funding and 55.6% did not disclose COI. Both our data and past studies thus suggest that current ICMJE guidelines, endorsed by these journals, appear insufficient for providing all readers with this crucial information. One could argue that these authors may have communicated COI and funding to the journal editor and simply not included these important characteristics of the research in the article. However, as above, given rising concerns about funding and COI, our data highlight how this crucial information should also, arguably, be in papers themselves so that readers can readily see this information. Those articles that did not list funding may not have involved any, but given how relatively little is known about these issues ‐ rates of such reporting and factors that may be involved—our goal in the present paper was to explore whether any reporting occurs or not, and if it occurs, what it consists of. We did not contact the authors of these articles themselves directly to assess whether funding or COI were in fact present, because we wanted to examine the information that readers themselves would ordinarily see in reading and evaluating a published article (ie, without themselves having to go to the trouble of contacting the authors for funding and COI information to help gauge whether any bias may be present). Many readers may assume that funding and COI, if not disclosed, are in fact absent, but, as mentioned earlier, that might not in fact be the case. Therefore, the presence or absence of funding and COI information should, we think, be explicitly stated in the articles themselves.

In short, as the first study in English that we know of to explore these issues with regard to research conducted in the developing world, these data, concerning whether and when this information is provided in these articles, shed important light on these corncerns. These findings can help inform future discussions, practice and research, suggesting the need to alter policies to reduce ambiguity and increase rates of such reporting.

References

Footnotes

  • Funding LJC is a post-doctoral research fellow currently supported by a training grant from the National Institute of Mental Health (T32 MH19139) at the HIV Center for Clinical and Behavioral Studies (P30-MH43520; principal investigator Anke A Ehrhardt PhD). This study was supported by a NIH grant (5R01HG04214) on ‘Views and Approaches to Research Integrity Among IRBs’.

  • Competing interests None.

  • Provenance and peer review Not commissioned; externally peer reviewed.

Other content recommended for you