The APA Continues To Handle Its Own Scientific Integrity Complaint

In October the American Psychological Association released a statement in response to allegations made by author James Risen.  In his book Pay Any Price: Greed, Power, and Endless War Risen alleges that the Association colluded with the Bush Administration in developing ‘enhanced interrogation’ techniques that most would consider torture.

It’s a very serious allegation, and the APA has taken pains to rebut the allegation through describing Rosen’s very limited interaction with the Association during the writing of his book, as well as its official policy on torture.

Not satisfied with those efforts, the APA announced that it has hired counsel to conduct an independent review of Risen’s claim.  Three members of the APA Board of Directors will coordinate the review, but APA promises an independent review.

“The review will include but not be limited to the following three issues: 1) whether APA supported the development or implementation of “enhanced” interrogation techniques that constituted torture; 2) whether changes to Section 1.02 of the APA Code of Ethics in 2002 or the formation and/or report of the APA Presidential Task Force on Psychological Ethics and National Security (PENS Task Force) were the product of collusion with the government to support torture or intended to support torture; and 3) whether any APA action related to torture was improperly influenced by government-related financial or policy considerations, including government grants, contracts or adoption of government policy regarding prescription privileges for psychologists serving in the military.”

Once the independent investigator completes the investigation Continue reading

Biomedical Journals Lay Down Some Transparency Markers

Both Nature and Science are noting in their latest issues the results of a June conference they co-convened with the National Institutes of Health (NIH).  At that conference, editors from over 30 journals, along with other scientific leaders in biomedical fields, met to discuss principles and guidance for reporting pre-clinical research.

A proposed list of principles and guidance were developed at the conference.  While the emphasis is on biomedical research, the principles strike me as generalizable to other fields of research.  I’ve summarized them below:

  • Rigorous statistical analysis – checked by the journal and policies disclosed in information for authors
  • Transparency in reporting – use a checklist to ensure reporting relevant methodological and analytical information to reviewers and readers.  Have ample space for methods sections, either in print or online.  Establish a clear set of reporting standards, which would include statistics, randomization, replication, presence of blinds, estimation of sample size, and inclusion/exclusion criteria.
  • Data and material sharing – All datasets should be made available on request during manuscript review, and based on reasonable request following publication.  Datasets should be placed in public repositories when possible, and in machine readable format
  • Refutations – Journals should have a policy assuming responsibility to consider publishing refutations of papers it has published.
  • Best Practice Guidelines – Journals should consider such guidelines for image based data, and descriptions of biological material (sufficient to uniquely identify source and relevant data)

May I suggest that if you are considering a journal for publication, that you see how many of these guidelines (or their discipline-appropriate equivalents) the journal follow?

 

PCAST And Bioethics Commission Double Up On BRAIN

Both the President’s Council of Advisers on Science and Technology (PCAST) and the Presidential Commission for the Study of Bioethical Issues will meet next month.

The Bioethics Commission will meet November 5 and 6 in Salt Lake City, Utah.  As is customary, the meeting will be webcast and updates will be posted on the Commission’s blog.  The agenda is not yet available, but based on the Federal Register notice, the BRAIN Initiative will be one focus of the meeting, as will education and deliberation in bioethics.

The next PCAST meeting is on November 14th.  As has become custom, the public session will be from approximately 9 to noon on a Friday in Washington, D.C., and the meeting will be webcast.  No agenda, draft or otherwise, is presently available.  Per that meeting’s Federal Register notice the meeting should cover the BRAIN Initiative as well (though with an emphasis on the private sector investments).  Other topics will likely include Ebola, space sciences and science and technology related to national security.

Study That Prompted Allegations Of NIH Interference Found Wanting

In March 2013 the Office for Human Subjects Research Protections (OHRP) at the Department of Health and Human Services (HHS) found that some of the informed consent provisions associated with the a study at the University of Alabama, Birmingham were lacking.  In June OHRP sent a subsequent letter to the researchers indicating it would put its planned sanctions on hold.

In between March and June, HHS and National Institutes of Health officials interacted with OHRP staff, and that interaction prompted allegations of improper influence.  The HHS Office of the Inspector General found no evidence of wrongdoing in its investigation.

But that doesn’t end the story, since OHRP put its actions on hold.  That hold ended on Friday.  Rather than implement sanctions against the researchers, OHRP has issued a call for comments on proposed informed consent guidelines.  The proposed guidelines affect the application of human research protections to cases of ‘standard of care research.’  The major questions concern what risks could be considered ‘reasonably foreseeable’ and how those risks should be described to prospective subjects.

In the case of the SUPPORT study that prompted this whole process, there was disagreement over whether or not the study protocols put subjects at risks that warranted disclosure.  OHRP felt that since the risks were greater than what subjects would reasonably expect without treatment, notice was required.  Others argued that because the treatment under study was within the standard of care for the condition, that no disclosure was required.

OHRP is taking comments until December 24, and will issue final guidance sometime in early 2015.

China’s Rising Scientific Enterprise Still Has A Big Quality Control Problem

Yes, China is increasing its scientific enterprise in terms of people and research output.  And while the relative quality of that research is likely improving to the level found in more established research systems, there appears to be at least one significant impediment to that improvement.

Nature News reports on another instance of corruption affecting Chinese scientific research.  This time its the misuse of over $4 million U.S. awarded to five research universities.  Seven scientists were named, and six are currently detained.  Two of those six have already started prison terms.

(For what it’s worth, even though it’s Chinese prison, I’m sympathetic to this level of punishment for the kinds of misconduct involved here.)

I suffer no illusion that other research systems are perfect.  But the kinds of scientific misconduct in other countries do not raise to the level I’ve seen reported in China.  Hopefully that will change, but in the meantime, I think it is something that should be part of any thorough analysis of the value in research, regardless of country.

Nobel Laureate Has A Play On Science Ethics

Should’ve has been around since 2007, but I didn’t discover it until I saw this notice of an upcoming reading at the National Academy of Sciences building.  Written by Roald Hoffman, a Nobel Laureate in Chemistry and member of the National Academy of Sciences, Should’ve traces the impact of one scientist’s suicide on members of his family.  The suicide was prompted (at least it seems), by the social implications of the man’s research, but the picture is more complicated than that.

Hoffman has written or co-written two other plays.  Oxygen wrestles with the late-18th century ‘discovery’ of the element and the associated theories around what the element actually is.  Something That Belongs To You is a semi-autobiographical work.  This is in addition to his research output and his poetry.  He also founded and helps organize the Entertaining Science cabaret series at the Cornelia Street Cafe in New York City.  (and yes, I’m envious.)

Follow-up Saturday – NIH Cleared On Ethics Case, May Proceed On Common Rule

Earlier this year I wrote about a case where the National Institutes of Health (NIH) was alleged to have acted improperly in a case involving a research study.  Public Citizen lodged a complaint with the Department of Health and Human Service’s (HHS) Office of Inspector General claiming that senior officials from the NIH and HHS interfered with the decision process of the Office for Human Subjects Research Protection (OHRP).  The specific case involved a research study on premature infants and optimal oxygen levels.

Earlier this month the Office of Inspector General issued its report on the allegations (H/T ScienceInsider).  The main conclusions were that senior NIH and HHS officials did not interfere in the initial decision of the OHRP, and that the subsequent communications between those officials and the OHRP was permissible under the law.  The OIG issued a separate report on how OHRP conducted its evaluation of the research study.  Public Citizen is not happy with the decision, characterizing the investigation as a ‘whitewash.’

While the OIG report indicated that OHRP is not an independent organization, part of the Public Citizen complaint indicated (page 2) that moving OHRP out of the NIH was done in part to insulate the office from interference by NIH officials.  It seems worth revisiting whether or not OHRP and related ethics organizations within HHS and NIH should be independent from those entities.

In related news, the ScienceInsider article (and the behind a paywall, Chronicle of Higher Education reporting it references) suggests that OHRP may soon be ready to issue new proposed rules on human subjects research.  This would seem to be forward progress on the Common Rule, which was the subject of a public comment period back in 2011.  As it hasn’t be revised in decades, it’s long overdue.