Reproducibility Initiative to increase the value of biomedical research

Public release date: 14-Aug-2012
[ | E-mail | Share ]

Contact: Hemai Parthasarathy
hemai@torchcommunications.com
415-813-6129
Torch Communications

Science Exchange partners with publishers and data repositories to encourage independent replication of valuable research

Palo Alto, California August 14, 2012 Science Exchange, in partnership with the open-access publisher PLOS and open data repository figshare, announced today the launch of the Reproducibility Initiative a new program to help scientists, institutions and funding agencies validate their critical research findings.

"In the last year, problems in reproducing academic research have drawn a lot of public attention, particularly in the context of translating research into medical advances. Recent studies indicate that up to 70% of research from academic labs cannot be reproduced, representing an enormous waste of money and effort," said Dr. Elizabeth Iorns, Science Exchange's co-founder and CEO. "In my experience as a researcher, I found that the problem lay primarily in the lack of incentives and opportunities for validationthe Reproducibility Initiative directly tackles these missing pieces."

The Reproducibility Initiative provides both a mechanism for scientists to independently replicate their findings and a reward for doing so. Scientists who apply to have their studies replicated are matched with experimental service providers based on the expertise required. The Initiative leverages Science Exchange's existing marketplace for scientific services, which contains a network of over 1000 expert providers at core facilities and contract research organizations (CROs). "Core facilities and commercial scientific service providers are the solution to this problem," said Dr. Iorns. "They are experts at specific experimental techniques, and operate outside the current academic incentive structure."

Scientists will receive the results of their validation studies and have the opportunity to publish them in the journal PLOS ONE as part of a Special Collection highlighting the importance of reproducibility in scientific research. They can also upload their primary data to the open-access repository figshare. Replications published in PLOS ONE will link back to the original publications upon which they are based. Prominent publishers, including Nature Publishing Group and Rockefeller University Press, have expressed their support for this acknowledgement of reproducibility.

The Reproducibility Initiative will potentially provide a mechanism for industry to identify robust drug targets for developing effective new therapies. "Improving the robustness of published data on early targets would have a significant impact on the efficiency of the drug development process," said Dr. Christopher Haskell, Head of the US Science Hub at Bayer HealthCare. "The Reproducibility Initiative seeks to address this challenge."

In agreement were Dr. Lee Ellis of MD Anderson and Dr. John Ioannidis of Stanford University, both Advisors to the Reproducibility Initiative. "It is critically important to independently validate preclinical data before moving to the clinic," said Dr. Ellis, who co-authored a widely read article in Nature earlier this year on the need to improve the reliability of preclinical cancer studies. Dr. Ioannidis, who published a study in PLOS Medicine titled "Why Most Published Research Findings Are False," also offered his support, stating "The Reproducibility Initiative is a very important pilot effort, offering valuable insights on how reproducibility checks can work in real life."

The Reproducibility Initiative is initially accepting 40-50 studies for validation. Studies will be selected on the basis of potential clinical impact and the scope of the experiments required and, in aggregate, may eventually serve as a proof-of-concept for this mechanism of validation to funding agencies and patient groups. Josh Sommer, Executive Director of the Chordoma Foundation, agreed with the potential promise of the Initiative, noting: "As a patient group ourselves, we can't afford to fund anything but research that is reproducible and robust enough to be developed into new therapies." Sommer will participate with Iorns and PLOS editor Dr. Elizabeth Silva in an upcoming webinar about the Initiative hosted by the advocacy organization, Faster Cures, in early September 2012.

Reproducible science incentives could build a foundation for robust translational research and improved therapies. "As awareness of irreproducibility grows, we wanted to provide a way for top quality researchers to distinguish themselves. This is truly a great opportunity for scientists with potentially groundbreaking results to garner direct validation of their work, and to lead the charge for reproducible science" said Dr. Iorns.

Scientists can submit their study for validation at: www.reproducibilityinitiative.org Core facilities or CROs can join Science Exchange at: www.scienceexchange.com/provider

###

REPRODUCIBILITY INITIATIVE SCIENTIFIC ADVISORY BOARD

The Scientific Advisory Board for the Initiative includes leaders from a variety of scientific disciplines who have championed the need for new ways to ensure the integrity and reproducibility of published research: Lee Ellis (University of Texas MD Anderson Cancer Center), John Ioannidis (Stanford University), Victoria Stodden (Columbia University), Bernard Munos (InnoThink Center for Research in Biomedical Innovation), Brian Nosek (University of Virginia), Bruce Booth (Atlas Ventures), George Robertson (Delhouise University), Heather Piwowar (Duke University), G. Sitta Sittampalam (NIH NCATS), and Elizabeth Iorns (Science Exchange).

ABOUT SCIENCE EXCHANGE

Science Exchange is a community marketplace for scientists to list, discover, and access scientific services from institutions around the world. Launched in August 2011, the company helps scientists find scientific service providers to conduct their experiments, and seeks to improve the efficiency of scientific research through collaboration. The company has been awarded by the Kauffman Foundation for entrepreneurship, and has received investment from Andreessen Horowitz, Crosslink Capital, Y Combinator and SV Angel.

---

[ | E-mail | Share ]

?

AAAS and EurekAlert! are not responsible for the accuracy of news releases posted to EurekAlert! by contributing institutions or for the use of any information through the EurekAlert! system.

Public release date: 14-Aug-2012
[ | E-mail | Share ]

Contact: Hemai Parthasarathy
hemai@torchcommunications.com
415-813-6129
Torch Communications

Science Exchange partners with publishers and data repositories to encourage independent replication of valuable research

Palo Alto, California August 14, 2012 Science Exchange, in partnership with the open-access publisher PLOS and open data repository figshare, announced today the launch of the Reproducibility Initiative a new program to help scientists, institutions and funding agencies validate their critical research findings.

"In the last year, problems in reproducing academic research have drawn a lot of public attention, particularly in the context of translating research into medical advances. Recent studies indicate that up to 70% of research from academic labs cannot be reproduced, representing an enormous waste of money and effort," said Dr. Elizabeth Iorns, Science Exchange's co-founder and CEO. "In my experience as a researcher, I found that the problem lay primarily in the lack of incentives and opportunities for validationthe Reproducibility Initiative directly tackles these missing pieces."

The Reproducibility Initiative provides both a mechanism for scientists to independently replicate their findings and a reward for doing so. Scientists who apply to have their studies replicated are matched with experimental service providers based on the expertise required. The Initiative leverages Science Exchange's existing marketplace for scientific services, which contains a network of over 1000 expert providers at core facilities and contract research organizations (CROs). "Core facilities and commercial scientific service providers are the solution to this problem," said Dr. Iorns. "They are experts at specific experimental techniques, and operate outside the current academic incentive structure."

Scientists will receive the results of their validation studies and have the opportunity to publish them in the journal PLOS ONE as part of a Special Collection highlighting the importance of reproducibility in scientific research. They can also upload their primary data to the open-access repository figshare. Replications published in PLOS ONE will link back to the original publications upon which they are based. Prominent publishers, including Nature Publishing Group and Rockefeller University Press, have expressed their support for this acknowledgement of reproducibility.

The Reproducibility Initiative will potentially provide a mechanism for industry to identify robust drug targets for developing effective new therapies. "Improving the robustness of published data on early targets would have a significant impact on the efficiency of the drug development process," said Dr. Christopher Haskell, Head of the US Science Hub at Bayer HealthCare. "The Reproducibility Initiative seeks to address this challenge."

In agreement were Dr. Lee Ellis of MD Anderson and Dr. John Ioannidis of Stanford University, both Advisors to the Reproducibility Initiative. "It is critically important to independently validate preclinical data before moving to the clinic," said Dr. Ellis, who co-authored a widely read article in Nature earlier this year on the need to improve the reliability of preclinical cancer studies. Dr. Ioannidis, who published a study in PLOS Medicine titled "Why Most Published Research Findings Are False," also offered his support, stating "The Reproducibility Initiative is a very important pilot effort, offering valuable insights on how reproducibility checks can work in real life."

The Reproducibility Initiative is initially accepting 40-50 studies for validation. Studies will be selected on the basis of potential clinical impact and the scope of the experiments required and, in aggregate, may eventually serve as a proof-of-concept for this mechanism of validation to funding agencies and patient groups. Josh Sommer, Executive Director of the Chordoma Foundation, agreed with the potential promise of the Initiative, noting: "As a patient group ourselves, we can't afford to fund anything but research that is reproducible and robust enough to be developed into new therapies." Sommer will participate with Iorns and PLOS editor Dr. Elizabeth Silva in an upcoming webinar about the Initiative hosted by the advocacy organization, Faster Cures, in early September 2012.

Reproducible science incentives could build a foundation for robust translational research and improved therapies. "As awareness of irreproducibility grows, we wanted to provide a way for top quality researchers to distinguish themselves. This is truly a great opportunity for scientists with potentially groundbreaking results to garner direct validation of their work, and to lead the charge for reproducible science" said Dr. Iorns.

Scientists can submit their study for validation at: www.reproducibilityinitiative.org Core facilities or CROs can join Science Exchange at: www.scienceexchange.com/provider

###

REPRODUCIBILITY INITIATIVE SCIENTIFIC ADVISORY BOARD

The Scientific Advisory Board for the Initiative includes leaders from a variety of scientific disciplines who have championed the need for new ways to ensure the integrity and reproducibility of published research: Lee Ellis (University of Texas MD Anderson Cancer Center), John Ioannidis (Stanford University), Victoria Stodden (Columbia University), Bernard Munos (InnoThink Center for Research in Biomedical Innovation), Brian Nosek (University of Virginia), Bruce Booth (Atlas Ventures), George Robertson (Delhouise University), Heather Piwowar (Duke University), G. Sitta Sittampalam (NIH NCATS), and Elizabeth Iorns (Science Exchange).

ABOUT SCIENCE EXCHANGE

Science Exchange is a community marketplace for scientists to list, discover, and access scientific services from institutions around the world. Launched in August 2011, the company helps scientists find scientific service providers to conduct their experiments, and seeks to improve the efficiency of scientific research through collaboration. The company has been awarded by the Kauffman Foundation for entrepreneurship, and has received investment from Andreessen Horowitz, Crosslink Capital, Y Combinator and SV Angel.

---

[ | E-mail | Share ]

?

AAAS and EurekAlert! are not responsible for the accuracy of news releases posted to EurekAlert! by contributing institutions or for the use of any information through the EurekAlert! system.

Source: http://www.eurekalert.org/pub_releases/2012-08/tc-rit081312.php

eastman kodak richard cordray shannon de lima joe torre west virginia university michele bachmann jessica biel