SciTech

Breaking Scientific News: Vaccines --> Autism Paper Retracted!

pO157.

Posted to SciTech on Thu Feb 04, 2010 at 08:07:49 AM EST (promoted by port1080). RSS.

There has been quite a bit of controversy regarding the idea that vaccines may not be completely safe. Much of this centered around a 1998 paper published in the reputable journal The Lancet which stated that vaccines were related to Crohn's disease and autism. The journal recently retracted (full access requires subscription) this article, claiming unreported conflicts of interest, falsification of methods and unethical content required it to be withdrawn from the scientific record.  

The Lancet has only retracted "10 or 15" studies in its entire 186 year history. However, this week the journal retracted a paper published by Dr. Andrew Wakefield a decade earlier. This paper, released to considerable fanfare and media hooplah, claimed vaccines (specifically the measles, mumps, rubella shot) caused GI disorders and autism. One of the more high profile journals in science, The Lancet publication gave Dr. Wakefield and other vaccine critics considerable ammunition to claim that the widely accepted treatments (which prevent dangerous diseases). This vaccine scare has been blamed for new outbreaks of previously unseen diseases.  

The Lancet stated that Dr. Wakefield's study did not truly pick patients in an unbiased and random manner and also acted unethically. It also charged that he subjected his patients to unneeded and unapproved invasive treatments, including colonoscopies, MRI scans and did other unethical things such as took blood from guests at his childrens' birthday parties.

The fallout from this paper was profound. Massive drops in vaccination compliance soon occurred across the first world, and thousands became infected with epidemics not seen in decades. Facing revocation of his medical license in the UK, Dr. Wakefield now practices medicine in Texas where he serves as the executive director of a foundation dedicated to autism research.

Shares of vaccine companies skyrocketed in stock trading after the news.

Tags: edited by Port1080, written by pO157, autism, vaccines, science, controversy, Lancet (all tags)

This story: 6 comments (1 from subqueue)
Post a Comment
1

Dirty secret of scientific peer review...

port1080.

Thu Feb 04, 2010 at 09:05:00 AM EST

5.00 (informative)

One of the big arguments for peer review is that it should guarantee that all experiments are repeatable.  In the article the author is expected to lay out his or her methodology in such detail that anyone who wants to could repeat the experiment and get the same result.  Seems foolproof, but there are two problems.  The first is that much of the time the experiment is so time consuming that it's not practical for someone to duplicate it just to verify the article - so as long as everything looks plausible, most of the time the reviewers don't bother to duplicate the experiment.  The second, and bigger (in my mind) problem is that a lot of times the raw data is not included in the article or made available.  The article will report results, but the raw data the results were drawn from is kept back.  This is somewhat understandable (usually the biggest part of the work is in gathering that raw data to begin with, so scientists don't want someone else to take that raw data they worked so hard to gather and just use it for free), but it can also lead to problems because without the raw data, it's much harder to check for errors.  Hiding the raw data can also lead the public to think the scientist has something to hide (see the controversy over not release raw climate change data), and of course sometimes the scientist does have something to hide (as in this case).  

Scientific research needs to be opened up.  Any project that gets any government funding at all should be required to upload all raw data into a computer database for public perusal (something like the ICPSR database for social science research, but mandatory instead of voluntary), and provide a link to the data in any article that is published based on the data.  It would also be good if reviewers took their jobs a little more seriously, and approved articles based on merit rather than whatever is the fad of the day, but humans being humans that's unlikely to change anytime soon...

Ce n'est pas une pipe. C'est une signature.

2

^ 1

Re: Dirty secret of scientific peer review...

pO157.

Thu Feb 04, 2010 at 11:24:06 AM EST

4.00 (reproducible, interesting, informative)

As a scientist who has submitted papers to peer review at various journals (and even had one rejected by my peers) I'm getting a kick out of these replies.

You are correct when you say that reviewers and editors are not going to duplicate an experiment. They won't. That's not their job. Their job is to review the study design for obvious flaws and determine if the data supports the conclusion. They also have other duties, such as making sure a paper fits within the journal's intended "scope" (otherwise you'd have a neurology paper in a molecular biology journal or something crazy).

So, where does the data go? Most journals (at least all the good ones, and all the good reviewers will, anyway) demand that any sequence data (DNA, RNA, proteins 'decoded') be deposited in a public, government database and the access numbers be printed in the paper. Therefore, anybody who has questions about that can quickly refer to the primary sequence data.

Also, many groups make gene knockouts (they "erase" a gene from an organism to see what it does) or add genes in. In many/most fields, these authors are required to either send these constructed organisms to a public repository or state that they will allow others free access to what they made so this can be carried out.

Usually this is enough. This way, if a person makes a claim other groups can access their strains & sequences to try to duplicate it on their own. I've seen more than enough papers in my field where somebody made a claim (usually its the bolder, more outrageous ones that are disproven the quickest), and it's generally not well accepted because nobody else can duplicate it. Then somebody gets their strains or looks at their sequence data and finds out the first group was wrong for some reason.  

Of course, this is different from people fraudulently lying or being malicious with their results. It is very difficult to prevent liars from getting work published, if they are good enough. However, the steps listed above usually mean the person will be detected eventually. When that happens, these guys come knocking. If the allegations are true that a scientist lied or forged data, then they get an article written about their shenanigans here (pdf of a sample newsletter, see page #8 and on --- you can see all the ones ever printed here) and at that point you might as well apply for a job as a garbageman because you are done in science forever.

Problem is, this takes time. Good science and detecting fraud (which is probably less than one .01 of a percent of all work). I've worked on projects that have taken half a decade before their first publication. This leads into the next problem and associated rant. Much of the problem stems from the fact that people want their shit and they want it now (this is a cool article, I think I may write it up for a diary or something). And the sciences are grossly underfunded. We have money for (insert the usual litany of my complaints) but we don't have money for space exploration or other science & engineering projects. If we're mortgaging our children and grandchildren's future we might as well spend the cash on something that will benefit them.

Never compromise.

3

^ 2

Re: Dirty secret of scientific peer review...

Lou.

Thu Feb 04, 2010 at 11:36:36 AM EST

none

people want their shit and they want it now

I don't want to go too far off topic...but isn't this one of the ways the market works?

Why does reduced fat Swiss cheese have twice as many holes are regular Swiss cheese?

4

^ 3

Re: Dirty secret of scientific peer review...

pO157.

Thu Feb 04, 2010 at 11:59:50 AM EST

3.00 (sycophantic)

Actually, I was going to bring this up. I think science is somewhat like the ultimate free market system. There is tremendous competition between labs to find the solution to certain problems - the best researchers with the best method who can work the most efficiently tend to get there first. This means that while there are a variety of methods out there to solve problems researchers tend to go for the best ones. Since money is a limiting factor (usually, unless you get yourself a Howard Hughes Investigator gig) people try their hardest to save money (I did my MS on easily less than $5k in lab supplies) and work efficiently.

While the idea of "If you ain't first, yer last" sounds harsh, and it is, it results in the best R&D pipeline possible.

Never compromise.

5

^ 4

Re: Dirty secret of scientific peer review...

zyxwvutsr.

Thu Feb 04, 2010 at 12:48:57 PM EST

none

I did my MS on easily less than $5k in lab supplies
What was the price of gold then?

6

^ 5

Re: Dirty secret of scientific peer review...

pO157.

Thu Feb 04, 2010 at 01:43:56 PM EST

none

Trading at about $430/ounce.

Never compromise.

This story: 6 comments (1 from subqueue)
Post a Comment