Epidemics of Bad Science vs Epidemics and Bad Science

Here’s a hot topic constantly resurfacing in the news, especially with the Omnibus currently proceeding at the US Court of Federal Claims, to wit: Is autism caused by vaccines? I won’t pretend that I’m going to capture everything in this controversy; there are too many players in the drama. (Autism Diva is keeping track of the daily news on the hearing.) However, this does make for an excellent case study in the scientific method. We get to look at concepts like incidence & prevalence, correlation vs causality, testimonials vs evidence-based medicine, and some general concepts in epidemiology. Could we possibly have any more fun?! (tongue-in-cheek joke)

When you read about autism, something noted most everywhere is the increasing numbers of children diagnosed. Surely, people say, there has to be something causing that to happen!

The whole vaccines-causes-autism story starts back in 1998,

when there was a research study in England by Dr Andrew Wakefield’s research group, touting a possible link between the MMR and autism. Additionally, in 2003 Dr Mark Geier and his son David came up with idea that no, it was the Thimerosal (a mercury compound used as a bactericide) in the vaccines that causes autism, which theory was later highly sensationalized as evidence for a big government conspiracy in David Kirby’s book, Evidence of Harm, and has been touted on various Web sites. There is also a small but vociferous number of parents who insist that their child was not afflicted with autism until vaccinated.

INCIDENCE & PREVALENCE

Epidemiology can be really tricky. We have to distinguish between the incidence of new cases, and the prevalence or overall number of cases in the population, and we also have to look at how things are diagnosed and recorded. For example, if you examine old historical records for tuberculosis, you won’t find much because it used to be called “consumption”, “scrofula”, “white plague” or several other things. It’s not that tuberculosis didn’t exist, but that it was identified differently, and people didn’t keep the same kinds of records at different times and places.

Likewise, the definitions of autism have changed and been expanded over the years to include a much broader spectrum of identifiers and labels (including Asperger’s Syndrome, which was added to the ICD10 in 1992, and the DSM-IV in 1994). Children that used to be diagnosed with conditions such as mental retardation or childhood schizophrenia would now be diagnosed as autistic. The diagnostic rates (which are not necessarily the prevalence rates) likewise increased from the earliest estimates for narrowly-defined autism at 5/10,000 to current estimates for broadly-defined autism at 1/166. (As Lorna Wing and David Potter point out, “…it is very difficult to make comparisons among studies done by different workers, at different times, in different places, using different definitions, and different methods of case finding and examination.”)

It is true that we are seeing more children (including autistic children) needing special education services. Because of changes in legal requirements for public schools (in the UK, the Disability Discrimination Act of 1995; in the US, the section 504 of the 1973 Rehabilitation Act, and the IDEA), schools now have to accept all children, regardless of disability, and to provide services for them. Formerly many children with disabilities were kept at home, were placed in institutions, or were unidentified and simply struggled through school. (Just ask adults with AD/HD how much fun school was.) School staff, parents and doctors are also more familiar with various disabilities that can affect learning (it’s hard to pick up a parenting magazine without running into articles on this or that), and consequently children are more likely to be assessed.

So now there are more children getting diagnoses, and also more students finally getting services because those services now exist. Sometimes the diagnosis a child receives depends partly on which sorts of services will likely be more useful for them, especially if a child has several conditions. It’s also interesting to note that over time, in some districts there appears to be some diagnostic substitution, where increase in autistic students roughly compares to the decrease in students diagnosed with other learning disabilities. It’s also one of those facts of bureaucracy that people don’t often keep records unless they have to, so a lack of historical records doesn’t necessarily indicate a lack of prevalence — just a lack of records. (This is what we mean by “absence of evidence doesn’t mean evidence of absence”.

The Wakefield study was alarming, and made a big news-splash, which in turn helped paved the way for the hysteria created by the Geiers’ paper. One of the key features to the scientific method is repeated tests of hypotheses, so further studies looking a the Thimerosal connection were done in Sweden, Denmark, England, Canada and the United States. None of those supported the mercury-autism hypothesis. In fact, since 1993, vaccines in Sweden and Denmark have not contained Thimerosal, but those countries continue to have new cases of autism being diagnosed. Likewise, to help reduce overall exposure to mercury from various sources, all pediatric vaccines have been free of Thimerosal since 2001, but this has not decreased the incidence of new autism diagnoses in the US either. A very recent US study also shows no connection between autism and RhIg (which also used to contain Thimerosal) and is given to mothers with Rh- blood type during their third trimester of pregnancy. Over in the US, in 2000, the Institute of Medicine (IOM) at the National Academy of Sciences, by request from the Centers for Disease Control and Prevention (CDC) and the National Institutes of Health (NIH), and the American Academy of Pediatrics (AAP), both examined the evidence for the MMR as a cause of autism, and dismissed the claims. They also noted that the timing of vaccinations, including the MMR, did not have any effect on the age of diagnosis. In Japan, the MMR was dropped in 1993 in favor of individual measles, mumps and rubella vaccines, and there has not been a decrease in the rate of autism following that change.

CORRELATION VS CAUSALITY

Question: does washing your car make it rain? It’s a funny joke because it’s absurd. But although one event might happen after another event, but that doesn’t mean the first caused the second. But it’s easy to understand how parents could believe that vaccinations caused their child to be autistic, as vaccinations are major and memorable series of events in a child’s life, and occur during the same time period as when many children are diagnosed with autism. However, correlation does not equal causality, post hoc ergo propter hoc. Vaccinations do not cause autism any more than does toilet-training, another major and memorable series of events in a toddler’s life. Current research indicates that various autism spectrum disorders are likely polygenic, which means caused by combinations of several genes. Various presentations of autism tend to run in families, and it affects more boys than girls.

Some parents who still struggle to come to terms with their child’s disability will seek a source of blame for causing the problem, and a cure. But what about those children who are purported to have been cured by, for example, chelation treatments? Chelation is used to remove toxic levels of heavy metals from the body. But an examination of the symptoms of mercury poisoning and those of autism show they have little in common. Although chelation therefore is not approved by the FDA as a treatment for autism, in 2005, a 5-year old autistic boy died of a heart attack resulting from chelation treatment. The chelator used drew too much calcium from his blood, causing cardiac arrest.

TESTIMONIALS VS EVIDENCE-BASED MEDICINE

There are a wide variety of unproven therapies out there that will supposedly cure any number of things, and those Web sites will have lots of testimonials. But of course, the plural of testimonial is not data. Human beings are prone to a number of (unconscious) cognitive biases, such as selective perception, investment bias (also post-purchase rationalization — we value something more when we’ve spent a lot of money on it), and/or the placebo effect. Sometimes the improvements seen in children being given treatment are simply maturation. Children with developmental disabilities by definition don’t develop “on schedule”, but over time they will still continue to mature, improve and make gains in abilities, albeit sometimes unevenly or in spurts. People want to see their children improve, so they associate the positive changes seen with any previous treatment, or treatments, as some people will employ several at once in desperate efforts for something to cure the problem. To get around these bias problems in scientific research, we use control groups, double-blind studies, and statistics.

In addition to potentially dangerous and potentially lethal “cures”, we still have the ever-present issue of dangerous and potentially lethal diseases. Just a couple decades after large-scale immunisations were put into place, it’s easy to forget just how dangerous these highly-infectious diseases were. In decades previous, children used to die at much greater rates; diseases such as tuberculosis, diphtheria, pertussis (“whooping cough”), polio, smallpox, measles (rubeola), mumps, rubella (“German measles”) and chicken pox would run through families, neighborhoods and cities, and one child of every ten would not even live long enough for their first birthday party. For those who lived, these diseases could lead to other issues, such as meningitis, deafness, blindness, sterility, and mobility impairment. (No, chicken pox is not nearly as serious as many of the other diseases, but a flare-up of shingles is hardly a walk in the park.) After the vaccine scare, immunisation rates in the UK dropped from 92% to 78.9%, and in 2006 a child in Britain died from measles for the first time in 14 years. In some areas of the UK, only one in nine children were getting the MMR. Of all the infectious diseases that can be prevented by vaccine, measles was and still is the most deadly, and is the cause of half of the one million deaths that could be prevented.

A vaccine is only effective in 85-95% of the immunized population (and a few people with compromised immune systems cannot take vaccines), so we rely upon “herd immunity” to help protect those vulnerable people by keeping the level of pathogen down to a very low level. According to the World Health Organization, it takes a 95% vaccination rate for herd immunity to prevail and prevent significant outbreaks, such as the mumps outbreak in the American Midwest last year. There were over 1,000 people infected, the largest in over 20 years. The outbreak was likely caused by a visitor from the UK, where the same virus genotype (G) has caused over 70,000 cases of mumps between 2004 and 2006. In the 1990’s, vaccination shortages in the former Soviet Union resulted in over 200,000 cases of diphtheria, leading to the deaths of 5,000 people.

Parents should be reassured that their children are much safer by being immunized, because diseases such as measles, mumps and rubella are not a thing of the past. These diseases can be very debilitating and life-threatening. They should be reassured that there is not good evidence showing any causal link between vaccines and autism.

9 Comments

  1. 11 April 2008 at 5:45

    […] 11 April 2008 at 5:45 (Gender / Sexuality, Learning Disabilities) Whenever I read statistics about the “increasing rates of autism”, I heave a big sigh. Those statements invariable contain a whole number of assumptions, many of them flat-out wrong, or at least unexamined. In the epidemiological data, there are diagnostic issues and census issues and statistical issues and of course, the inevitable agenda issues in the reportage of the census results and analyses. I’ve previously discussed a number of these problems, including incidence versus prevalence, and correlation versus causality in the post, “Epidemics of Bad Science vs Epidemics and Bad Science” […]

  2. qw88nb88 said,

    29 June 2007 at 15:02

    RAJ, you are building a straw-man argument. The leprosy study is unrelated to autism genetics studies, even indirectly. The leprosy study is looking at the genetic susceptibility toward a pathogen. In other words, some people are more resistant or susceptible than others toward a particular disease. This is not a novel concept — for instance, we can buy our tomato seeds by checking the catalogue descriptions for genetic qualities listed as “VFN”, which means the cultivar has genes making it resistant toward Verticillium wilt, Fusarium Wilt and Nematodes. In our personal lives we also know that some people are more resistant to say, a strain of rhinovirus, so some family members will catch the latest head cold and others won’t. In contrast, the autism genetics studies are looking at the combinations of genes that are unique to autistic people.

  3. RAJ said,

    28 June 2007 at 17:33

    You wrote:

    “Current research indicates that various autism spectrum disorders are likely polygenic, which means caused by combinations of several genes. Various presentations of autism tend to run in families, and it affects more boys than girls”.

    The current research is hypothesis driven, the polygenic theory is unproven. Looking at raw data and misinterpreting its meaning can also occur within respectable scientific circles.

    The genetic data published in autism over many decades is indistinguishable from the genetic data published in leprosy research, a condition whose cause, exposure to Myobacterium Laprae, was discovered over a hundred years ago.

    Twin studies from India found a very high concordance rate ( 60 85% ) in MZ twins and a rapid falloff in concordance rates ( 5 – 20% ) in DZ twins. Leprosy also tends to run in families with a sib risk ratio similar to what has been reported in autism, multiplex leprosy families have been recruited and genome wide scans are underway and there are as many candidate leprosy susceptabilty genes as there are in autism.

    There is also a 3:1 male female ratio reported in leprosy, based on the largest epedimiologic study of its kind, over 400,000 cases from China leprosy registries over a fifty year period.

    http://www.nature.com/ng/journal/v27/n4/full/ng0401_439.html

  4. medrecgal said,

    24 June 2007 at 13:37

    Thanks for showing some common sense regarding this insanity; it is, unfortunately, not the rule, and that’s why there’s this huge legal proceeding going on regarding parents who think their children were rendered “autistic” by big pharma’s “vaccine conspiracy”. The whole concept makes me ill; scaremongering is not good science! As you stated, changing definitions and better recognition are probably what’s mostly responsible for this supposed “autism epidemic”. Fortunately for a fellow “spectrum-ite”, there are some people out there with enough scientific background and sensibility to wade through all the junk and inanity.

  5. qw88nb88 said,

    23 June 2007 at 14:42

    You’re right, María, I have seen your comments concerning research on a number of other blogs, and like your other analyses, I am sure that another such reply would be would be very, very long, and that it would comprise a number of references from way out of the autism/immunology fields. I do believe that such analysis would be better served if you posted it on a blog of your own.

  6. Bug Girl said,

    23 June 2007 at 13:26

    Nice job!

  7. María Luján said,

    22 June 2007 at 21:44

    Hi
    My analysis, point by point , is different especially considering very recent published science from other fields than autism and other issues that are of my concern.
    Because I do not know if you can be interested on other view, please let me know if you are interested on a different view-It will be long :)
    Thank you-
    María Luján

  8. qw88nb88 said,

    22 June 2007 at 20:31

    Thank you, Steve. The story is so multifaceted that it’s hard to know where to begin! The back-stories behind the “research” of Wakefield, the Geiers, and others would absolutely fill a book describing conflicts of interest and bad science.

  9. Steve D said,

    22 June 2007 at 18:13

    This is perhaps the most straightforward, concise, clearly presented analysis of the MMR and Thimerosal “stories” as relates to autism causation that I have read. Good job!


Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: