Wednesday, 3 July 2013

The Society of Homeopaths and what passes for Evidence.

So today has seen some great news for rationality, science, and above all patients. The ASA has announced this ruling, leading to the Society of Homepaths taking down a rather large chunk of their website- the bit about what homeopathy can be used for.

However, using their search function, you can still find some of the nonsense they are promoting. I stumbled across this article, for example, entitled "Homeopathy Offers Alternative Relief for hay fever sufferers". I'd be very surprised if this article doesn't get taken down soon also, to be honest. It really should, given part of the ASA's ruling relates to their claims over the efficacy of homeopathy for hay fever.

That use of the word alternative (as opposed to complementary) is interesting. That in itself suggests that the Society of Homeopaths are advocating patients not using conventional medicines in favour of their homeopathic products.

One thing that I have learnt about homeopaths is that, despite the fact that they often claim that randomised controlled trials (and indeed science in general) can't explain their wondrous treatment because of its individualised nature and quantum nanoparticles blah blah all the other words that they're clinging onto, they like to cite trials. A lot.

Homeopaths will often spout names of trials and provide links to PubMed abstracts with abandon, even when the trials say little about the clinical use of homeopathy in humans. In vitro or animal trials are favourites, and on the odd occasion where I have been sent a human trial, the result usually show that homeopathy is no better than placebo, and in some cases actually worse than placebo. At best, I'm guessing this is just ignorance- maybe they have misread the results of the trial? At worst (and more realistically), its a pretty obvious and petty method of obfuscation, and a pretty rubbish one at that. Presumably they think I will be so vowed by the fact that a trial exists that I wont bother to check the actual results of what the trial is saying.

This hayfever page overs a great example of this:
"A number of research trials have shown that homeopathic treatment can produce a significant improvement in hay fever symptoms,(4-7) but what does this involve?"
 Let's have a look at the "number of research trials", shall we? 

Reilly DT, Taylor MA, McSharry C, Aitchison T. Is homeopathy a placebo response?
Controlled trial of homeopathic potency, with pollen in hayfever as a model. Lancet,1986;2: 881-6.
This is a trial from 1986. Really, that's the best they can do, in 2013? The abstract of this trial appears impressive: "The homoeopathically treated patients showed a significant reduction in patient and doctor assessed symptom scores", but neglects to mention the most important part of a study like this: blinding. How can we assess the placebo effect in a study that isn't blinded? especially when the results rely on only reported outcomes. We can tick this one off the list as being a pretty rubbish effort at a trial. Must try harder.

 Kleijnen J, Knipschild P, ter Riet G. Clinical trials of Homeopathy. Br Med J, 1991; 302:316-22.
Ahh, the early nineties. We're getting thoroughly modern and hip now, eh? This is a meta-analysis. hay fever isn't mentioned in the abstract at all, and the conclusion of the paper is that studies performed in homeopathy are rubbish, and better ones need to be done. Hardly a conclusive statement that homeopathy works for hay fever. We can tick this one off the list too.

We're now left with two trials to back up that statement above. To me, two trials is not "a number" of trials, even at this point. Even if these two trials were massive, robust, good quality randomised controlled trials, I still wouldn't be entirely convinced: I'd want to see the result replicated in as many different trials as possible. Anyway, we shalll soldier on, in the hopes of being dazzled by the brilliance of these two references.

Launsø L, Kimby CK, Henningsen I, Fønnebø V. An exploratory retrospective study of people suffering from hypersensitivity illness who attend medical or classical homeopathic treatment. Homeopathy, 2006; 95: 73-80.
Oh dear. A retrospective study. So not a controlled trial at all then? The results? "The two groups of patients were similar in respect of their health at the start of the treatment, 57% of the patients who consulted a CH experienced an improvement of their state of health compared to 24% of the GP patients." well, that's all very well and good, but there is no blinding here whatsoever, and only 88 patients completed the study. means nothing at all, except for- as even the authors put it- as an exploratory study, maybe to try to find ways of how to conduct as more robust actual trial in the future.

That's it, down to the final trial. I'm expecting great things. 

Kim LS, Riedlinger JE, Baldwin CM, Hilli L, Khalsa SV, Messer SA, Waters RF. Treatment of Seasonal Allergic Rhinitis Using Homeopathic Preparation of Common Allergens in the Southwest Region of the US: A Randomized, Controlled Clinical Trial. Ann Pharmacother, 2005; 39(4): 617-24.
HURRAH!!! It's double-blind! We've gotten there! We've gotten some good, robust evidence tha- oh hang on, its only got 40 participants in it.IT's just a wee ickle little study that's far too small to draw any conclusions from.

So there you have it. This page is still up there on their website, using crappy references that don't back up their claims. The Society of Homeopaths- and quacks in general- need to realise that, no matter how hard they try, just trying to shoehorn poor excuses for studies in wherever they like isn't good enough.

Here's how it should go: you look at the evidence, you evaluate the evidence, and you make your claim on the basis of that evidence. Not: "I shall claim this, then try desperately to find something that vaguely looks like it backs me up, and I'll just hope for the best that no-one else bothers reading it. It seems the Society of Homeopaths are going in for the latter, and good on the ASA for pulling them up on it.

"We told the Society of Homeopaths not to discourage essential treatment for conditions for which medical supervision should be sought, including offering specific advice on or treatment for such conditions. We also told them not to make health claims for homeopathy unless they held sufficiently robust evidence of efficacy." -ASA ruling