Absurdities Arising from Indiscriminate Use of Research

Breakthrough research reveals parachutes don’t prevent death when jumping from a plane | Association of Health Care Journalistsby Tara Haelle – Feb 2019

The goal of evidence-based medicine (EBM) is to base medical care only on the best evidence: rigorous randomized controlled trials (RCTs). In general, this seems to make sense, but as an overarching objective applied to all cases, it can become absurd.

It’s been 15 years since BMJ published the most rigorous type of study there is — a systematic review of randomized controlled trials — to assess the evidence for using a parachute to prevent death and major injury when jumping from a plane.

They had to conclude, “As with many interventions intended to prevent ill health, the effectiveness of parachutes has not been subjected to rigorous evaluation by using randomized controlled trials.”  

But at long last, an RCT on this topic exists.

The absence of randomized controlled trials for a certain medical intervention does not mean that the intervention cannot be safe and effective.

And, an RCT often would be unethical, as I noted in a past blog on the “tyranny of the RCT.” Sometimes, well-designed observational studies must suffice.

And common sense matters too. After all, if you had 100 people diagnosed with dehydration, you wouldn’t give water to only half of them and see what happens to the other half.

But what is common sense to some of us may be completely unknown to others.

For example, it’s obvious to most pain patients that more severe pain requires higher doses of opioids. The inverse is also usually true, that if people are taking high doses of opioids, it means they are in more pain (in general and when drug metabolism isn’t an issue).

Yet in opioid research, increasing doses are correlated with negative outcomes while the positive pain-relieving effects are completely ignored. Researchers design and report their studies as though the doses of opioids taken were “independent variables” and not correlated with anything significant, like pain.

This is making the current glut of opioid research mostly useless and even deceptive because it doesn’t control for (or even mention) the level of pain that is relieved by opioids.

It’s like running a study to find adverse effects of blood-thinners and, like with opioids, report only on negative outcomes like fatigue and dizziness (common side effects of these medications) without mentioning that

When medication doses are studied without taking into consideration what the medication is being used for, the results become nonsensical.

If blood-thinners or other critically necessary drugs were studied and condemned for their side effects like opioids are, no one would take any medications at all.

The authors then poked fun at evidence-based medicine advocates who “have criticized the adoption of interventions evaluated by using only observational data” with a recommendation:

“We think that everyone might benefit if the most radical protagonists of evidence-based medicine organized and participated in a double-blind, randomized, placebo-controlled, crossover trial of the parachute.

(Note: A crossover trial means every participant will eventually jump from the plane without a parachute.)

Ah, but the method of madness matters!

  • The non-participating passengers flew at 800 km/hr at an altitude of 9,146 m, but
  • the trial participants jumped a whopping 0.6 meter (2 feet) from a plane traveling at an incredible 0 km/hr.

The authors point out their trial’s glaring limitation — an inability to generalize to higher altitude jumps — and use it make a point that health journalists would be wise to remember:

“When beliefs regarding the effectiveness of an intervention exist in the community, randomized trials might selectively enroll individuals with a lower perceived likelihood of benefit, thus diminishing the applicability of the results to clinical practice.”

Put plainly, if most people already think an intervention works, then an RCT may end up with enough bias in its design that the conclusion ends up clinically meaningless.

I’ve been complaining about this for a long time: Opioids Blamed for Consequences of Chronic Pain

Author: Tara Haelle (@TaraHaelle) is AHCJ’s medical studies core topic leader, guiding journalists through the jargon-filled shorthand of science and research and enabling them to translate the evidence into accurate information.

5 thoughts on “Absurdities Arising from Indiscriminate Use of Research

  1. canarensis

    A study for “…evidence for using a parachute to prevent death and major injury when jumping from a plane”?!?!
    That sounds like something from the Journal of Irreproduceable Results, &/or the Ignobel Award. Oy freaking vey.
    There is some basis for non-science types to conclude that science types are moronic lunatics…unfortunately.

    Liked by 1 person

    1. Zyp Czyk Post author

      It was just a science gag, but it did prove the point.

      As to whether scientists are moronic: at UCSD in the 70’s, my boyfriend once found the famous Dr Harold Urey sitting on the curb in the parking lot. His car had a flat, and he had no clue what to do, so my boyfriend changed the tire for him.

      Liked by 1 person

      1. canarensis

        I know there’s a real good reason for the creation of the “absent-minded professor” stereotype…tho I do know quite a few non-science types who couldn’t change their tire if their life depended on it, tho that is a really good example!

        Liked by 1 person

  2. canarensis

    Part 2:
    “If blood-thinners or other critically necessary drugs were studied and condemned for their side effects like opioids are, no one would take any medications at all.”
    Very true. I pointed this out at one of the meetings of the Oregon Zealots, when they got nearly hysterical stating that (something like) 85% of opioid takers report SOME type of side effect from the medicine. I said this is true for every medicine ever created, but they just sorta sneered at me, like I was the unreasonable one.

    Liked by 1 person

  3. leejcaroll

    The problem frommy perspective i n doing studies on pain patients is that the researchers must rely on subjective responses from the participants. Is your pain better? How much better? I just had a deep brain stimulator implant implanted. I am part of a study, actually participant number 1. I have to answer ?’s sporadically. how does the pain feel. what is the number you assign to our pain. Tell me which of these words describe your pain. All answers by definitiono have to be subjective. so studies on how ae opioids working, helping your pain also rely only on subjective. Until there is a good way to objectively evaluate pain any studies on pain and treatments always have to be viewed skeptically. (The only good results are from surgical interventions where there is a definite reductioin in pain or the pain is gone. Objectively if the patient is able to do more and if there was a way to quantify that that would be a better indicator of benefit, from opioids or any other treatments/interventions



Other thoughts?

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.