Regression to the shmean (verden i farger)

Every so often I get one of these people leave my clinic after a period of rehabilitation.

“Thanks so much. You’ve made such a difference. I wished they’d sent me 6yrs ago.”

This leaves me in a predicament. There feels a genuine change. But I’ve been trained to be suspect of treatment results. Regression to the mean has become a new buzzword in healthcare. It predicts that if an extreme measure is taken then the next measure will tend to be nearer the mean. Regardless of whether the initial measure was under or over the mean. Interesting.

So should I dismiss the above effect. Regression to the mean is a statistical phenomenon. Giving population data. It has uses but in isolation is reductionist. This is one concern with pure statistical interpretation of complexity. The world is reduced to numbers for our ‘benefit’. To take out the human-ness and be left with ‘reality’ or metaphysicality (a dubious claim). Statistics is bound to describe the world in numbers only. The world in black and white. 2D. Only in complexity can we see the world in colour.

Where does it work best? A good example is if you get 100 students to sit a blinded multiple choice test. Then repeat the next day. We expect the higher and lower scores to become less extreme and those around the mean to be more divergent. Repeat the test UNblinded and the effect is much less pronounced. The results less random or down to chance. Another example would be simple objective data such as inherited height which formed part of the initial idea by Sir Francis Galton.

Let’s start with terminology. Often it is easy to mistake regression with resolution. We know regression to the mean is not resolution because regression needs to occur in both directions. Towards the mean. Some better. Some worse. This does not describe resolution. Resolution continues a tendency toward improvement or resolution with multiple readings. Regression to the mean does not. It fluctuates around its own mean.

So terminology clear where do we go next? Well we give treatments a rough time when they have unknown mechanism. Rightly so. We want to know why and how. Regression to the mean works best with random unorganised data. The less random the data the less regression to the mean observed. In this view there is no causal attribution, just random stochastic variation. In cases of simple characteristics like height we know at least part of the regression process through gene sequencing in inheritance.

But what about pain? Do we know the mechanism of regression to the mean or resolution? Is it always the same? Is each resolution equal? Does the frequency of regression change? I often see people who have had a previous episode of pain and who have seen some resolution through avoidance strategies, behaviour adaptation, reduced daily effort. This is surely different to someone who resolved with good activity levels and less maladaptive beliefs. These qualitative differences are washed out with simple statistics.

Have we backed ourselves into a corner? Using regression to the mean as a convenient take down of alternative medicine. Easy to disengage. A sort of cognitive dissonance. If it works in the short term it’s placebo. If it works in the long term it’s regression to the mean. But where does it leave us? Over reliant on a statistical view of the world. (This is not an apologetic for alternative medicine. Rather a call for a deeper understanding).

Mechanisms could include subjective symptoms (like pain) being a byproduct of consciousness. Our consciousness is finite and in demand. This could lead to variation around a mean. Long term outcomes interfered by competing demands for consciousness. Stress, anxiety, other health issues, life! We might provide temporary scaffolding with our treatments. But do we see life changes? This is an excellent example of how regression actually helps us to engage in a more human level. But we should be careful to investigate it’s mechanism. Otherwise regression becomes a magic homogenising process.

The data is gathered at a population level therefore tells us little of an individual. It relies on a mean. An average. A normal. It assumes each person equal regardless of context. Their regression (or resolution) determined by pathology rather than person. Unable to compare to an alternative we can’t know how they may fluctuate other than using previous experience to inform (a priori). This is frowned on by groups of certain statisticians for risk of bias. They much prefer amalgamating a load of data from a population then assuming each person from 1-100th percentile on the continuum is bang average (mean). How accurate can this be? How wise not to use a priori reasoning? Maybe a discussion for a different day.

Statistics view the complexity of the world as disorganised when in fact social sciences generally accepts that social reality is best viewed as organised complexity. It is obsessed with linear modelling as this makes life easy to interpret. But at what cost in understanding? Complex causality is superseded by natural variation. This leads to determinism.

If we are not careful regression or resolution are examples of where useful data can reduce people to numbers. People lose out to ‘science’. Mean statistics cloak human variety. Depersonalised treatment approved in Randomised Control Trials assume situational approach i.e. putting each individual through the same situation or context will achieve the best results. This seems to be a foundation for much of healthcare. Deterministic reasoning such as “if we can determine the pathology and determine (through Randomised Control Trials) most effective treatment all our healthcare problems are solved!” Unfortunately this doesn’t seem to be the case. Factors outside the external context seem to matter greatly (i.e. the internal context/the person). I have seen regression to the mean used to explain treatment effects. The person sees you at their worst so can only improve. This may be true of some private clinics. But often people arrive in clinics 4-6 weeks from onset if we are lucky. So it is a misguided assumption to say we see them at their worst. Another call to put away the blankets and actually think. You know like humans do.

Using a bit of deep human thinking (not robot processing) we can see the above case study did not fit regression to the mean principles. Neither natural resolution after 6yr history. Clinically regression to the mean does happen but is quite obvious. They are the people who fluctuate both ways with no real improvement. Resolution is a bit trickier. Our healthcare professions should be quick to note that we may influence the context or environment for progress but do not provide the ‘magic’ of resolution. Do away with blanket thinking.

Be more human. Be less robot.

Thanks for reading this far.

Neil

further reading:

Only got 5mins to look at one article? This is a brilliant piece written by a quantative researcher in the social sciences explaining how quantitative approaches fail by themselves. Must read! http://bit.ly/quantfail

Another interesting piece on protocol v reasoning https://sfbayareaspt.wordpress.com/2016/02/01/protocols-vs-expertise/

4 thoughts on “Regression to the shmean (verden i farger)”

  1. Morning Neil,

    Read this a few times now. What do think the worth of regression to the mean is for us in reality.
    In RCTs we often turn variance and subjectivity into a constant and leave out lots of other variables. The answer then is far from a true representation of the population.
    Is everything set up to regress to the mean?
    Do our patients progress from the mean?

    Thanks for the read.

    Regards

    Liked by 1 person

    1. Great questions. Ultimately life, people and interventions are more complex than RCT would like but that other forms of experimentation are more suited to. Together they provide a fuller picture.

      Regression to the mean helps explain those patients who sometimes respond to treatment but get no better. So it makes sure we don’t assume that response to 1 treatment is classed as improvement. Realistically if we are honest professionals we would know this anyway. Chronic conditions tend to be more inclined to regress to their mean but not resolve. Most of our/my patients resolve rather than regress to the mean. We look to facilitate or at very least not to mess up this journey!

      Those that do regress to their mean we need to ensure we are not taking a unidimensional approach to their symptoms and help provide what they need to improve. Or at very least learn to live better with pain.

      The other thing I didn’t have time/space to explore was the scaffolding effect of treatment. Our interventions can give temporary support (like scaffolding) to the patient so whilst under care they progress well/resolve but once scaffolding is removed the effect is not maintained as it was externally appropriated and not internally sustained. This is where self-management/treatment is key and that life changes are made and sustained.

      Like

  2. Hi Neil – great post, thank you for this contribution!

    One question based on this statement: “..there is no causal attribution, just random stochastic variation.”

    Does your metaphysic allow for two sources of stochastic variation – one source being mechanisms that have causal attribution at a level of reality that we simply cannot access and therefore they appear stochastic to us; and a second source being those that are truly stochastic in the sense that they emerge from a quantum level that we believe is truly random and has no causal attribution that can mechanistically explain their behavior at the level we can observe?

    I personally struggle with this question given my strong beliefs in causal theory. I tend toward a metaphysic of stochastic as “unknown” mechanisms with the belief that there are actual real mechanisms that are causing the events, that they are not truly random just random appearing to our limited sensory perceptual and reasoning systems. The question for me then shifts to epistemology, what of these yet unknown mechanisms can be known vs. remain unknowable.

    The above does not interfere at all with my complete agreement with your reconciliation and approach towards regression to the mean. I believe your thoughts cohere with what I have always seen as a struggle between nominalism and realism; between particulars and universals. In a critical realism we recognize that particulars are what we work with daily while we search is for universals that provide some meaning to those particulars – but most of the time the universals (in order to be known) represent the mean and therefore do not account well for the possible variability. We identify regression to the mean when formulating universals, but we need to be careful in interpreting particulars based on the universals.

    Thanks again!
    Sean

    Liked by 1 person

    1. great question Sean. it is difficult to know whether the stochastic nature is truly random or just unknown complexity! i’d probably side with you in erring toward unknown complexity in these clinical cases. i tend toward dispositional accounts of causation. the human is tremendously complex and in most cases the situation can provoke causally diverse responses/outcomes/particulars.

      Thanks for the great feedback!

      Neil

      Liked by 1 person

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s