Chris Lancelot: Limits of statistics can be easily figured out

The incidence of Clostridium difficile in hospitals may be far greater than thought because current testing methods miss 20-80 per cent of cases. New, more accurate tests could be introduced - but hospital managers are worried an apparent rise in cases would be regarded as poor patient care and land them in trouble with the DoH and the public.

This is a perfect example of the statistical adage that data collected for one purpose shouldn't be used for another. Mathematical manipulation forms only one part of statistical analysis; equally important is a deep understanding of the provisos behind the raw data, and the inferences that can (or more importantly, cannot) be drawn.

If the incidence or prevalence of a disease has changed, is it because of different methods of testing? Has the topic under analysis been redefined during the investigation, perhaps to include or exclude certain conditions? And crucially, are there hidden psychological drivers to explain why reporting of data may be subject to bias?

A good example of the effect of such bias is the recent request from the European Centre for Disease Prevention and Control (ECDC), asking GPs to stop prescribing antibiotics for coughs and colds. Could the over-prescribing of antibiotics be related to GPs' anxiety that pushy patients will complain about their doctors if they don't get what they want? Will GPs obeying the ECDC risk being downgraded on the new, government-supported, practice assessment websites, or alternatively red-carded on their 'balanced scorecards' by their PCT simply because they have received too many complaints?

This is the difficulty with micromanaging the NHS by using targets. Most targets are simplistic. Many can be gamed - hospital waiting times in particular, which is the underlying reason certain hospitals reject so many Choose and Book appointments and ask GPs to fax in referral letters instead.

Einstein observed that not everything that can be counted matters and not everything that matters can be counted. Even when data is apparently complete and accurate to two decimal places, its relevance may be zero and its very presence counterproductive. In medicine the circumstances of data collection must be thoroughly understood before its analysis can mean anything.

Have you registered with us yet?

Register now to enjoy more articles and free email bulletins

Register

Already registered?

Sign in

Follow Us:

Just published

GP training: Working remotely as a GP trainee during the pandemic

GP training: Working remotely as a GP trainee during the pandemic

Dr Zoe Brown was in her first year of GP training and pregnant as lockdown began....

GPs warn government off PCN-led test and trace system

GPs warn government off PCN-led test and trace system

GPs have rebuffed suggestions that primary care networks (PCNs) are ‘best placed’...

Map: Three-fold variation in GP practice list size between CCGs

Map: Three-fold variation in GP practice list size between CCGs

The list size of GP practices across England has grown rapidly over the past decade...

Advance decisions to refuse treatment - what GPs need to know

Advance decisions to refuse treatment - what GPs need to know

A recent case has underlined the need for GPs to communicate a patient’s known wishes...

Law changed to allow physios and paramedics to administer vaccines during pandemic

Law changed to allow physios and paramedics to administer vaccines during pandemic

A wider range of healthcare workers will be allowed to administer flu and potential...

Medicines shortages drive up GP workload as prescribing costs surge £158m

Medicines shortages drive up GP workload as prescribing costs surge £158m

Medicines shortages in England are continuing to drive up GP workload during the...