London School of Hygiene & Tropical Medicine

Their re-analysis of original data from an influential trial corrected earlier errors and led the researchers to question the finding that deworming children increased school attendance.

The researchers re-analysed data from a trial conducted in Kenya in 1998-99 which reported that a school-based deworming intervention increased school attendance. The trial also concluded that the benefits were passed to children who did not themselves receive treatment due to the prevention of onward transmission of infections. Those findings have been highly influential due to the substantial benefits that might be gained from use of inexpensive deworming drug treatment. Consequently, deworming school-age children has been hailed as the fourth most effective way of advancing the welfare of developing countries.

Amid ongoing debate around the deworming evidence, the International Initiative for Impact Evaluation (3ie) commissioned the researchers to carry out the re-analysis of the key Kenyan trial data. The findings are published as two new papers in the International Journal of Epidemiology.

In the first new paper, researchers used the same methods as the original study to re-analyse the trial data from Kenya. They were able to reproduce the majority of the original paper's findings, which found a decrease in worm infections, some evidence of small improvements to nutritional status and no benefit on exam results. However, the researchers found calculation errors in the original authors' data which meant there was no longer evidence that deworming caused an increase in school attendance among children who attended schools near to the schools where children were treated. The researchers were therefore unable to replicate the finding that attendance was improved in untreated schools.

In the second new paper, researchers re-analysed the school attendance and examination data with methods commonly used by health researchers, rather than those used by economists as in the original study. The new analysis found substantial amounts of missing data, some inconsistent results related to school attendance and data patterns which had the potential to affect the results. The researchers concluded that while the trial provided some evidence of a benefit on school attendance there was a high risk of bias. Both the original study and the re-analysis found no evidence of benefit on exam results.

Study author Dr Alexander Aiken, Lecturer in Infectious Disease Epidemiology at the London School of Hygiene & Tropical Medicine, said: "Many organisations including the World Bank, World Health Organization and Gates Foundation have heavily promoted deworming drug treatments in low-income countries because improved school attendance could potentially benefit educational achievement. Our findings should help these development organisations to develop future policy in this area."

Parasitic worm (helminth) infections affect millions of children in developing countries, causing debilitating illness and holding back their physical development.

Study author Calum Davey, Research Fellow at the London School of Hygiene & Tropical Medicine, added: "Our findings suggest that on the basis of this study alone, we should be cautious about concluding that there are educational benefits from deworming children. It is important that policy is based on rigorous review of the evidence from all relevant studies."

Writing in a linked commentary piece published in the International Journal of Epidemiology to coincide with the re-analysis, Professor Paul Garner from the Liverpool School of Tropical Medicine and Co-ordinating Editor for the Cochrane Infectious Diseases Group, said: "Our view is that current promotion of community deworming is certainly a panacea: a single solution to multiple problems in low and middle income countries, and that the belief that deworming will impact substantially on economic development seems delusional when you look at the results of reliable controlled trials."

The two new papers by researchers at the London School of Hygiene & Tropical Medicine are included in an updated systematic review from the Cochrane Infectious Diseases Group on evidence of the benefits of deworming drugs for children.

Podcast: Calum Davey and Alex Aiken discuss their findings

Publications:

• Alexander M Aiken, Calum Davey, James R Hargreaves and Richard J Hayes. Re-analysis of health and educational impacts of a school-based deworming programme in western Kenya: a pure replication. International Journal of Epidemiology. DOI: 10.1093/ije/dyv127
• Calum Davey, Alexander M Aiken, Richard J Hayes and James R Hargreaves. Re-analysis of health and educational impacts of a school-based deworming programme in western Kenya: a statistical replication of a cluster quasi-randomized stepped-wedge trial. International Journal of Epidemiology. DOI: 10.1093/ije/dyv128

Related links:

• Centre for Evaluation