Datamining for terrorists would be lovely if it worked

February 28th, 2009 by Ben Goldacre in bad science, evidence based policy, politics, statistics, surveillance | 79 Comments »

The Guardian
Saturday February 28 2009
Ben Goldacre

This week Sir David Omand, the former Whitehall security and intelligence co-ordinator, described how the state should analyse data about individuals in order to find terrorist suspects: travel information, tax, phone records, emails, and so on. “Finding out other people’s secrets is going to involve breaking everyday moral rules” he said, because we’ll need to screen everyone to find the small number of suspects.

There is one very significant issue that will always make data mining unworkable when used to search for terrorist suspects in a general population, and that is what we might call Read the rest of this entry »