Wednesday, March 27, 2013

Hard data, hard times

Charles Dickens would not approve of Big Data; he had no time at all for Mr Gradgrind’s view that ‘You can only form the minds of reasoning animals upon Facts: nothing else will ever be of any service to them’, nor for his efforts to turn his son Tom into a scientist by having the boy trained to mathematical exactness.

Dickens had no respect at all for the output of Victorian collators & compilers of statistics in the form of Parliamentary Blue Books.

Whatever they could prove (which is usually anything you like), they proved there, in an army constantly strengthening by the arrival of new recruits … the most complicated social questions were cast up, got into exact totals, and finally settled - if those concerned could only have been brought to know it. As if an astronomical observatory should be made without any windows, and the astronomer within should arrange the starry universe solely by pen, ink, and paper, so Mr. Gradgrind, in his Observatory (and there are many like it), had no need to cast an eye upon the teeming myriads of human beings around him, but could settle all their destinies on a slate, and wipe out all their tears with one dirty little bit of sponge.
Heaven knows what Dickens would think of the idea of settling issues of social policy through the mechanism of the randomised controlled trial
Well, actually he gave us a pretty good clue, in the words of young Tom Gradgrind, failed mathematician:
'I wish I could collect all the Facts we hear so much about,' said Tom, spitefully setting his teeth, 'and all the Figures, and all the people who found them out: and I wish I could put a thousand barrels of gunpowder under them, and blow them all up together! '

Those Blue Books are now regarded as invaluable social documents by many, but there will always be those who  place more value on the story than on statistics.

Link
Project Gutenberg: Hard Times by Charles Dickens