Skip to main content

Big Data - Brian Clegg ****

I first became involved with what we now term big data when providing some mathematical assistance to a major supermarket.  They wanted to know what products would suffer, or benefit, if another product were put on special offer – the victims and victors as they called them.  As an example, if fresh meat pies are put on buy one get one free, should the supermarket plan on stocking more fresh vegetables? That sort of thing.  The supermarket in question had a lot of data concerning historical sales, and what had previously been put on special offer, so it was just a case of designing a set of algorithms to analyse this data to provide the necessary forecast, and also to have the system learn through what we would now call reinforcement learning over time.  This was back in the mid 90s. One can imagine how things - in all camps - should have vastly improved since then.  That’s just one example of where Big Data transparently impacts our lives.

In Big Data, Clegg sets out an assortment of examples from the success of Netflix and the prediction of crime locations to algorithms that have lost people their jobs or caused stock market crashes, examining the mechanisms and implications of each.  Taking the supermarket example - although this is my example and not his - we might ask ourselves who really benefits here – who exactly are the victims and victors (or villains perhaps) in real life?

Big Data is here to stay - should we be afraid of it or embrace it?  As always, Clegg writes with an easy clarity that draws us in - no technical expertise required to understand his exploration of this essential subject - and throughout Big Data’s highly enjoyable pages, the spread and range of material is highly impressive – dizzying in fact.  I personally found entirely new perspectives on the subject that will keep me pondering for quite some time.  

I should add that, if I were still a statistics lecturer at Oxford, I would recommend the book to my students as bedside reading.

Paperback:  

Kindle:  
Using these links earns us commission at no cost to you
Review by Peet Morris
Please note, this title is written by the editor of the Popular Science website. Our review is still an honest opinion – and we could hardly omit the book – but do want to make the connection clear.

Comments

Popular posts from this blog

Stephen Hawking: Genius at Work - Roger Highfield ****

It is easy to suspect that a biographical book from highly-illustrated publisher Dorling Kindersley would be mostly high level fluff, so I was pleasantly surprised at the depth Roger Highfield has worked into this large-format title. Yes, we get some of the ephemera so beloved of such books, such as a whole page dedicated to Hawking's coxing blazer - but there is plenty on Hawking's scientific life and particularly on his many scientific ideas. I've read a couple of biographies of Hawking, but I still came across aspects of his lesser fields here that I didn't remember, as well as the inevitable topics, ranging from Hawking radiation to his attempts to quell the out-of-control nature of the possible string theory universes. We also get plenty of coverage of what could be classified as Hawking the celebrity, whether it be a photograph with the Obamas in the White House, his appearances on Star Trek TNG and The Big Bang Theory or representations of him in the Simpsons. Ha

Roger Highfield - Stephen Hawking: genius at work interview

Roger Highfield OBE is the Science Director of the Science Museum Group. Roger has visiting professorships at the Department of Chemistry, UCL, and at the Dunn School, University of Oxford, is a Fellow of the Academy of Medical Sciences, and a member of the Medical Research Council and Longitude Committee. He has written or co-authored ten popular science books, including two bestsellers. His latest title is Stephen Hawking: genius at work . Why science? There are three answers to this question, depending on context: Apollo; Prime Minister Margaret Thatcher, along with the world’s worst nuclear accident at Chernobyl; and, finally, Nullius in verba . Growing up I enjoyed the sciencey side of TV programmes like Thunderbirds and The Avengers but became completely besotted when, in short trousers, I gazed up at the moon knowing that two astronauts had paid it a visit. As the Apollo programme unfolded, I became utterly obsessed. Today, more than half a century later, the moon landings are

Space Oddities - Harry Cliff *****

In this delightfully readable book, Harry Cliff takes us into the anomalies that are starting to make areas of physics seems to be nearing a paradigm shift, just as occurred in the past with relativity and quantum theory. We start with, we are introduced to some past anomalies linked to changes in viewpoint, such as the precession of Mercury (explained by general relativity, though originally blamed on an undiscovered planet near the Sun), and then move on to a few examples of apparent discoveries being wrong: the BICEP2 evidence for inflation (where the result was caused by dust, not the polarisation being studied),  the disappearance of an interesting blip in LHC results, and an apparent mistake in the manipulation of numbers that resulted in alleged discovery of dark matter particles. These are used to explain how statistics plays a part, and the significance of sigmas . We go on to explore a range of anomalies in particle physics and cosmology that may indicate either a breakdown i