Skip to main content

Big Data - Brian Clegg ****

I first became involved with what we now term big data when providing some mathematical assistance to a major supermarket.  They wanted to know what products would suffer, or benefit, if another product were put on special offer – the victims and victors as they called them.  As an example, if fresh meat pies are put on buy one get one free, should the supermarket plan on stocking more fresh vegetables? That sort of thing.  The supermarket in question had a lot of data concerning historical sales, and what had previously been put on special offer, so it was just a case of designing a set of algorithms to analyse this data to provide the necessary forecast, and also to have the system learn through what we would now call reinforcement learning over time.  This was back in the mid 90s. One can imagine how things - in all camps - should have vastly improved since then.  That’s just one example of where Big Data transparently impacts our lives.

In Big Data, Clegg sets out an assortment of examples from the success of Netflix and the prediction of crime locations to algorithms that have lost people their jobs or caused stock market crashes, examining the mechanisms and implications of each.  Taking the supermarket example - although this is my example and not his - we might ask ourselves who really benefits here – who exactly are the victims and victors (or villains perhaps) in real life?

Big Data is here to stay - should we be afraid of it or embrace it?  As always, Clegg writes with an easy clarity that draws us in - no technical expertise required to understand his exploration of this essential subject - and throughout Big Data’s highly enjoyable pages, the spread and range of material is highly impressive – dizzying in fact.  I personally found entirely new perspectives on the subject that will keep me pondering for quite some time.  

I should add that, if I were still a statistics lecturer at Oxford, I would recommend the book to my students as bedside reading.



Review by Peet Morris
Please note, this title is written by the editor of the Popular Science website. Our review is still an honest opinion – and we could hardly omit the book – but do want to make the connection clear.


Popular posts from this blog

The Feed (SF) - Nick Clark Windo ****

Ever since The War of the Worlds, the post-apocalyptic disaster novel has been a firm fixture in the Science Fiction universe. What's more, such books are often among the few SF titles that are shown any interest by the literati, probably because many future disaster novels feature very little science. With a few exceptions, though (I'm thinking, for instance, The Chrysalids) they can make for pretty miserable reading unless you enjoy a diet of page after page of literary agonising.

The Feed is a real mixture. Large chunks of it are exactly that - page after page of self-examining misery with an occasional bit of action thrown in. But, there are parts where the writing really comes alive and shows its quality. This happens when we get the references back to pre-disaster, when we discover the Feed, which takes The Circle's premise to a whole new level with a mega-connected society where all human interaction is through directly-wired connections… until the whole thing fails …

Everything You Know About Space Is Wrong - Matt Brown ****

What we have here is a feast of assertions some people make about space that are satisfyingly incorrect, with pithy, entertaining explanations of what the true picture is. Matt Brown admits in his introduction that a lot of these incorrect facts are nitpicking - more on that in a moment - but it doesn't stop them being delightful. I particularly enjoyed the ones about animals in space and about the Moon.

Along the way, we take in space exploration, the Earth's place in space, the Moon, the solar system, the universe and a collection of random oddities, such as the fact that Mozart didn't write Twinkle, Twinkle Little Star. Sometimes the wrongness comes from a frequent misunderstanding. So, for example, Brown corrects the idea that Copernicus was the first to say that the Earth moves around the Sun. Sometimes there's some very careful wording. This is used when Brown challenges the idea that the Russian dog Laika was the first animal in space. What we discover is that, i…

Dark Matter and the Dinosaurs - Lisa Randall ****

I did my PhD in galactic dynamics - which is an awkward subject when people want to know what its relevance to the 'real world' is. So I was excited when Clube and Napier's book The Cosmic Serpent came out, around the same time, because it provided me with a ready-made answer. It argued that the comets which occasionally crash into Earth with disastrous results - such as the extinction of the dinosaurs - are perturbed from their normal orbits by interactions with the large-scale structure of the galaxy.

I was reminded of this idea a few years ago when there was a flurry of media interest in Lisa Randall's "dark matter and the dinosaurs" conjecture. I was sufficiently enthusiastic about it to write an article on the subject for Fortean Times - though my enthusiasm didn't quite extend to purchasing her hardback book at the time. However, now that it's out in paperback I've remedied the situation - and I'm glad I did.

Dark matter is believed to exi…