Skip to main content

Big Data - Brian Clegg ****

I first became involved with what we now term big data when providing some mathematical assistance to a major supermarket.  They wanted to know what products would suffer, or benefit, if another product were put on special offer – the victims and victors as they called them.  As an example, if fresh meat pies are put on buy one get one free, should the supermarket plan on stocking more fresh vegetables? That sort of thing.  The supermarket in question had a lot of data concerning historical sales, and what had previously been put on special offer, so it was just a case of designing a set of algorithms to analyse this data to provide the necessary forecast, and also to have the system learn through what we would now call reinforcement learning over time.  This was back in the mid 90s. One can imagine how things - in all camps - should have vastly improved since then.  That’s just one example of where Big Data transparently impacts our lives.

In Big Data, Clegg sets out an assortment of examples from the success of Netflix and the prediction of crime locations to algorithms that have lost people their jobs or caused stock market crashes, examining the mechanisms and implications of each.  Taking the supermarket example - although this is my example and not his - we might ask ourselves who really benefits here – who exactly are the victims and victors (or villains perhaps) in real life?

Big Data is here to stay - should we be afraid of it or embrace it?  As always, Clegg writes with an easy clarity that draws us in - no technical expertise required to understand his exploration of this essential subject - and throughout Big Data’s highly enjoyable pages, the spread and range of material is highly impressive – dizzying in fact.  I personally found entirely new perspectives on the subject that will keep me pondering for quite some time.  

I should add that, if I were still a statistics lecturer at Oxford, I would recommend the book to my students as bedside reading.

Paperback:  
Kindle:  
Review by Peet Morris
Please note, this title is written by the editor of the Popular Science website. Our review is still an honest opinion – and we could hardly omit the book – but do want to make the connection clear.

Comments

Popular posts from this blog

De/Cipher - Mark Frary ****

I was a little doubtful when I first saw this book. Although it has the intriguing tagline 'The greatest codes ever invented and how to crack them' the combination of a small format hardback and gratuitous illustrations made me suspect it would be a lightweight, minimal content, Janet and John approach to codes and ciphers. Thankfully, in reality Mark Frary manages to pack a remarkable amount of content into De/Cipher's slim form.

Not only do we get some history on and instructions to use a whole range of ciphers, there are engaging little articles on historical codebreakers and useful guidance on techniques to break the simpler ciphers. The broadly historical structure takes the reader through basic alphabetic manipulation, keys, electronic cryptography, one time pads and so on, all the way up to modern public key encryption and a short section on quantum cryptography. 

We even get articles on some of the best known unsolved ciphers, such as the Dorabella and the Voynich ma…

Paul McAuley - Four Way Interview

Paul McAuley won the Philip K. Dick Award for his first novel and has gone on to win the Arthur C. Clarke, British Fantasy, Sidewise and John W. Campbell Awards. He gave up his position as a research biologist to write full-time. He lives in London. His latest novel is Austral.


Why science fiction?

For one thing, I fell in love with science fiction at an early age, and haven’t yet fallen out of love with it (although I have flirted with other genres). For another, we’re living in an increasingly science-fictional present. Every day brings headlines that could have been ripped from a science-fiction story. Giant robot battle: Who knew a duel between chainsaw-armed mech suits could be so boring? for instance. Or, Roy Orbison hologram to embark on UK tour in 2018. And looming above all this, like Hokusai’s famous wave, are the ongoing changes caused by global warming and climate change, which is just one consequence of human activity having become the dominant force of change on the planet…

Karl Drinkwater - Four Way Interview

Karl Drinkwater is originally from Manchester, but has lived in Wales half his life. He is a full-time author, edits fiction for other writers and was a professional librarian for over twenty-five years. He has degrees in English, Classics and Information Science. When he isn't writing, he loves exercise, guitars, computer and board games, the natural environment, animals, social justice, cake and zombies - not necessarily in that order. His latest novel is Lost Solace.

Why science fiction?

My favourite books have always been any form of speculative fiction. As a child I began with ghost stories, which were the first books to make me completely forget I was reading. By my teenage years I was obsessed with fantasy, science fiction, and horror. Although I read literary and contemporary books, non-fiction, historical works, classics and so on, it is speculative fiction that I return to when I want escape and wonder. When I read reviews of my last book, the fast-paced novella Harvest Fe…