Information Theory: a tutorial introduction

Information Theory: a tutorial introduction - James V. Stone ***

Information theory is central to the technology that we use every day - apart from anything else, in the technology that brings you this review (though ironically not in the book being reviewed as it doesn't appear to have an ebook version). As in his Bayes' Rule, James Stone sets out to walk a fine line between a title for the general reader and a textbook. And like that companion title the outcome is mixed, though here the textbook side largely wins.

The opening chapter 'What is information?' walks the line very well. It gradually builds up the basics that will be required to understand information theory and though it would work better if it had a little more context (for example, more about Claude Shannon as a person) to anchor it, the general reader will, with perhaps a few pages that needs re-reading, find it approachable and providing more depth than a popular science title usually would. I like the way that Stone uses variants of a photograph, for instance, to demonstrate what is happening with different mechanisms for compressing data. Unfortunately, though, this is pretty much where that general reader gets off, until we get to chapter 9.

The main bulk of the book, pages 21 to 184, cross that line and plonk solidly into textbook territory - they may cover the topic rather more lightly than a traditional textbook, but they simply don't work to inform without requiring the kind of investment of mind and mathematics that a textbook does - and, with a few brief exceptions, the writing style feels no different from the better textbooks I have from university. At chapter 9, the subject is brought round to information in nature, and there we get enough application and context to make what we learn seem more approachable again, though not to the same level as the equivalent part of Bayes' Rule. It's also a shame that (unless I missed it) there is no mention of Omega, Greg Chaitin's remarkable non-computable number.

So where Bayes' Rule is suited to popular science readers who want to stretch themselves and put in some extra effort, Information Theory can only really be regarded as a readable introductory textbook - it doesn't work in a popular science context. (Why then am I reviewing it? The author kindly provided the title for review in the hope that it would work for popular science readers.) If you are about to take a university course encompassing information theory - or are contemplating doing so - I can, however, heartily recommend this title as an introduction.

Paperback:

Using these links earns us commission at no cost to you

Buy direct from the author here.

Review by Brian Clegg

Comments

Roger Highfield - Stephen Hawking: genius at work interview

Roger Highfield OBE is the Science Director of the Science Museum Group. Roger has visiting professorships at the Department of Chemistry, UCL, and at the Dunn School, University of Oxford, is a Fellow of the Academy of Medical Sciences, and a member of the Medical Research Council and Longitude Committee. He has written or co-authored ten popular science books, including two bestsellers. His latest title is Stephen Hawking: genius at work . Why science? There are three answers to this question, depending on context: Apollo; Prime Minister Margaret Thatcher, along with the world’s worst nuclear accident at Chernobyl; and, finally, Nullius in verba . Growing up I enjoyed the sciencey side of TV programmes like Thunderbirds and The Avengers but became completely besotted when, in short trousers, I gazed up at the moon knowing that two astronauts had paid it a visit. As the Apollo programme unfolded, I became utterly obsessed. Today, more than half a century later, the moon landings are

Splinters of Infinity - Mark Wolverton ****

Many of us who read popular science regularly will be aware of the 'great debate' between American astronomers Harlow Shapley and Heber Curtis in 1920 over whether the universe was a single galaxy or many. Less familiar is the clash in the 1930s between American Nobel Prize winners Robert Millikan and Arthur Compton over the nature of cosmic rays. This not a book about the nature of cosmic rays as we now understand them, but rather explores this confrontation between heavyweight scientists. Millikan was the first in the fray, and often wrongly named in the press as discoverer of cosmic rays. He believed that this high energy radiation from above was made up of photons that ionised atoms in the atmosphere. One of the reasons he was determined that they should be photons was that this fitted with his thesis that the universe was in a constant state of creation: these photons, he thought, were produced in the birth of new atoms. This view seems to have been primarily driven by re

Deep Utopia - Nick Bostrom ***

This is one of the strangest sort-of popular science (or philosophy, or something or other) books I've ever read. If you can picture the impact of a cross between Douglas Hofstadter's Gödel Escher Bach and Gaileo's Two New Sciences (at least, its conversational structure), then thrown in a touch of David Foster Wallace's Infinite Jest , and you can get a feel for what the experience of reading it is like - bewildering with the feeling that there is something deep that you can never quite extract from it. Oxford philosopher Nick Bostrom is probably best known in popular science for his book Superintelligence in which he looked at the implications of having artificial intelligence (AI) that goes beyond human capabilities. In a sense, Deep Utopia is a sequel, picking out one aspect of this speculation: what life would be like for us if technology had solved all our existential problems, while (in the form of superintelligence) it had also taken away much of our appare

Search This Blog