Book cover of Information Theory, Inference and Learning Algorithms

Book description

Information theory and inference, taught together in this exciting textbook, lie at the heart of many important areas of modern technology - communication, signal processing, data mining, machine learning, pattern recognition, computational neuroscience, bioinformatics and cryptography. The book introduces theory in tandem with applications. Information theory is taught alongside practical…

When you buy books, we may earn a commission that helps keep our lights on (or join the rebellion as a member).

Why read it?

2 authors picked Information Theory, Inference and Learning Algorithms as one of their favorite books. Why do they recommend it?

The best parts of this book really represent a gold standard in pedagogical clarity.

Although it’s now twenty years old, there is still much to learn from this rather unconventional book that covers the boundary between machine learning, information theory, and Bayesian methods. There are also odd tangents and curiosities, some of which work better than others but are never dull.

Just writing this review makes me want to go back to it and squeeze more out of it.

This is considered to be a modern classic on information theory. It is a fairly readable text that roams far and wide over many topics. MacKay was extraordinarily clever, curious, and generous (which is why he made the book freely available). His wide range of interests included coding theory and artificial neural networks (machine learning), which occupy a few chapters of the book. In describing the difference between Bayesian and frequentist statistical methods, MacKay pulls no punches, and he can be heard laughing through gritted teeth as he tries to make sense of the nonsensical. This is one of those…

From James' list on information theory.

If you love Information Theory, Inference and Learning Algorithms...

Book cover of These Blue Mountains

These Blue Mountains by Sarah Loudin Thomas,

A moving story of love, betrayal, and the enduring power of hope in the face of darkness.

German pianist Hedda Schlagel's world collapsed when her fiancé, Fritz, vanished after being sent to an enemy alien camp in the United States during the Great War. Fifteen years later, in 1932, Hedda…

Want books like Information Theory, Inference and Learning Algorithms?

Our community of 12,000+ authors has personally recommended 69 books like Information Theory, Inference and Learning Algorithms.

Browse books like Information Theory, Inference and Learning Algorithms

Book cover of Introduction to Information Theory: Symbols, Signals and Noise
Book cover of Elements of Information Theory
Book cover of The Mathematical Theory of Communication

Share your top 3 reads of 2025!

And get a beautiful page showing off your 3 favorite reads.

1,366

readers submitted
so far, will you?

📚 If you like Information Theory, Inference and Learning Algorithms, you might also like...

Book cover of The Duke's Christmas Redemption

The Duke's Christmas Redemption by Arietta Richmond,

A Duke who has rejected love, a Lady who dreams of a love match, an arranged marriage, a house full of secrets, a most unneighborly neighbor, a plot to destroy reputations, an unexpected love that redeems it all.

Lady Charlotte Wyndham, given in an arranged marriage to a man she…

Book cover of Coyote Weather

Coyote Weather by Amanda Cockrell,

Coyote weather is the feral, hungry season, drought-stricken, and ready to catch fire. It’s 1967, and the American culture is violently remaking itself while the country is forcibly sending its young men to fight in a deeply unpopular war.

Jerry has stubbornly made no plans for the future because he…

5 book lists we think you will like!