Book cover of Information Theory, Inference and Learning Algorithms

Book description

Information theory and inference, taught together in this exciting textbook, lie at the heart of many important areas of modern technology - communication, signal processing, data mining, machine learning, pattern recognition, computational neuroscience, bioinformatics and cryptography. The book introduces theory in tandem with applications. Information theory is taught alongside practical…

When you buy books, we may earn a commission that helps keep our lights on (or join the rebellion as a member).

Why read it?

2 authors picked Information Theory, Inference and Learning Algorithms as one of their favorite books. Why do they recommend it?

The best parts of this book really represent a gold standard in pedagogical clarity.

Although it’s now twenty years old, there is still much to learn from this rather unconventional book that covers the boundary between machine learning, information theory, and Bayesian methods. There are also odd tangents and curiosities, some of which work better than others but are never dull.

Just writing this review makes me want to go back to it and squeeze more out of it.

This is considered to be a modern classic on information theory. It is a fairly readable text that roams far and wide over many topics. MacKay was extraordinarily clever, curious, and generous (which is why he made the book freely available). His wide range of interests included coding theory and artificial neural networks (machine learning), which occupy a few chapters of the book. In describing the difference between Bayesian and frequentist statistical methods, MacKay pulls no punches, and he can be heard laughing through gritted teeth as he tries to make sense of the nonsensical. This is one of those…

If you love Information Theory, Inference and Learning Algorithms...

Book cover of December on 5C4

December on 5C4 by Adam Strassberg,

Magical realism meets the magic of Christmas in this mix of Jewish, New Testament, and Santa stories–all reenacted in an urban psychiatric hospital!

On locked ward 5C4, Josh, a patient with many similarities to Jesus, is hospitalized concurrently with Nick, a patient with many similarities to Santa. The two argue…

Want books like Information Theory, Inference and Learning Algorithms?

Our community of 13,000+ authors has personally recommended 69 books like Information Theory, Inference and Learning Algorithms.

Browse books like Information Theory, Inference and Learning Algorithms

Book cover of Introduction to Information Theory: Symbols, Signals and Noise
Book cover of Elements of Information Theory
Book cover of The Mathematical Theory of Communication

Share your top 3 reads of 2026!

And get a beautiful page showing off your 3 favorite reads.

166

readers submitted
so far, will you?

📚 If you like Information Theory, Inference and Learning Algorithms, you might also like...

Book cover of Sexy Selfie Nation: Standing Up for Yourself in Today's Toxic, Sexist Culture

Sexy Selfie Nation by Leora Tanenbaum,

The problem is not with the actions young women take but with the toxic, sexist conditions they are responding to.

Tanenbaum found, based on six years of interviews with young people ages 14-30, that young women are navigating a culture littered with gendered dress codes, revenge porn, and sexually explicit…

Book cover of In This Together: Connecting with Your Community to Combat the Climate Crisis

In This Together by Marianne E. Krasny,

In This Together explores how we can harness our social networks to make a real impact fighting the climate crisis. Against notions of the lone environmental crusader, Marianne E. Krasny shows us the power of "network climate action"—the idea that our own ordinary acts can influence and inspire those close…

5 book lists we think you will like!