Perception as Inference

…and how we survive in a world of uncertainty

Every breath you take, every move you make, every glance you steal—literally all the time—there is something going on behind the scenes: your brain is running billions of calculations to answer one question… what the hell is actually happening right now?

Being alive means dealing with uncertainty, every moment of every day. Seriously, that’s what it means to be alive: to navigate uncertainty, to try to “infer” what’s going on, using only limited and noisy information. We need to be able to understand this complex and uncertain world around us, at least well enough to survive and reproduce.

But what does it mean to “understand” the world? It turns out this can be rigorously mathematized as Bayesian inference. Don’t worry! I’ll develop every intuition from the ground up and slowly derive the math from scratch. No background needed whatsoever.

By the end of this post, I hope to convince you that:

Main takeaway
inference = understanding the world
the brain = electric meatball inference machine
Continue reading “Perception as Inference”

World Models, Adaptation, and Surprise (Part 1)

Part 1: Conceptual and Mathematical Foundations

Familiarity dulls the senses. Live in one place long enough, and you’ll see everything there is to see: the extraordinary becomes ordinary, the unfamiliar becomes routine, and surprises gradually fade away.

Think of your first ride on the New York City metro. Remember the unforgettable insights it has to offer into the spectrum of human behavior. Now imagine living there, enduring the metro commute every single day—day after day, week after week, year after year. Would you still be surprised at what you see during your daily metro ride? I haven’t lived in NYC, but I imagine that after enough time, you’d morph into a true New Yorker, unfazed by even the most creative displays of humanity.

This intuition can be summarized as follows:

Main observation
Brains adapt to the statistics of their environments.
Continue reading “World Models, Adaptation, and Surprise (Part 1)”

The Perennial Quest for Understanding

Welcome to my blog. Here, I will share my journey as I seek to understand the true nature of reality, out there in the world, and how we construct our perceptions of it, here in our minds.

My posts will explore the brain, evolution, intelligence, and physics, and how these threads intertwine to shape the human mind’s understanding of physical reality.

Continue reading “The Perennial Quest for Understanding”