random-walk-is-binomial
The Problem
A particle starts at 0 on the number line and takes steps. Each step is or with equal probability. After steps, what is the distribution of its position?
I worked it out by hand for the first few . Some things jumped out of those tables:
- After 1 step it sits on . After 2 steps, only even positions. After 3 steps, only odd positions. The reachable set flips parity with .
- Each distribution is symmetric about 0, with the most mass near 0 and less toward the edges.
- It looked like a bell, or like the triangle you get from summing two dice, which peaks at 7.
What I could not do was jump to general . Redoing the tree for every is hopeless. I needed the position's PMF as a formula, and I did not see how to get there.
Where I Got Stuck
Those tables were positions: the position after one step, after two, after three. I was treating each one as a random variable whose distribution I did not know, and grinding it out by hand with a tree. The instinct was to keep going the same way for general : build 's table too, so .
That is the trap. Each new step splits every position into two, so the tree doubles and after steps the bookkeeping explodes. Redoing it for every is hopeless, and it hands me no formula for . I was trying to compute the position's distribution in one piece, directly, instead of building it from simpler pieces I already understood.
The Reframe: Count Rights, Not the Running Sum
The way out is to build the position from simple pieces instead of computing it whole. Let be the -th step, for a right and for a left (reusing , now for the step itself rather than the running position). Each step is a trivial fair two-outcome trial, and the position is just their sum:
This is the reframe. Adding up independent identical fair steps builds a Binomial, so is a Binomial in disguise and I never have to grind out its distribution by hand: I know one step, and is of them summed. Whether I write a step as right or left, or , or a indicator, is just notation for the same coin. What is left is bookkeeping to pin down exactly which Binomial.
That bookkeeping is cleanest if you stop tracking the running sum and count the two kinds of step instead. Let be the number of right steps and the number of left steps. Two facts then pin down everything:
The first says every step is either a right or a left. The second is the position, since each right adds 1 and each left subtracts 1.
Now is easy to name. Over independent steps, each going right with probability , is a count of successes in fair trials. So and
Both probabilities are , so collapses to no matter what is. The entire shape of the distribution is carried by the count alone.
From R to the Position y
I still had the probability in terms of , not the position I actually care about. The same two equations bridge them. Adding and drops and gives . Landing at position forces exactly of the steps to have been rights. Substitute:
That is the whole PMF. Two constraints fix its domain, and they explain the parity pattern I had noticed by hand:
- Parity. The count has to be a whole number, so must be even, so shares the parity of . Even lands on even positions, odd on odd positions, and off-parity positions get probability 0.
- Range. The number of rights runs , which is just . You cannot get further from 0 than the number of steps you took.
The textbook runs the same derivation in its random walk example (Example 3.7.2 in the 2nd edition), writing the position as with counting the right steps. That is the same in different letters, since and .
Quick check against my hand tables: for , , exactly the I had written for position 1 under .
The Click: One Shape, Three Disguises
Once the PMF is , the bell stops being a surprise. The is a constant. The whole shape is the binomial coefficient swept across , and I already knew that coefficient peaks in the middle and drops off toward the ends.
Why the coefficient peaks
Two arguments, and the second is the one worth keeping.
Symmetry rules out a monotonic slide. Choosing items to take is the same as choosing the to leave behind, so . The values at and match, which forces a symmetric hump rather than a curve that just keeps falling.
The ratio test says where the hump turns over. Compare one coefficient to the next:
While this ratio is above 1, the sequence is still climbing. Setting rearranges to , that is . So the coefficients grow up to about the middle and shrink after it. For even there is a single peak at . For odd the ratio equals exactly 1 at the center, so the two middle values tie.
The same shape everywhere
Map that back to the walk. The count of rights is , and is largest at . Setting gives . The most likely place to end up is where you started, with the probability decaying symmetrically toward . That is the same peak, relabeled from "number of rights " to "position ".
It is also the same shape as summing two dice. There, middle sums like 7 have many more combinations () than edge sums like 2, which only comes from , so mass piles up in the center.
Worth pinning down what that dice sum actually is. With and the two dice, is not a Binomial. A die is uniform on , not a Bernoulli, so the sum is a triangular distribution, the convolution of two uniforms, which is why its plot has straight sides rather than a smooth hump. It shares the Binomial's shape through the mechanism, not the formula: both are sums of independent identical pieces, and summing independent pieces piles mass in the middle, since more input pairs land on the central values. The walk lands on the Binomial exactly because its pieces are Bernoulli steps, while the dice sum lands on a triangle because its pieces are uniform. Same family, different members.
Binomial coefficients, dice sums, and the random walk are the same peaked, symmetric object wearing different labels. The random-walk PMF is a relabeled , and nothing more. The reason it keeps smoothing toward a cleaner bell as grows has a name, the Central Limit Theorem: a sum of many independent identical pieces tends toward a bell whatever the pieces look like, and the walk is exactly such a sum.
Aside: y on Both Sides Is Fine
For a while the formula bothered me because shows up on the left and the right of . That looked like an equation I should solve for . It is not. is a function definition, read as "the probability that the random variable takes the specific value ". Capital is the random variable, lowercase is a particular number you plug in, and the PMF is often written to make that explicit. It is no stranger than having on both sides. That capital-vs-lowercase split is exactly the machinery behind probability-distributions-and-random-variables.