Abhishek S.
Shipping in public. Listening in private.

Abhishek

I lead women’s Indo-Western & Premium at Max Fashion. I also wrote the AI that runs the buying floor.

Rare profile. Category operator who ships production code.

Senior Buying Leader · Max Fashion Women’s Indo-Western & Premium · 530+ India stores NIFT ’12 · Twelve years on the floor

abhishek@bengaluru ~ %
>role: senior buying lead
>dept: women’s indo-western + premium
>floor: 530+ stores india

Poisson Process

Siméon Poisson published the distribution in 1837 inside Recherches sur la probabilité des jugements, a treatise trying to model wrongful convictions in French criminal courts. He never named it after himself. The trial-data application was a footnote; the machinery turned out to describe almost anything that arrives one-at-a-time without coordinating. One parameter, λ, rate per unit time. That is the whole model.

How it works

A counting process N(t) is Poisson with rate λ if three things hold:

  1. N(0) = 0. The clock starts empty.
  2. Independent increments. What happened in (0, s] tells you nothing about what happens in (s, t].
  3. The probability of one event in a tiny window of width h is λh + o(h). Two events in the same tiny window is o(h) — vanishingly rare.

From those axioms, two facts fall out:

The deep claim sitting underneath all this: if you superpose many independent rare-event streams, the limit is Poisson. This is the Palm-Khintchine theorem, the arrival-process cousin of the central limit theorem.

Where it shows up

Domain What arrives Typical λ
Call centres Inbound calls 100-3,000 per hour, time-varying
Retail footfall Shoppers entering a store 20-200 per 15-min window
Particle physics Photons hitting a CCD pixel depends on flux, sub-second
Insurance Claims arriving at a desk a few per day per book
Internet Packet arrivals at a router millions per second
Genomics Mutations along a DNA strand 10^-9 per base per generation
Astronomy Gamma-ray bursts in the sky ~1 per day, all-sky

Bortkiewicz's 1898 study of Prussian cavalry officers killed by horse kicks is the textbook example. Across 14 corps over 20 years, 122 deaths. Counts per corps-year fit Poisson with λ ≈ 0.61 almost perfectly. The point is not the macabre subject. The point is that an event with no plausible mechanism for clustering, sampled across many independent units, looks Poisson.

In retail operations this is load-bearing. Footfall in 15-minute windows is the input to staffing models, queueing approximations, and conversion-rate denominators. If arrivals are Poisson with rate λ(t) varying through the day, an M/M/c queue gives you closed-form expected wait times. Get the rate wrong and the staffing model is wrong before anyone has done arithmetic. This is one place where the concept bayesian inference update — treating yesterday's λ as a prior, today's count as evidence — pays for itself.

What's contested

The independence assumption is the crack in the foundation. Real arrivals cluster. Calls arrive in bursts after a TV ad airs. Shoppers arrive in waves when a mall food court empties. Photon arrivals at low intensity are Poisson, but coherent light shows bunching (Hanbury Brown-Twiss, 1956) and antibunching for single emitters. Each of these violates independent increments.

The field has three responses:

A 2011 paper by Brown et al. on call-centre arrivals found that the homogeneous Poisson model is rejected at almost every level of aggregation finer than hourly. NHPP with a smooth λ(t) survives. This matters: many textbook queueing results assume homogeneous Poisson, and the staffing recommendations they produce are systematically wrong by 10-30% during peaks.

The other open question is goodness-of-fit at the tail. Poisson tails decay roughly as e^(-x log x). Real-world tails — financial losses, network traffic, earthquake magnitudes — are often power-law. Mistaking a fat-tailed process for Poisson means under-pricing rare disasters. This is the concept fat tails critique, and it is the reason actuaries pair Poisson frequency models with non-Poisson severity distributions.

Why this has to do with other realms

The exponential inter-arrival time is the same memoryless distribution that governs radioactive decay. A single uranium-238 atom has no age — its probability of decaying in the next second is identical at t=0 and at t=4.5 billion years. This is why nuclear physicists and queueing theorists share equations. The same axiom — no memory — yields the same maths.

The connection runs further. The concept shannon information of a Poisson process per unit time is λ log(e/λ) bits when properly normalised; the rate parameter is also the information rate of the underlying source. And in evolutionary biology, the concept molecular clock uses Poisson statistics on neutral mutations to date species splits — the same machinery Poisson built for trial verdicts now dates the human-chimp divergence to roughly 6 million years ago. One distribution, four sciences, one parameter each.

An open question

If real arrival processes are routinely non-Poisson at the fine grain (clustered, self-exciting, doubly-stochastic), why does the Poisson approximation work so well at coarse aggregation? The Palm-Khintchine theorem says superposition smooths things out. But the conditions it requires — many sparse independent streams — are rarely audited in practice. When does aggregation fail to rescue the model, and how would we know before the queue collapses?

Key sources

Further reading

Abhishek's take

The thing that grabbed me late was that Poisson built this to model wrongful convictions and the distribution barely fits courtrooms — verdicts cluster around individual judges, panels, news cycles. The machinery works best where it was an afterthought: photons, packets, footfall. The general lesson is that powerful mathematical objects often outgrow the question that produced them, and the inventor rarely sees where they will land. The contested layer matters operationally — assuming independence when arrivals self-excite is how staffing models fail at exactly the moments you needed them to hold.

Where I've used this

Retail footfall in 15-minute windows is the daily working substrate. The honest version is non-homogeneous Poisson with a λ(t) curve that bends around mall anchor-tenant timings and weather; the textbook M/M/c is a useful first approximation and a dangerous final one. Pairing it with a Bayesian update on yesterday's residuals is what keeps the staffing math from drifting.

See Also

Tags: #probability #stochastic-processes #queueing #statistics #retail-ops