Poisson approximations to the negative binomial distribution
This post is an introduction to the negative binomial distribution and a discussion of different ways of approximating the negative binomial distribution. The negative binomial distribution describes the number of times a coin lands on tails before a certain number of heads are recorded. The distribution depends on two parameters and
.…
Jigsaw puzzles and the isoperimetric inequality
The 2025 World Jigsaw Puzzle Championship recently took place in Spain. In the individual heats, competitors had to choose their puzzle. Each competitor could either complete a 500-piece rectangular puzzle or a 500-piece circular puzzle. For example, in Round F, puzzlers could choose one of the following two puzzles: There are many things to consider…
The Multivariate Hypergeometric Distribution
The hypergeometric distribution describes the number of white balls in a sample of balls draw without replacement from an urn with
white balls and
black balls. The probability of having
white balls in the sample is:
This is because…
The maximum of geometric random variables
I was working on a problem involving the maximum of a collection of geometric random variables. To state the problem, let be i.i.d. geometric random variables with success probability
. Next, define
. I wanted to know the limiting distribution of
…
“Uniformly random”
The term “uniformly random” sounds like a contradiction. How can the word “uniform” be used to describe anything that’s random? Uniformly random actually has a precise meaning, and, in a sense, means “as random as possible.” I’ll explain this with an example about shuffling card. Shuffling cards Suppose I have a deck of ten cards…
Understanding the Ratio of Uniforms Distribution
The ratio of uniforms distribution is used in rejection sampling. The density of the distribution has a table mountain shape. In this post the density is derived geometrically.
The discrete arcsine distribution
The discrete arcsine distribution is an interesting distribution with connections to random walks, Markov chains and the Beta distribution. This post shows that the discrete arcsine distribution is a special case of the beta-binomial distribution.
The sample size required for importance sampling
My last post was about using importance sampling to estimate the volume of high-dimensional ball. The two figures below compare plain Monte Carlo to using importance sampling with a Gaussian proposal. Both plots use samples to estimate
, the volume of an
-dimensional ball A friend of mine pointed out that…
Monte Carlo integration in high dimensions
Plain Monte Carlo often fails in high dimensional problems such as estimating the volume of a high dimensional ball. Importance sampling is a powerful variance reduction tool.
Uniformly sampling orthogonal matrices
An matrix
is orthogonal if
. The set of all
orthogonal matrices is a compact group written as
. The uniform distribution on
is called Haar measure. There are many ways to generate random…
Something went wrong. Please refresh the page and/or try again.
Follow My Blog
Get new content delivered directly to your inbox.