Multivariate random variable

Multinomial distribution

A random vector ⃗𝐗 :𝜉 →ℝ𝑘 has a 𝑘-dimensional multinomial distribution iff it is the sum of 𝑛 independently distributed categorically distributed variables #m/def/prob

𝑌𝑖∼Cat𝑘(⃗𝐩)𝑋=𝑛∑𝑖=1𝑌𝑖𝑋∼Multi𝑘(𝑛,⃗𝐩)

The joint probability mass function is

ℙ(⃗𝐗=⃗𝐱)=𝑛!𝑘∏𝑖=1𝑝𝑥𝑖𝑖𝑥𝑖!

and 𝑋𝑖 ∼Bin⁡(𝑛,𝑝𝑖). Hence this generalizes the binomial distribution.

Properties

  1. Multinomial lumping (𝑋1 +𝑋2,𝑋3,…,𝑋𝑘) ∼Mult𝑘−1(𝑛,(𝑝1 +𝑝2,𝑝3,…,𝑝𝑘))
  2. Multinomial conditioning (𝑋2,…,𝑋𝑘) ∣𝑋1 =𝑥1 ∼Mult𝑘−1(𝑛 −𝑛1,(𝑝′2,…,𝑝′𝑘)) where 𝑝′𝑗 =𝑝𝑗𝑝2+⋯+𝑝𝑘
  3. Cov⁡[𝑋𝑖,𝑋𝑗] = −𝑛𝑝𝑖𝑝𝑗 for 𝑖 ≠𝑗.


#state/develop | #lang/en | #SemBr