Law of Large Numbers

Wikipedia: Law of large numbers

The fundamental statistical result that the average of a sequence of n independent identically distributed random variables tends to their common mean as n tends to infinity, whence the relative frequency of the occurrence of an event in n independent repetitions of an experiment tends to its probability as n increases without limit.

Bibliography