Law of Large Numbers

From GM-RKB
Jump to navigation Jump to search

A Law of Large Numbers is a theorem that proves that for a random sample of size [math]\displaystyle{ n }[/math], as [math]\displaystyle{ n\to\infty }[/math]the sample mean approaches to population mean.



References

2014

  • (Wikipedia, 2014) ⇒ http://en.wikipedia.org/wiki/Law_of_large_numbers Retrieved:2014-5-14.
    • In probability theory, the law of large numbers (LLN) is a theorem that describes the result of performing the same experiment a large number of times. According to the law, the average of the results obtained from a large number of trials should be close to the expected value, and will tend to become closer as more trials are performed.

      The LLN is important because it "guarantees" stable long-term results for the averages of random events. For example, while a casino may lose money in a single spin of the roulette wheel, its earnings will tend towards a predictable percentage over a large number of spins. Any winning streak by a player will eventually be overcome by the parameters of the game. It is important to remember that the LLN only applies (as the name indicates) when a large number of observations are considered. There is no principle that a small number of observations will coincide with the expected value or that a streak of one value will immediately be "balanced" by the others. See the Gambler's fallacy.


  • (Wikipedia, 2014) ⇒ http://en.wikipedia.org/wiki/Probability_theory#Law_of_large_numbers Retrieved:2014-5-14.
    • Common intuition suggests that if a fair coin is tossed many times, then roughly half of the time it will turn up heads, and the other half it will turn up tails. Furthermore, the more often the coin is tossed, the more likely it should be that the ratio of the number of heads to the number of tails will approach unity. Modern probability provides a formal version of this intuitive idea, known as the law of large numbers. This law is remarkable because it is not assumed in the foundations of probability theory, but instead emerges from these foundations as a theorem. Since it links theoretically derived probabilities to their actual frequency of occurrence in the real world, the law of large numbers is considered as a pillar in the history of statistical theory and has had widespread influence.

      The law of large numbers (LLN) states that the sample average :[math]\displaystyle{ \overline{X}_n=\frac1n{\sum_{k=1}^n X_k} }[/math] of a sequence of independent and identically distributed random variables [math]\displaystyle{ X_k }[/math] converges towards their common expectation [math]\displaystyle{ \mu }[/math], provided that the expectation of [math]\displaystyle{ |X_k| }[/math] is finite.

      It is in the different forms of convergence of random variables that separates the weak and the strong law of large numbers :[math]\displaystyle{ \begin{array}{lll} \text{Weak law:} & \overline{X}_n \, \xrightarrow{P} \, \mu & \text{for } n \to \infty \\ \text{Strong law:} & \overline{X}_n \, \xrightarrow{\mathrm{a.\,s.}} \, \mu & \text{for } n \to \infty . \end{array} }[/math] It follows from the LLN that if an event of probability p is observed repeatedly during independent experiments, the ratio of the observed frequency of that event to the total number of repetitions converges towards p.

      For example, if [math]\displaystyle{ Y_1,Y_2,...\, }[/math] are independent Bernoulli random variables taking values 1 with probability p and 0 with probability 1-p, then [math]\displaystyle{ \textrm{E}(Y_i)=p }[/math] for all i, so that [math]\displaystyle{ \bar Y_n }[/math] converges to p almost surely.

2001

1995

1985

  • (Judd, 1985) ⇒ Kenneth L. Judd. (1985). “The Law of Large Numbers with a Continuum of Iid Random Variables.” In: Journal of Economic theory 35, no. 1

1965

1947