Statistical Inference/Probability Theory
From Wiki**3
< Statistical Inference
Set Theory
Sample Space [Definition 1.1.1]
The set, S, of all possible outcomes of a particular experiment is called the sample space for the experiment.
Event [Definition 1.1.2]
An event is any collection of possible outcomes of an experiment, that is, any subset of S (including S itself).
Let A be an event, a subset of S. We say the event A occurs if the outcome of the experiment is in the set A. When speaking of probabilities, we generally speak of the probability of an event, rather than a set. But we may use the terms interchangeably.
Base relationships
We first need to define formally the following two relationships, which allow us to order and equate sets:
Containment:
<amsmath>A \subset B \Leftrightarrow x \in A \Rightarrow x \in B</amsmath>
Equality:
<amsmath>A = B \Leftrightarrow A \subset B \land B \subset A</amsmath>
Base operations
Given any two events (or sets) A and B , we have the following elementary set operations:
Union: The union of A and B, written <amsmath>A \cup B</amsmath>, is the set of elements that belong to either A or B or both:
<amsmath>A \cup B = \{ x : x \in A \lor x \in B \}</amsmath>
Intersection: The intersection of A and B, written <amsmath>A \cap B</amsmath>, is the set of elements that belong to both A and B:
<amsmath>A \cap B = \{ x : x \in A \land x \in B \}</amsmath>
Complementation: The complement of A, written <amsmath>A^c</amsmath>, is the set of all elements that are not in A:
<amsmath>A^c = \{ x : x \notin A \}</amsmath>
Event Operations [Theorem 1.1.4]
The elementary set operations can be combined, somewhat akin to the way addition and multiplication can be combined. As long as we are careful, we can treat sets as if they were numbers. We can now state the following useful properties of set operations.
For any three events, A, B, and C, defined on a sample space S ,
Commutativity
- <amsmath>A \cup B = B \cup A</amsmath>
- <amsmath>A \cap B = B \cap A</amsmath>
Associativity
- <amsmath>A \cup (B \cup C) = (A \cup B) \cup C</amsmath>
- <amsmath>A \cap (B \cap C) = (A \cap B) \cap C</amsmath>
Distributive Laws
- <amsmath>A \cap (B \cup C) = (A \cap B) \cup (A \cap C)</amsmath>
- <amsmath>A \cup (B \cap C) = (A \cup B) \cap (A \cup C)</amsmath>
DeMorgan Laws
- <amsmath>\overline{A \cup B} = \overline{A} \cap \overline{B}</amsmath>
- <amsmath>\overline{A \cap B} = \overline{A} \cup \overline{B}</amsmath>