Skip to main content

Probability Theory

  • Understand the fundamental concepts of probability.
  • Learn about probability rules and axioms.
  • Explore conditional probability and Bayes’ Theorem.
  • Visualize probability distributions.

Definition of Probability

Probability measures the likelihood of an event occurring. It is defined as:

\[ P(A) = \frac{\text{Number of favorable outcomes}}{\text{Total number of outcomes}} \]

Basic Rules of Probability

Rule Formula Description
Complement Rule \( P(A^c) = 1 - P(A) \) The probability of an event not occurring.
Addition Rule (for mutually exclusive events) \( P(A \cup B) = P(A) + P(B) \) If events A and B cannot happen together.
Multiplication Rule (for independent events) \( P(A \cap B) = P(A) P(B) \) If A’s occurrence does not affect B.

Conditional Probability and Bayes’ Theorem

Conditional probability is:

\[ P(A | B) = \frac{P(A \cap B)}{P(B)} \]

Bayes’ Theorem:

\[ P(A | B) = \frac{P(B | A) P(A)}{P(B)} \]

Proof

Starting from conditional probability:

\[ P(A | B) = \frac{P(A \cap B)}{P(B)} \]

Similarly:

\[ P(B | A) = \frac{P(A \cap B)}{P(A)} \]

Rearrange:

\[ P(A \cap B) = P(B | A) P(A) \]

Substituting in:

\[ P(A | B) = \frac{P(B | A) P(A)}{P(B)} \]

Visualizing Probability Distribution

Exercises

  • Question 1: A bag contains 4 red and 6 blue balls. What is the probability of drawing a red ball?
  • Question 2: If \( P(A) = 0.4 \), \( P(B) = 0.5 \), and \( P(A \cap B) = 0.2 \), find \( P(A \cup B) \).
  • Question 3: What is the probability of flipping two fair coins and getting at least one heads?
  • Answer 1: \( \frac{4}{10} = 0.4 \)
  • Answer 2: \( P(A \cup B) = 0.7 \)
  • Answer 3: \( \frac{3}{4} \)

This Week's Best Picks from Amazon

Please see more curated items that we picked from Amazon here .

Popular posts from this blog

LU Decomposition

LU Decomposition: A Step-by-Step Guide LU Decomposition, also known as LU Factorization, is a method of decomposing a square matrix into two triangular matrices: a lower triangular matrix L and an upper triangular matrix U . This is useful for solving linear equations, computing determinants, and inverting matrices efficiently. What is LU Decomposition? LU Decomposition expresses a matrix A as: \[ A = LU \] where: L is a lower triangular matrix with ones on the diagonal. U is an upper triangular matrix. Step-by-Step Process Consider the matrix: \[ A = \begin{bmatrix} 2 & 3 & 1 \\ 4 & 7 & 3 \\ 6 & 18 & 5 \end{bmatrix} \] Step 1: Initialize L as an Identity Matrix Start with an identity matrix for \( L \): \[ L = \begin{bmatrix} 1 & 0 & 0 \\ 0 ...

Gaussian Elimination: A Step-by-Step Guide

Gaussian Elimination: A Step-by-Step Guide Gaussian Elimination is a systematic method for solving systems of linear equations. It works by transforming a given system into an equivalent one in row echelon form using a sequence of row operations. Once in this form, the system can be solved efficiently using back-substitution . What is Gaussian Elimination? Gaussian elimination consists of two main stages: Forward Elimination: Convert the system into an upper triangular form. Back-Substitution: Solve for unknowns starting from the last equation. Definition of a Pivot A pivot is the first nonzero entry in a row when moving from left to right. Pivots are used to eliminate the elements below them, transforming the system into an upper triangular form. Step-by-Step Example Consider the system of equations: \[ \begin{aligned} 2x + 3y - z &= 5 \\ 4x + y...

Vector Spaces and Linear Transformation

Vector Spaces and Linear Transformations A vector space is a set of vectors that satisfies specific properties under vector addition and scalar multiplication. Definition of a Vector Space A set \( V \) is called a vector space over a field \( \mathbb{R} \) (real numbers) if it satisfies the following properties: Closure under addition: If \( \mathbf{u}, \mathbf{v} \in V \), then \( \mathbf{u} + \mathbf{v} \in V \). Closure under scalar multiplication: If \( \mathbf{v} \in V \) and \( c \in \mathbb{R} \), then \( c\mathbf{v} \in V \). Associativity: \( (\mathbf{u} + \mathbf{v}) + \mathbf{w} = \mathbf{u} + (\mathbf{v} + \mathbf{w}) \). Commutativity: \( \mathbf{u} + \mathbf{v} = \mathbf{v} + \mathbf{u} \). Existence of a zero vector: There exists a vector \( \mathbf{0} \) such that \( \mathbf{v} + \mathbf{0} = \mathbf{v} \). Existence of additive inverses: For eac...