Skip to main content

This Week's Best Picks from Amazon

Please see more curated items that we picked from Amazon here .

Estimation and Confidence Intervals

Estimation and Confidence Intervals

  • Understand the difference between point estimation and interval estimation.
  • Learn how confidence intervals provide a range of likely values.
  • Compute confidence intervals for means and proportions.
  • Visualize confidence intervals with probability distributions.

Point Estimation vs. Interval Estimation

Point estimation provides a single value as an estimate of an unknown population parameter.

  • Example: Using the sample mean \( \bar{x} \) to estimate the population mean \( \mu \).

Interval estimation gives a range of values where the parameter is likely to be found, with a confidence level.

Confidence Intervals

A confidence interval (CI) is an interval estimate of a population parameter. It has the form:

\[ \text{Estimate} \pm (\text{Margin of Error}) \]

The general formula for a confidence interval for the population mean \( \mu \) is:

\[ \bar{x} \pm z^* \frac{\sigma}{\sqrt{n}} \]

where:

  • \( \bar{x} \) = sample mean
  • \( \sigma \) = population standard deviation (or \( s \) if unknown)
  • \( n \) = sample size
  • \( z^* \) = critical value from the standard normal table

Common Confidence Levels and z-values:

Confidence Level z-value
90% 1.645
95% 1.960
99% 2.576

Derivation

From the Central Limit Theorem, the sampling distribution of \( \bar{x} \) follows a normal distribution:

\[ \bar{X} \sim N\left( \mu, \frac{\sigma}{\sqrt{n}} \right) \]

Rearrange the probability statement for a normal distribution:

\[ P\left( -z^* \leq \frac{\bar{x} - \mu}{\sigma/\sqrt{n}} \leq z^* \right) = C \]

Multiplying through by \( \sigma/\sqrt{n} \):

\[ P\left( \bar{x} - z^* \frac{\sigma}{\sqrt{n}} \leq \mu \leq \bar{x} + z^* \frac{\sigma}{\sqrt{n}} \right) = C \]

This shows the confidence interval formula.

Visualization of Confidence Intervals

Examples

Example 1: A sample of 50 students has an average test score of 78, with a standard deviation of 10. Compute the 95% confidence interval for the population mean.

Using:

\[ \bar{x} = 78, \quad s = 10, \quad n = 50, \quad z^* = 1.96 \] \[ \text{Margin of Error} = 1.96 \times \frac{10}{\sqrt{50}} = 2.77 \] \[ CI = (78 - 2.77, 78 + 2.77) = (75.23, 80.77) \]

Interpretation: We are 95% confident that the true mean score is between 75.23 and 80.77.

Exercises

  • Question 1: A sample of 40 people has a mean height of 170 cm with a standard deviation of 8 cm. Find the 95% confidence interval for the population mean.
  • Question 2: A survey finds that 60% of 500 respondents support a policy. Compute a 99% confidence interval for the proportion.
  • Question 3: A sample of size 36 has a mean weight of 65 kg. Assume \( \sigma = 5 \). Compute a 90% confidence interval.
  • Question 4: A quality control study finds that 30 defective items are found in a sample of 200. Compute a 95% confidence interval for the defect rate.
  • Question 5: A researcher estimates the mean reaction time of a drug to be 2.5 seconds, with a sample of 100 trials and a standard deviation of 0.4. Find a 95% confidence interval.
  • Answer 1: \( CI = (167.5, 172.5) \).
  • Answer 2: \( CI = (0.553, 0.647) \).
  • Answer 3: \( CI = (63.63, 66.37) \).
  • Answer 4: \( CI = (0.107, 0.193) \).
  • Answer 5: \( CI = (2.42, 2.58) \).

Popular posts from this blog

Gaussian Elimination: A Step-by-Step Guide

Gaussian Elimination: A Step-by-Step Guide Gaussian Elimination is a systematic method for solving systems of linear equations. It works by transforming a given system into an equivalent one in row echelon form using a sequence of row operations. Once in this form, the system can be solved efficiently using back-substitution . What is Gaussian Elimination? Gaussian elimination consists of two main stages: Forward Elimination: Convert the system into an upper triangular form. Back-Substitution: Solve for unknowns starting from the last equation. Definition of a Pivot A pivot is the first nonzero entry in a row when moving from left to right. Pivots are used to eliminate the elements below them, transforming the system into an upper triangular form. Step-by-Step Example Consider the system of equations: \[ \begin{aligned} 2x + 3y - z &= 5 \\ 4x + y...

Singular Value Decomposition

Lesson Objectives ▼ Understand the concept of Singular Value Decomposition (SVD). Decompose a matrix into orthogonal matrices and singular values. Learn how to compute SVD step by step. Explore applications of SVD in data compression and machine learning. Lesson Outline ▼ Definition of SVD Computing SVD Step by Step Applications of SVD Examples Definition of Singular Value Decomposition The **Singular Value Decomposition (SVD)** of an \( m \times n \) matrix \( A \) is a factorization of the form: \[ A = U \Sigma V^T \] where: \( U \) is an \( m \times m \) orthogonal matrix (left singular vectors). \( \Sigma \) is an \( m \times n \) diagonal matrix with **singular values** on the diagonal. \( V \) is an \( n \times n \) orthogonal matrix (right singular vectors). Computing SVD Step by Step To compute \( A = U \Sigma V^T \): Find the eigenvalues and eige...

Eigenvalues and Eigenvectors

Lesson Objectives ▼ Understand the definition of eigenvalues and eigenvectors. Learn how to compute eigenvalues and eigenvectors. Explore the characteristic equation. Interpret eigenvalues and eigenvectors in transformations. Understand diagonalization and its applications. Lesson Outline ▼ Definition of Eigenvalues and Eigenvectors Characteristic Equation Diagonalization Examples Definition of Eigenvalues and Eigenvectors In a linear transformation, an eigenvector is a nonzero vector that only changes by a scalar factor when the transformation is applied. For a square matrix \( A \), an eigenvector \( \mathbf{v} \) and its corresponding eigenvalue \( \lambda \) satisfy: \[ A\mathbf{v} = \lambda \mathbf{v} \] \( A \) is an \( n \times n \) matrix. \( \mathbf{v} \neq 0 \) is an eigenvector. \( \lambda \) is a scalar eigenvalue. Characteristic Equation ...