Skip to main content

Estimation and Confidence Intervals

Estimation and Confidence Intervals

  • Understand the difference between point estimation and interval estimation.
  • Learn how confidence intervals provide a range of likely values.
  • Compute confidence intervals for means and proportions.
  • Visualize confidence intervals with probability distributions.

Point Estimation vs. Interval Estimation

Point estimation provides a single value as an estimate of an unknown population parameter.

  • Example: Using the sample mean \( \bar{x} \) to estimate the population mean \( \mu \).

Interval estimation gives a range of values where the parameter is likely to be found, with a confidence level.

Confidence Intervals

A confidence interval (CI) is an interval estimate of a population parameter. It has the form:

\[ \text{Estimate} \pm (\text{Margin of Error}) \]

The general formula for a confidence interval for the population mean \( \mu \) is:

\[ \bar{x} \pm z^* \frac{\sigma}{\sqrt{n}} \]

where:

  • \( \bar{x} \) = sample mean
  • \( \sigma \) = population standard deviation (or \( s \) if unknown)
  • \( n \) = sample size
  • \( z^* \) = critical value from the standard normal table

Common Confidence Levels and z-values:

Confidence Level z-value
90% 1.645
95% 1.960
99% 2.576

Derivation

From the Central Limit Theorem, the sampling distribution of \( \bar{x} \) follows a normal distribution:

\[ \bar{X} \sim N\left( \mu, \frac{\sigma}{\sqrt{n}} \right) \]

Rearrange the probability statement for a normal distribution:

\[ P\left( -z^* \leq \frac{\bar{x} - \mu}{\sigma/\sqrt{n}} \leq z^* \right) = C \]

Multiplying through by \( \sigma/\sqrt{n} \):

\[ P\left( \bar{x} - z^* \frac{\sigma}{\sqrt{n}} \leq \mu \leq \bar{x} + z^* \frac{\sigma}{\sqrt{n}} \right) = C \]

This shows the confidence interval formula.

Visualization of Confidence Intervals

Examples

Example 1: A sample of 50 students has an average test score of 78, with a standard deviation of 10. Compute the 95% confidence interval for the population mean.

Using:

\[ \bar{x} = 78, \quad s = 10, \quad n = 50, \quad z^* = 1.96 \] \[ \text{Margin of Error} = 1.96 \times \frac{10}{\sqrt{50}} = 2.77 \] \[ CI = (78 - 2.77, 78 + 2.77) = (75.23, 80.77) \]

Interpretation: We are 95% confident that the true mean score is between 75.23 and 80.77.

Exercises

  • Question 1: A sample of 40 people has a mean height of 170 cm with a standard deviation of 8 cm. Find the 95% confidence interval for the population mean.
  • Question 2: A survey finds that 60% of 500 respondents support a policy. Compute a 99% confidence interval for the proportion.
  • Question 3: A sample of size 36 has a mean weight of 65 kg. Assume \( \sigma = 5 \). Compute a 90% confidence interval.
  • Question 4: A quality control study finds that 30 defective items are found in a sample of 200. Compute a 95% confidence interval for the defect rate.
  • Question 5: A researcher estimates the mean reaction time of a drug to be 2.5 seconds, with a sample of 100 trials and a standard deviation of 0.4. Find a 95% confidence interval.
  • Answer 1: \( CI = (167.5, 172.5) \).
  • Answer 2: \( CI = (0.553, 0.647) \).
  • Answer 3: \( CI = (63.63, 66.37) \).
  • Answer 4: \( CI = (0.107, 0.193) \).
  • Answer 5: \( CI = (2.42, 2.58) \).

This Week's Best Picks from Amazon

Please see more curated items that we picked from Amazon here .

Popular posts from this blog

Gaussian Elimination: A Step-by-Step Guide

Gaussian Elimination: A Step-by-Step Guide Gaussian Elimination is a systematic method for solving systems of linear equations. It works by transforming a given system into an equivalent one in row echelon form using a sequence of row operations. Once in this form, the system can be solved efficiently using back-substitution . What is Gaussian Elimination? Gaussian elimination consists of two main stages: Forward Elimination: Convert the system into an upper triangular form. Back-Substitution: Solve for unknowns starting from the last equation. Definition of a Pivot A pivot is the first nonzero entry in a row when moving from left to right. Pivots are used to eliminate the elements below them, transforming the system into an upper triangular form. Step-by-Step Example Consider the system of equations: \[ \begin{aligned} 2x + 3y - z &= 5 \\ 4x + y...

Singular Value Decomposition

Lesson Objectives ▼ Understand the concept of Singular Value Decomposition (SVD). Decompose a matrix into orthogonal matrices and singular values. Learn how to compute SVD step by step. Explore applications of SVD in data compression and machine learning. Lesson Outline ▼ Definition of SVD Computing SVD Step by Step Applications of SVD Examples Definition of Singular Value Decomposition The **Singular Value Decomposition (SVD)** of an \( m \times n \) matrix \( A \) is a factorization of the form: \[ A = U \Sigma V^T \] where: \( U \) is an \( m \times m \) orthogonal matrix (left singular vectors). \( \Sigma \) is an \( m \times n \) diagonal matrix with **singular values** on the diagonal. \( V \) is an \( n \times n \) orthogonal matrix (right singular vectors). Computing SVD Step by Step To compute \( A = U \Sigma V^T \): Find the eigenvalues and eige...

LU Decomposition

LU Decomposition: A Step-by-Step Guide LU Decomposition, also known as LU Factorization, is a method of decomposing a square matrix into two triangular matrices: a lower triangular matrix L and an upper triangular matrix U . This is useful for solving linear equations, computing determinants, and inverting matrices efficiently. What is LU Decomposition? LU Decomposition expresses a matrix A as: \[ A = LU \] where: L is a lower triangular matrix with ones on the diagonal. U is an upper triangular matrix. Step-by-Step Process Consider the matrix: \[ A = \begin{bmatrix} 2 & 3 & 1 \\ 4 & 7 & 3 \\ 6 & 18 & 5 \end{bmatrix} \] Step 1: Initialize L as an Identity Matrix Start with an identity matrix for \( L \): \[ L = \begin{bmatrix} 1 & 0 & 0 \\ 0 ...