Skip to main content

Estimation and Confidence Intervals

Estimation and Confidence Intervals

  • Understand the difference between point estimation and interval estimation.
  • Learn how confidence intervals provide a range of likely values.
  • Compute confidence intervals for means and proportions.
  • Visualize confidence intervals with probability distributions.

Point Estimation vs. Interval Estimation

Point estimation provides a single value as an estimate of an unknown population parameter.

  • Example: Using the sample mean \( \bar{x} \) to estimate the population mean \( \mu \).

Interval estimation gives a range of values where the parameter is likely to be found, with a confidence level.

Confidence Intervals

A confidence interval (CI) is an interval estimate of a population parameter. It has the form:

\[ \text{Estimate} \pm (\text{Margin of Error}) \]

The general formula for a confidence interval for the population mean \( \mu \) is:

\[ \bar{x} \pm z^* \frac{\sigma}{\sqrt{n}} \]

where:

  • \( \bar{x} \) = sample mean
  • \( \sigma \) = population standard deviation (or \( s \) if unknown)
  • \( n \) = sample size
  • \( z^* \) = critical value from the standard normal table

Common Confidence Levels and z-values:

Confidence Level z-value
90% 1.645
95% 1.960
99% 2.576

Derivation

From the Central Limit Theorem, the sampling distribution of \( \bar{x} \) follows a normal distribution:

\[ \bar{X} \sim N\left( \mu, \frac{\sigma}{\sqrt{n}} \right) \]

Rearrange the probability statement for a normal distribution:

\[ P\left( -z^* \leq \frac{\bar{x} - \mu}{\sigma/\sqrt{n}} \leq z^* \right) = C \]

Multiplying through by \( \sigma/\sqrt{n} \):

\[ P\left( \bar{x} - z^* \frac{\sigma}{\sqrt{n}} \leq \mu \leq \bar{x} + z^* \frac{\sigma}{\sqrt{n}} \right) = C \]

This shows the confidence interval formula.

Visualization of Confidence Intervals

Examples

Example 1: A sample of 50 students has an average test score of 78, with a standard deviation of 10. Compute the 95% confidence interval for the population mean.

Using:

\[ \bar{x} = 78, \quad s = 10, \quad n = 50, \quad z^* = 1.96 \] \[ \text{Margin of Error} = 1.96 \times \frac{10}{\sqrt{50}} = 2.77 \] \[ CI = (78 - 2.77, 78 + 2.77) = (75.23, 80.77) \]

Interpretation: We are 95% confident that the true mean score is between 75.23 and 80.77.

Exercises

  • Question 1: A sample of 40 people has a mean height of 170 cm with a standard deviation of 8 cm. Find the 95% confidence interval for the population mean.
  • Question 2: A survey finds that 60% of 500 respondents support a policy. Compute a 99% confidence interval for the proportion.
  • Question 3: A sample of size 36 has a mean weight of 65 kg. Assume \( \sigma = 5 \). Compute a 90% confidence interval.
  • Question 4: A quality control study finds that 30 defective items are found in a sample of 200. Compute a 95% confidence interval for the defect rate.
  • Question 5: A researcher estimates the mean reaction time of a drug to be 2.5 seconds, with a sample of 100 trials and a standard deviation of 0.4. Find a 95% confidence interval.
  • Answer 1: \( CI = (167.5, 172.5) \).
  • Answer 2: \( CI = (0.553, 0.647) \).
  • Answer 3: \( CI = (63.63, 66.37) \).
  • Answer 4: \( CI = (0.107, 0.193) \).
  • Answer 5: \( CI = (2.42, 2.58) \).

This Week's Best Picks from Amazon

Please see more curated items that we picked from Amazon here .

Popular posts from this blog

LU Decomposition

LU Decomposition: A Step-by-Step Guide LU Decomposition, also known as LU Factorization, is a method of decomposing a square matrix into two triangular matrices: a lower triangular matrix L and an upper triangular matrix U . This is useful for solving linear equations, computing determinants, and inverting matrices efficiently. What is LU Decomposition? LU Decomposition expresses a matrix A as: \[ A = LU \] where: L is a lower triangular matrix with ones on the diagonal. U is an upper triangular matrix. Step-by-Step Process Consider the matrix: \[ A = \begin{bmatrix} 2 & 3 & 1 \\ 4 & 7 & 3 \\ 6 & 18 & 5 \end{bmatrix} \] Step 1: Initialize L as an Identity Matrix Start with an identity matrix for \( L \): \[ L = \begin{bmatrix} 1 & 0 & 0 \\ 0 ...
Read more

Gaussian Elimination: A Step-by-Step Guide

Gaussian Elimination: A Step-by-Step Guide Gaussian Elimination is a systematic method for solving systems of linear equations. It works by transforming a given system into an equivalent one in row echelon form using a sequence of row operations. Once in this form, the system can be solved efficiently using back-substitution . What is Gaussian Elimination? Gaussian elimination consists of two main stages: Forward Elimination: Convert the system into an upper triangular form. Back-Substitution: Solve for unknowns starting from the last equation. Definition of a Pivot A pivot is the first nonzero entry in a row when moving from left to right. Pivots are used to eliminate the elements below them, transforming the system into an upper triangular form. Step-by-Step Example Consider the system of equations: \[ \begin{aligned} 2x + 3y - z &= 5 \\ 4x + y...
Read more

Vector Spaces and Linear Transformation

Vector Spaces and Linear Transformations A vector space is a set of vectors that satisfies specific properties under vector addition and scalar multiplication. Definition of a Vector Space A set \( V \) is called a vector space over a field \( \mathbb{R} \) (real numbers) if it satisfies the following properties: Closure under addition: If \( \mathbf{u}, \mathbf{v} \in V \), then \( \mathbf{u} + \mathbf{v} \in V \). Closure under scalar multiplication: If \( \mathbf{v} \in V \) and \( c \in \mathbb{R} \), then \( c\mathbf{v} \in V \). Associativity: \( (\mathbf{u} + \mathbf{v}) + \mathbf{w} = \mathbf{u} + (\mathbf{v} + \mathbf{w}) \). Commutativity: \( \mathbf{u} + \mathbf{v} = \mathbf{v} + \mathbf{u} \). Existence of a zero vector: There exists a vector \( \mathbf{0} \) such that \( \mathbf{v} + \mathbf{0} = \mathbf{v} \). Existence of additive inverses: For eac...
Read more