Inferential Statistics
- Inferential Statistics – Definition, Types, Examples, Formulas
- Observational Studies and Experiments
- Sample and Population
- Sampling Bias
- Sampling Methods
- Research Study Design
- Population Distribution, Sample Distribution and Sampling Distribution
- Central Limit Theorem
- Point Estimates
- Confidence Intervals
- Introduction to Bootstrapping
- Bootstrap Confidence Interval
- Paired Samples
- Impact of Sample Size on Confidence Intervals
- Introduction to Hypothesis Testing
- Writing Hypotheses
- Hypotheses Test Examples
- Randomization Procedures
- p-values
- Type I and Type II Errors
- P-value Significance Level
- Issues with Multiple Testing
- Confidence Intervals and Hypothesis Testing
- Inference for One Sample
- Inference for Two Samples
- One-Way ANOVA
- Two-Way ANOVA
- Chi-Square Tests
Population Distribution, Sample Distribution and Sampling Distribution
Population Distribution
Population distribution refers to the distribution of a particular characteristic or variable among all individuals or units in a specific population. For example, the population distribution of heights in a country would refer to the distribution of heights among all individuals living in that country.
The population is the whole set of values, or individuals, you are interested in. For example, if you want to know the average height of the residents of India, that is your population, i.e., the population of India.
Population characteristic are mean (μ), Standard deviation (σ) , proportion (P) , median, percentiles etc. The value of a population characteristic is fixed. This characteristics are called population distribution. They are symbolized by Greek characters as they are population parameters.
Sample Distribution
Sample distribution refers to the distribution of a particular characteristic or variable among the individuals or units selected from a population. For example, if we take a random sample of 100 individuals from a country’s population and measure their heights, the distribution of heights in the sample is called the sample distribution.
The sample is a subset of the population, and is the set of values you actually use in your estimation. Let’s think 1000 individual you have selected for your study to know about average height of the residents of India. This sample has some quantity computed from values e.g. mean (x ), Standard deviation (s) , sample proportion etc. This is called sample distribution. The mean and standard deviation are symbolized by Roman characters as they are sample statistics.
Sampling Distribution
Sampling distribution refers to the distribution of a statistic (such as the mean, standard deviation, etc.) calculated from multiple random samples of the same size drawn from a population. For example, if we take multiple random samples of 100 individuals from a country’s population and calculate the mean height of each sample, the distribution of these means is called the sampling distribution. The central limit theorem states that under certain conditions, the sampling distribution of the sample mean will be approximately normal, regardless of the shape of the population distribution.
Researchers often use a sample to draw inferences about the population that sample is from. To do that, they make use of a probability distribution that is very important in the world of statistics: the sampling distribution. It is theoretical distribution. The distribution of sample statistics is called sampling distribution.
We have a population of x values whose histogram is the probability distribution of x. Select a sample of size n from this population and calculate a sample statistic e.g. . This procedure can be repeated indefinitely and generates a population of values for the sample statistic and the histogram is the sampling distribution of the sample statistics.
For example, If you draw an indefinite number of sample of 1000 respondents from the population the distribution of the infinite number of sample means would be called the sampling distribution of the mean.
Take another example, suppose that a sample of size sixteen (N=16) is taken from some population. The mean of the sixteen numbers is computed. Next a new sample of sixteen is taken, and the mean is again computed. If this process were repeated an infinite number of times, the distribution of the now infinite number of sample means would be called the sampling distribution of the mean.
Consider below diagram to get more clarification about sampling distribution.
The population which consists of a set of scores (5, 6, 7, 8 and 9) which distribute around a parameter mean of 7.00. From this population, we can draw a number of samples. Each sample consists of three scores which constitute a subset of the population. The sample scores distribute around some statistic mean for each sample. For sample A, for instance, the scores are 5, 6 and 7 (the sample distribution for A) and the associated statistic mean is 6.00. For sample B the scores are 5, 8 and 8, and the statistic mean is 7.00. Each sample has a statistic mean. The statistics associated with the various samples can now be gathered into a distribution of their own. The distribution will consist of a set of values of a statistic, rather than a set of observed values. This leads to the definition for a sampling distribution: A sampling distribution is a statement of the frequency with which values of statistics are observed or are expected to be observed when a number of random samples is drawn from a given population.
Every statistic has a sampling distribution. For example, suppose that instead of the mean, medians were computed for each sample. The infinite number of medians would be called the sampling distribution of the median.
The sampling distribution of the mean is represented by the symbol , that of the median by , etc.
The standard deviation of the sampling distribution of the mean is called the standard error of the mean and is symbolized by . Similarly, the standard deviation of the sampling distribution of the median is called the standard error of the median and is symbolized by .
Examples of Population Distribution, Sample Distribution and Sampling Distribution
Population Distribution: The population distribution of annual income for all working adults in the United States.
Sample Distribution: A researcher randomly selects 200 working adults from the United States and records their annual income to create a sample distribution of income.
Sampling Distribution: A statistician takes 1000 random samples of 50 working adults each from the United States population and calculates the mean income of each sample. The distribution of these sample means is the sampling distribution of the mean income.