Overview and motivation


Figure 1

mice with different diets
Mice with different diets

Figure 2

Graph with mice weight measurements
Does the diet affect the mice’s weight?

Our first test: Disease prevalence


Figure 1

Example: Disease prevalence

Figure 2

binomial probability distribution of number of patients with disease
The null distribution

Figure 3

The null distribution of the number of patients with disease, with significant outcomes indicated by colour.
The null distribution

Figure 4

A cup of coffee
Please take a minute…

One-sided vs. two-sided tests, and data snooping


Figure 1

Binomial null distribution with one-sided significance indicated.
One-sided test

Figure 2

Binomial null distribution with two-sided significance indicated. We should look on both sides of the distribution and ask what outcomes are unlikely. For this, we split the 5% significance to 2.5% on each side. That way, we will reject everything below 1, or above 8. The alternative hypothesis is now that the prevalence is different from 4%.


Errors in hypothesis testing


Figure 1

image of confusion matrix
Errors in hypothesis testing

One-sample t-test


Figure 1

graph showing mouse weights of one sample, and a mean to compare them to.
Scenario for one-sided t-test: Comparing mouse weights to a single value.

Figure 2

Formula for t-statistic, and graph with moise weights indicating sample mean and mu0
The t-statistic is a scaled difference between sample mean and \(\mu_0\)

Figure 3

Formula for t-statistic, and image of scale
The t-statistic weighs effect size and sample size against variance.

Figure 4

Schema for performing a one-sample t-test
One-sample t-test

The distribution of t according to the Central Limit Theorem


Figure 1

picture of fireworks

The distribution of t in practice


Figure 1


Figure 2


Figure 3


Figure 4

Graph showing t-distribution
The t distribution for different degrees of freedom (wikipedia)

The two-sample and paired t-test


Figure 1


Figure 2


Figure 3


Interpreting p-values


Figure 1


Figure 2

image showing a cup of coffee
Have a coffee! (Image: Wikimedia)

Summary and practical aspects


Figure 1

Image of a cookbook for statistical tests
Cookbook (image adapted from kindpng.com)

Figure 2

Computer screen executing wilcoxon test
In practice (image adapted from kindpng.com)

References