Chapter 19: Nonparametric Methods
2026-04-15
This presentation is based on the following books. The references are coming from these books unless otherwise specified.
Main sources:
ClassShare App
You may be asked in class to go to the ClassShare App to answer questions.
SPSS Tutorial
A physical therapist rates the functional recovery of 20 patients on a 0–100 scale before and after a 6-week program. The scores are bounded, skewed toward the floor at pre-test, and the sample is small. She wants to know whether patients improved. What test should she use and why?
By the end of this chapter, you should be able to:
Use nonparametric when:
What nonparametric tests give up:
Warning
Using nonparametric tests “just to be safe” when assumptions are met unnecessarily reduces power. Choose based on evidence, not habit.
Most nonparametric tests share one core mechanism: convert raw scores → ranks, then compute on ranks
| Participant | Raw score | Rank |
|---|---|---|
| A | 48 | 1 |
| B | 62 | 2 |
| C | 71 | 3 |
| D | 85 | 4 |
| E | 91 | 5 |
Key insight: After ranking, the test depends only on the ordering, not the exact magnitudes. An outlier of 48 and an outlier of −200 receive the same rank (1) — this is the source of robustness.
Tied ranks: When participants share the same raw score, each receives the average of the ranks they would have occupied (e.g., two tied scores at ranks 3 and 4 → both receive rank 3.5). SPSS handles this automatically.
Goodness-of-Fit
Test of Independence
Critical assumption: All expected cell counts ≥ 5. If violated → use Fisher’s exact test (2×2 tables).
Research question: Is the distribution of participants across training and control groups independent of sex?
| Control | Training | Row total | |
|---|---|---|---|
| Female | 21 | 12 | 33 |
| Male | 9 | 18 | 27 |
| Col total | 30 | 30 | 60 |
See Figure 1 in the SMS textbook (Ch. 19): mosaic plot of sex by group assignment — tile height represents the proportion of each sex within each group, visualizing the overrepresentation of females in the control group.
APA write-up:
A chi-square test of independence revealed a statistically significant association between participant sex and group assignment, χ²(1, N = 60) = 5.45, p = .020, φ = .302. Females were proportionally more common in the control group (70%) than the training group (40%).
When to use Spearman ρ instead of Pearson r:
What Spearman measures: Whether one variable tends to increase as the other increases (or decreases) — regardless of whether the pattern is a straight line.
Example from Ch. 19: Is there an association between post-test muscular strength and 20-m sprint time?
See Figure 2 (fig-spearman-scatter) in the SMS textbook (Ch. 19): scatter plot with lowess smoother showing the strong negative monotonic relationship between post-test strength and sprint time (N = 60).
Nonparametric alternative to: Independent-samples t-test
Use when: Two independent groups; outcome is ordinal or severely non-normal in small samples
How it works:
Effect size: Rank-biserial r (range −1 to +1; same magnitude benchmarks as Pearson r)
Example from Ch. 19: Do training and control groups differ in post-test RPE (Borg 6–20 scale)?
See Figure 3 (fig-mwu-boxplot) in the SMS textbook (Ch. 19): boxplots of post-test RPE by group — the control group shows higher RPE values (Mdn = 13) than the training group (Mdn = 12).
Nonparametric alternative to: Paired-samples t-test
Use when: Two related measurements per participant (pre/post, left/right); difference scores are not normally distributed or are ordinal
How it works:
Wilcoxon vs. sign test: Wilcoxon uses the magnitude and direction of differences → more powerful. Sign test uses direction only → use only when magnitudes are untrustworthy.
Example from Ch. 19: Did functional ability improve from pre- to post-test in the training group?
See Figure 4 (fig-wilcoxon-paired) in the SMS textbook (Ch. 19): paired scatter plot connecting each participant’s pre and post functional scores — nearly all lines slope upward, consistent with the large effect.
Nonparametric alternative to: One-way between-subjects ANOVA
Use when: Three or more independent groups; outcome is ordinal or severely non-normal
How it works: - Pool all scores across groups → rank together - H statistic based on rank sums within each group (approximately chi-square distributed, df = k − 1) - Significant H → at least one group’s distribution tends to be higher or lower than the others
After a significant result → post hoc comparisons: - Dunn’s test (Bonferroni-corrected) pairwise Mann-Whitney comparisons - Same logic as post hoc in ANOVA: omnibus first, then pairwise
Note: When k = 2, Kruskal-Wallis is mathematically equivalent to Mann-Whitney U — use Mann-Whitney directly.
Example from Ch. 19: Do balance errors differ across three time points in the full sample?
Nonparametric alternative to: One-way repeated-measures ANOVA
Use when: Same participants measured under k ≥ 3 conditions; outcome is ordinal or non-normal
How it works: - Rank scores within each participant across conditions (each participant has their own ranks 1 through k) - Test statistic based on whether condition rank sums differ more than chance predicts - Significant result → at least one condition differs from the others
Effect size: Kendall’s W (concordance coefficient, 0–1) - Near 0: participants show no consistent ordering across conditions - Near 1: all participants rank conditions in the same order
After a significant result: Pairwise Wilcoxon signed-rank tests with Bonferroni correction
Example from Ch. 19: Does RPE change across pre, mid, post in the training group?
See Figure 5 (fig-friedman-profile) in the SMS textbook (Ch. 19): individual RPE profiles across time — criss-crossing lines show no consistent directional trend, consistent with a non-significant result.
See Table 1 (tbl-nonparam-guide) in the SMS textbook (Ch. 19) for the complete decision guide. Key mappings:
| Design | Parametric analogue | Nonparametric test | Effect size |
|---|---|---|---|
| 1 sample vs. median | One-sample t | Sign test | p̂ |
| Categorical outcome, 1 variable | — | Chi-square GoF | Cramér’s V |
| Categorical outcome, 2 variables | — | Chi-square independence | φ or Cramér’s V |
| Monotonic relationship | Pearson r | Spearman ρ | ρ |
| 2 independent groups | Independent t | Mann-Whitney U | Rank-biserial r |
| 2 related samples | Paired t | Wilcoxon signed-rank | Rank-biserial r |
| ≥3 independent groups | One-way ANOVA | Kruskal-Wallis | η²_H |
| ≥3 related conditions | Repeated-measures ANOVA | Friedman’s | Kendall’s W |
| 2+ factors, between-subjects | Factorial ANOVA | Scheirer-Ray-Hare | η²_H per effect |
The key decision questions: 1. How many groups/conditions? (2 vs. ≥3) 2. Independent or related/repeated measurements? 3. Is the outcome continuous, ordinal, or categorical?
Always report an effect size alongside the p-value. A non-significant result does not mean the effect is zero.
| Test | Effect size | Range | Benchmarks |
|---|---|---|---|
| Chi-square (2×2) | Phi (φ) | 0–1 | .10 small / .30 medium / .50 large |
| Chi-square (larger) | Cramér’s V | 0–1 | same |
| Spearman ρ | ρ itself | −1 to +1 | same as Pearson r |
| Mann-Whitney U | Rank-biserial r | −1 to +1 | .10 / .30 / .50 |
| Wilcoxon signed-rank | Rank-biserial r | −1 to +1 | .10 / .30 / .50 |
| Kruskal-Wallis | η²_H | 0–1 | .01 / .06 / .14 |
| Friedman’s | Kendall’s W | 0–1 | concordance, not η² |
Warning
Kendall’s W ≠ eta-squared. W measures concordance in rank ordering across participants. Do not benchmark it against ANOVA effect size standards.
Using nonparametric “just to be safe.” Rank transformation discards information and reduces power when parametric assumptions are met. Base the choice on evidence, not habit.
Treating non-significance as equivalence. A non-significant result with a small sample may simply lack power. Always report the effect size so readers can evaluate practical significance.
Ignoring expected cell count requirements. Running chi-square with expected counts < 5 produces an unreliable p-value. Check SPSS output — if any expected cell is < 5, switch to Fisher’s exact test.
Running multiple nonparametric follow-ups without correction. Post-hoc Wilcoxon or Mann-Whitney tests after a significant Friedman or Kruskal-Wallis inflate familywise Type I error. Apply Bonferroni or Holm correction.
Misinterpreting Kendall’s W as eta-squared. W = .26 means moderate concordance in rank ordering — it does not mean “26% of variance explained.”
Omitting effect sizes. Statistical significance and effect size are both required for a complete APA report.
Chi-square independence: > “A chi-square test of independence revealed a [significant/non-significant] association between [var1] and [var2], χ²(df, N = n) = [value], p = [value], φ/V = [value].”
Spearman ρ: > “Spearman rank-order correlation indicated a [strong/moderate/weak] [positive/negative] [significant/non-significant] association between [var1] and [var2], ρ(df) = [value], p = [value].”
Mann-Whitney U: > “A Mann-Whitney U test indicated that [group 1] (Mdn = [value]) [significantly/did not significantly] differ from [group 2] (Mdn = [value]), U = [value], p = [value], r = [value].”
Wilcoxon signed-rank: > “A Wilcoxon signed-rank test revealed a [significant/non-significant] change from [time 1] (Mdn = [value]) to [time 2] (Mdn = [value]), W = [value], p = [value], r = [value].”
Kruskal-Wallis: > “A Kruskal-Wallis test indicated [significant/non-significant] differences across groups, H(df) = [value], p = [value], η²_H = [value]. [Post-hoc Dunn-Bonferroni comparisons revealed that…]”
Friedman’s test: > “Friedman’s test revealed [significant/non-significant] differences across conditions, χ²(df) = [value], p = [value], W = [value].”
Q1. A researcher measures muscle soreness (0–10 VAS) in 20 participants at pre-, mid-, and post-intervention (same participants at all three time points). Which test should they use?
Q2. A sport scientist uses a chi-square test of independence on a 3×4 contingency table and finds three cells with expected counts of 2. What should they do?
Q3. A Kruskal-Wallis test comparing four groups yields H(3) = 11.84, p = .008. What does this tell you, and what must you do next?