ANOVA: How to Run It Online and Report It in APA7
Analysis of variance (ANOVA) tests whether the means of three or more groups or conditions differ, using one overall test instead of many t-tests.
What is ANOVA?
Analysis of variance (ANOVA) tests whether the means of three or more groups or conditions differ, using one overall test instead of many t-tests.
When to use it
Use ANOVA when you compare means across three or more groups, across repeated measurements, or across combinations of two factors.
Example question: Do three teaching methods lead to different average scores?
Preparing your data
Between-subjects: one row per participant with a group column and an outcome column. Repeated measures: one row per participant and one column per condition or time.
Example dataset (simulated; first rows of 75): id, method (Method A, B or C), score (0 to 100); long format.
| id | method | score |
|---|---|---|
| 1 | Method A | 67.0 |
| 2 | Method A | 75.0 |
| 3 | Method A | 71.0 |
| 4 | Method A | 81.0 |
| 5 | Method A | 73.0 |
| 6 | Method A | 77.0 |
Download the full example CSV to practise. If the tool asks for a different layout, follow the instructions on its page.
How to run it on StatFas
- Open the ANOVA tool. You do not need an account to run an analysis.
- Enter your data or upload your file, laid out as described in Preparing your data.
- Select your variables. Choose the version that matches your design (see the table below), then select the outcome and factor(s).
- Choose any options the tool offers (for example the confidence level, a post hoc test or the error bar type) and run the analysis.
- Read the results on the page. Check the assumptions first, then the test statistic, the p-value and the effect size.
- To save your results, log in or create a free account. Every analysis stays free; the account is only needed to download.
Assumptions and checks
- The outcome is continuous.
- Independent observations (except in repeated-measures designs, which have their own assumptions).
- Residuals are roughly normal.
- Homogeneity of variance across groups (use Welch's ANOVA if violated).
- Repeated-measures designs additionally assume sphericity, or you apply a correction.
Key numbers to look at
- F(df1, df2) and p for each effect.
- Effect size: η2 or partial η2.
- Post hoc comparisons to see which groups differ.
- Descriptives: mean and SD for each group or cell.
Effect size
η2 or partial η2: about .01 small, .06 medium, .14 large.
Benchmarks such as small, medium and large are conventions (Cohen, 1988), not rules. Interpret size in the context of your field.
Reporting ANOVA in APA7 style
Template
Worked example (simulated data)
The numbers below were computed from the example CSV above, so you can reproduce them. They illustrate the format and are not real findings.
APA7 reminders: italicise statistical symbols (M, SD, t, F, p, r), report exact p-values to two or three decimals (use p < .001 for very small values), omit the leading zero for values that cannot exceed 1 (.45, not 0.45), and put degrees of freedom in parentheses. See the APA7 cheat sheet.
Common mistakes
- Running multiple t-tests instead of ANOVA, which inflates false positives.
- Treating a significant omnibus F as showing which groups differ without a post hoc test.
- Using a between-subjects ANOVA for repeated measurements.
Related analyses and alternatives
- One-way ANOVA: One factor, different people in each group.
- Two-way ANOVA: Two factors, different people in each cell.
- One-way ANOVA with repeated measures: One factor, same people in all conditions.
- Two-way ANOVA with repeated measures: Two factors with repeated measures.
- Kruskal-Wallis Test: Non-normal data and independent groups.
Not sure which analysis you need? Use the test chooser.
Frequently asked questions
Which ANOVA do I need?
Count your factors (one or two) and ask whether the same people appear in every condition (repeated measures) or different people in each (between-subjects).
Why not just run several t-tests?
Each test carries a chance of a false positive, so many tests inflate it. ANOVA tests all groups together first.
References
American Psychological Association. (2020). Publication manual of the American Psychological Association (7th ed.). https://doi.org/10.1037/0000165-000
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.
This guide is for learning and for preparing results for your own reports. You remain responsible for choosing an appropriate analysis, checking its assumptions and interpreting the results. Follow the formatting rules of your journal or institution where they differ from APA7.