Hierarchical Regression Explained: How to Run, Read and Report It

By Dr. Faheem Afzal Shah, Founder, StatFAS.com · Tool: Hierarchical Regression Calculator

Hierarchical regression enters predictors in a sequence of blocks that you decide in advance, usually on theoretical grounds, and tests what each block adds. It is the standard way to ask whether a set of predictors explains additional variance in an outcome beyond variables you already know matter. It differs fundamentally from stepwise regression, in which the software chooses the order from the data.

What is hierarchical regression?

You fit a sequence of nested linear models, each adding a block of predictors: Model 1 (controls), Model 2 (controls plus focal predictors), and so on. At each step you record R² and test the change. The key statistic is the change in R²:

ΔR² = R²full − R²reduced    Fchange = (ΔR² / m) / [(1 − R²full) / (n − k − 1)]

Here m is the number of predictors added in the block, k the total number of predictors in the larger model, with df = (m, n − k − 1). The order of entry is a substantive claim: it asks what the later block explains after the earlier block has been accounted for, so reversing the order can change ΔR².

When should you use it?

Use it to control for demographic or baseline variables before testing focal predictors, to test an interaction after main effects (see moderation analysis), or to compare theory-based sets of predictors. Specify the blocks before looking at the results (Cohen et al., 2003).

Assumptions

The assumptions are those of multiple linear regression: linearity, independent errors, constant variance, approximately normal residuals, limited multicollinearity and no influential outliers. Models must be nested and fitted to the same cases, so a variable with missing values can change the sample between steps and invalidate ΔR².

Original example (illustrative)

Question. After accounting for prior achievement, do study hours and motivation explain additional variance in final exam score? Data for n = 20 students (invented):

#PriorGPAHoursMotiv.Final#PriorGPAHoursMotiv.Final
163.03.04.05.169.01160.03.89.06.879.0
267.02.96.05.471.01264.02.66.04.667.0
363.03.58.03.563.01354.02.810.03.865.0
450.03.45.03.354.01459.03.86.06.169.0
567.02.08.05.372.01556.03.311.05.476.0
664.02.28.04.369.01665.03.35.06.362.0
756.02.98.05.464.01760.02.811.04.569.0
865.02.86.06.169.01858.02.38.02.861.0
963.03.110.02.570.01954.03.14.04.855.0
1062.03.111.05.475.02058.03.07.04.366.0

Block 1 (controls): prior exam score and prior GPA. Block 2 (focal): weekly study hours and motivation.

Model 1 (df = 17)
PredictorbSEp
Intercept13.7721.99.539
Prior exam score0.740.29.021
Prior GPA2.852.88.337
Model 2 (df = 15)
PredictorbSEp
Intercept4.0313.95.777
Prior exam score0.570.19.009
Prior GPA1.321.89.493
Study hours1.820.34< .001
Motivation2.320.77.008
ModelR²Adj. R²ΔR²F changep
10.2770.1920.277F(2, 17) = 3.26.063
20.7760.7160.498F(2, 15) = 16.64< .001

Check: Fchange = (0.498/2) / ((1 − 0.776)/15) = 16.64. Model 2 as a whole: F(4, 15) = 12.96, p < .001.

Interpretation. Prior achievement and GPA explain 27.7% of the variance in final scores. Adding study hours and motivation raises this to 77.6%, an increase of 49.8 percentage points, which is statistically significant. So the focal block explains meaningful additional variance beyond the controls. To judge practical importance, look at the coefficients in original units and their intervals, not only ΔR². With only 20 cases and four predictors the estimates are imprecise, and the example data are invented.

How to run hierarchical regression with StatFAS

Open the Hierarchical Regression Calculator. Arrange one outcome column and one column per predictor, then assign predictors to blocks in order.

Understanding the output

APA 7 reporting example

Hierarchical multiple regression was used to test whether study hours and motivation predicted final exam score beyond prior achievement. Prior exam score and GPA in Step 1 accounted for 27.7% of the variance, F(2, 17) = 3.26, p = .063. Adding study hours and motivation in Step 2 explained an additional 49.8% of variance, ΔR² = .498, F(2, 15) = 16.64, p = < .001.

Common mistakes and troubleshooting

Limitations and alternatives

Hierarchical regression shows incremental prediction, not causation, and results depend on the entry order when predictors are correlated. For many predictors with collinearity, consider ridge regression. For nested outcomes or repeated measures, mixed models are more appropriate. For comparing models that are not nested, use information criteria such as AIC.

Conclusion

Hierarchical regression answers a focused question: what does a set of predictors add after accounting for others? Define your blocks from theory, report ΔR² with its test, and interpret the coefficients and their intervals for practical importance.

Screenshots to supply (genuine captures only):
1. statfas-hierarchical-regression-interface.png, alt: "StatFAS Hierarchical Regression Calculator interface"
2. statfas-hierarchical-regression-example-data.png, alt: "Example data entered in the StatFAS Hierarchical Regression Calculator"
3. statfas-hierarchical-regression-settings.png, alt: "Hierarchical Regression Calculator settings in StatFAS"
4. statfas-hierarchical-regression-result.png, alt: "Hierarchical Regression Calculator results generated in StatFAS"

Frequently asked questions

What is the difference between hierarchical and stepwise regression?

In hierarchical regression the researcher chooses the order of entry on theoretical grounds. In stepwise regression the software selects predictors based on statistical criteria, which tends to capitalise on chance and produce unstable models.

What does ΔR² tell me?

It is the additional proportion of variance in the outcome explained by the predictors added in a step, over and above those already in the model. It is tested with an F-change statistic.

Can the order of entry change the results?

Yes, when predictors are correlated. The incremental variance explained by a block depends on what has already been entered, so the order should reflect your research question.

References

Author attribution: Dr. Faheem Afzal Shah, Plant Functional Genomics and Regulatory Genomics Researcher; StatFAS.com Founder.