Introduction

<aside> 💡

Multiple regression extends simple linear regression by analysing the relationship between a dependent variable and multiple independent variables simultaneously.

</aside>

graph LR;
    A["Regression Analysis"] --> B["Simple Regression"];
    A --> C["Multiple Regression"];
    B --> D["One independent variable (X)"];
    B --> E["One dependent variable (Y)"];
    C --> F["Multiple independent variables (X₁, X₂, ..., Xₖ)"];
    C --> G["One dependent variable (Y)"];
    style A fill:#f9f,stroke:#333;
    style B fill:#bbf,stroke:#333;
    style C fill:#bbf,stroke:#333;

This allows us to model complex real-world phenomena where outcomes are influenced by multiple factors.

For example, in competitive swimming, an athlete's race time (outcome) is influenced by multiple factors (stroke technique, physical conditioning, pool temperature, mental state) on race day. Understanding how these various factors work together could help coaches and athletes optimise training and performance.

Unlike simple linear regression, which considers only one predictor variable, multiple regression can incorporate numerous predictors, making it highly useful for:

• Prediction (estimating future values based on multiple input variables);
• Explanation (understanding the relative importance of different predictors); and
• Control (accounting for confounding variables in experimental research).

Formula

It’s important to understand the general form of a multiple regression model, which can be expressed as:

$$ Y = β₀ + β₁X₁ + β₂X₂ + ... + βₖXₖ + ε $$

Where:

• $Y$ is the dependent variable
• $β₀$ (’beta zero’) is the intercept (constant term)
• $β₁, β₂, ..., β$ₖ are the regression coefficients
• $X₁, X₂, ..., Xₖ$ are the independent variables
• $ε$ (’epsilon’) represents the error term