Linear Regression
A statistical approach for modeling the straight-line relationship between a dependent variable and one independent variable.
What is Linear Regression?
Simple linear regression fits a line to a scatterplot of data by minimizing the sum of squared residuals (the vertical distances between data points and the line). It produces an equation (y = mx + b) that describes how the expected value of the dependent variable changes given a one-unit change in the independent variable.
Why Linear Regression Matters
It allows researchers to predict the value of an outcome based on a predictor and quantifies the exact rate of change, serving as the conceptual foundation for more complex predictive models.
Example
An agricultural scientist uses linear regression to predict wheat yield (dependent variable) based solely on the amount of fertilizer applied per acre (independent variable).
Common Mistakes
- Extrapolating predictions far outside the range of the data observed in the sample.
- Assuming the relationship is linear without checking residual plots for non-linear patterns.