Why do we need regularization for linear least sqaures given that a line is the simplest model possible?

Viewed 22

In linear least squares we are trying to fit a line to data. A line is the simplest model that can be fit to the data. How is it possible for a linear model to over-fit the data? In short why do we need regularization for fitting a line to a data?

0 Answers
Related