I am trying to understanding a common knowledge about using OLS to solve high dimensional linear model. I understand when p>n, OLS will fail. I also have the impression that when p is large, OLS will not perform well either. I did a simple simulation:
OLS performs quite good.
I have done more simulations, and the results of Bias are similar.
I must have understood something wrong.