I come up with an interview question that I would like to know your opinion about that. The questions are say that in designing a web crawler:
1) what kind of pages will you hit with a DFS versus BFS?
2) how would you avoid getting into infinite loops?
I appreciate if somebody could answer them.