When crawling a slow website, I always get the error: TCP connection timed out: 10060. I guess this may happen when the crawler tries to establish a TCP connection with the server and the default connect timeout is too low.
I know the download timeout can be set in scrapy, but I found no way to set the connect timeout. Does anyone have some ideas? Thanks!