very new to the idea of using web automation with rotating proxies and headers here. I have some basic questions that I can't seem to totally have the answers confirmed from the docs.. Here are some of the questions I most want the answers to for now, please excuse if they are too basic:)
- First of all, if you're using web automation for example with Selenium or Playwright, with proxies will it mean that the Selenium or Playwright scripts will be sent to the proxy servers to be used and fetch the data? Thus far, I have only been using paid proxy services that use python
requestsand do not offer web automation, the problem here is that sometime requests don't return full diplayed data. - Second question would be about TorPy a tool I recently found. As I understand from the manuals it is a layered process in fetching data via multiple free proxies for each request, would this be correct assumption? Many thanks.