Scrapy-splash can't scrape any element

user_17157047 0
Viewed 57

I try to scrape this site

Command fetch('site') returns me crawled(200).

But when I try to get any of css selectors, it returns an empty list.

I realised that this page is generated with JavaScript ant tried to use Splash.

fetch('http://localhost:8050/render.html?url=site') also returns 200, but response.css returns nothing.

Why splash doesn't work hier? What can help me?

Will be grateful for any help!

scrapy splash-screen javascript
1 Answers

The site returns 403 access denied even when accessed from a normal web browser. Therefore splash would return the same content as a normal browser and response.css yields nothing.

enter image description here

user_81799390
Related