Scrape data from dynamically loaded websites using goutte

Viewed 16

Can i use goutte controller to scrape data from dynamically loaded websites.. Like airbnb or YouTube? Actually I'm able to scrape data from html sites but not from airbnb

1 Answers

The problem you are gonna run into is that goutte does not process/run the javascript of the given website, which means that websites that loads their data from javascript requests is not gonna have the data in the DOM for you to read, for that you might want to look into a headless browser solution like Puppeteer or if you like Laravel they have Laravel Dusk which essentially is the samething.

Hope this helps :-)

Related