I'm trying to scrape a particular website that uses a "load more" button to gather more products. I've managed to do it using selenium and clicking on the button till reaches the end, but I'm trying to switch over to Scrapy and use FormRequest with the set of parameters of the network tab.
Main issue here is that I can't replicate what I've seen on other topics on stackoverflow. This website payload looks very different and has no "pagination" I can follow.
Please find the website and what I have found so far. Target website: https://www.ferreiracosta.com/Categoria/ceramicos-porcelanatos
From the second picture, almost all items are present on the page source code to build the data for formRequest, except for the __AJAX, which looks to be random numbers everytime I reload the page, also, there is no page number to identify where am I.
Am I looking at something that I must use selenium to interact with the page? Thanks!