I have got the code to scrape the first page, but the url changes from:
https://www.expansion.com/empresas-de/ganaderia/granjas-en-general/index.html --> https://www.expansion.com/empresas-de/ganaderia/granjas-en-general/2.html
import requests<br>
from bs4 import BeautifulSoup<br>
url = "https://www.expansion.com/empresas-de/ganaderia/granjas-en-general/index.html"<br>
page = requests.get(url)<br>
soup = BeautifulSoup(page.content, "html.parser")<br>
lists = soup.select("div#simulacion_tabla ul")<br>
for lis in lists:<br>
title = lis.find('li', class_="col1").text<br>
location = lis.find('li', class_="col2").text<br>
province = lis.find('li', class_="col3").text<br>
info = [title, location, province]<br>
How can I create a loop that would run from page 2 - page 65? Many thanks!