I'm fairly new to the area of web scraping and I'm trying to extract the list of books available at the following url https://www.goodreads.com/choiceawards/best-fiction-books-2020. I'm trying to get all titles from the part e.g. title="The Midnight Library by Matt Haig" but wasn't very successful and I get back just an empty space and no result. Can anyone advice on that? Thanks.
What I've got so far:
from bs4 import BeautifulSoup as bs
url= "https://www.goodreads.com/choiceawards/best-fiction-books-2020"
page = requests.get(url)
soup = bs(page.content, 'html.parser')
soup.find_all('a', class_='pollAnswer__bookLink')
for book in soup.find_all('a', {'class':'pollAnswer__bookLink'}) :
print(book.get_text())