I'll keep it short. I am parsing this URL and extracting all the images from it. I am doing this with Requests-HTML and BeautifulSoup. When inspecting the page all the images are 'encrypted' image URLs which are usable and good for me. However, when I parse the page only about half the images come back as 'encrypted' image URLs and the rest come back as 'data' image URLs which are just placeholders and not actual images. Can someone help me understand why they are not all parsing as 'encrypted' image URLs like they are on the actual page?
CODE:
from requests_html import HTMLSession
url = 'https://www.google.com/search?tbm=shop&q=desk'
session = HTMLSession()
data = session.get(url)
google_soup = BeautifulSoup(data.content, 'html.parser')
google_parsed = google_soup.find_all('img')
google_initiate.google_parse_page = url
session.close()
print(google_parsed)
PORTION OF THE OUTPUT:
<img alt="" data-deferred="1" id="17112548149630969467" role="presentation" src="data:image/gif;base64,R0lGODlhAQABAIAAAP///////yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw=="/>, <img alt="" data-image-src="https://encrypted-tbn2.gstatic.com/shopping?q=tbn:ANd9GcSiKiAlbso8A4fKosLOsZP8u3WKFWXu3dqrGu2InZ2JD5Xt864&usqp=CAE" data-lazy-loaded="true" role="presentation"/>,