not getting a urllib response on some urls that opens regularly in the webbrowser

Question

I am having an issue with urllib on python3 that I dont know how to solve. this is my code :

import urllib.request
       hdr = { 'User-Agent' : 'super happy flair bot by /u/spladug' }
       req = urllib.request.Request(url,headers=hdr)
       data = urllib.request.urlopen(req,timeout=10).read()
       return data

Stuff I tried:

Changing user agent
Adding and removing timeouts
curl these sites

but still there are some sites(that ends with image file extension like http://xxx.xxx/aaa.png or .jpg) that I just can't get a response, and if I am setting a timeout I am getting TimeOutError. but if i open the same site in the chrome everything working fine. Does someone have any solution or faced the issue?

site example - https://sgfm.elcorteingles.es/SGFM/dctm/MEDIA03/202006/24/00117731276964____5__210x210.jpg

user_13646430 · Answer

I don't know what's the error in your code, but I'm using requests and I never had that problem.

import requests
response=requests.get(URL)
print(response.text)

How to use Headers in requests .get(): Using headers with the Python requests library's get method

not getting a urllib response on some urls that opens regularly in the webbrowser

1 Answers