Struggling to grab data from website using python

user_17647877 0
Viewed 67

I'm trying to grab snowfall data from the National Weather Service at this site:

https://www.nohrsc.noaa.gov/snowfall/

The data can be downloaded via the webpage with a 'click' on the file type in the drop down, but I can't seem to figure out how to automate this using python. They have an ftp archive, but it requires a login and I can't access it for some reason.

However, since the files can be downloaded via a "click" on the webpage interface, I imagine there must be a way to grab it using wget or urlopen? But I can't seem to figure out what the exact url address would be in this case in order to use those functions. Does anyone have any ideas on how to download this data straight from the website listed above?

Thanks!

urlopen wget python
1 Answers

You can inspect links with Chrome Console.

Press F12, then click on file type:

enter image description here

Here an URL https://www.nohrsc.noaa.gov/snowfall/data/202112/sfav2_CONUS_6h_2021122618_grid184.nc

You can download it with python using Requests library

import requests

r = requests.get('https://www.nohrsc.noaa.gov/snowfall/data/202112/sfav2_CONUS_6h_2021122618_grid184.nc')

data = r.content # file context

Or you can just save it to file with urlretrieve

from urllib.request import urlretrieve
url = 'https://www.nohrsc.noaa.gov/snowfall/data/202112/sfav2_CONUS_6h_2021122618_grid184.nc'
dst = 'data.nc'
urlretrieve(url, dst)
user_81531470
Related