How to extract absolute URL of href with relative path?

user_7357673 0
Viewed 730

I am trying to extract download links from this link.

Here is the page source (viewing in Google Chrome) of that link:

enter image description here

When I point at ../matlab/licensing.pdf on the page source, a link https://www.mathworks.com/help/pdf_doc/matlab/licensing.pdf appears.

I inspect ../matlab/licensing.pdf but the link does not appear on the right hand. Thus I am unable to extract this link with regrex in Python.

Please help me extract this link from the page source.

web-scraping python-3.x python
1 Answers

try using urllib.parse.urljoin

example:

import urllib.parse

base = r"https://www.mathworks.com/help/pdf_doc/install/index.html"
link_in_html = r"../matlab/licensing.pdf"

result = urllib.parse.urljoin(base, link_in_html)

print(result)
user_50523650
Related