Is it possible to find all the pages and links on ANY given website? I'd like to enter a URL and produce a directory tree of all links from that site?
I've looked at HTTrack but that downloads the whole site and I simply need the directory tree.
5 Answers
Another alternative might be
Array.from(document.querySelectorAll("a")).map(x => x.href)
With your $$( its even shorter
Array.from($$("a")).map(x => x.href)
Related