Menu
Google Search Console Log in and navigate to Search Traffic -> Links to Your Site, then click the 'More' button under the first table. This will give you a list of domains and some options to download the data.
With the Google website page counter tool, you can easily find out how to find all pages on a website for free. It is a convenient way to check if the search engine network has indexed all parts of your site.
Check out linkchecker—it will crawl the site (while obeying robots.txt) and generate a report. From there, you can script up a solution for creating the directory tree.
If you have the developer console (JavaScript) in your browser, you can type this code in:
urls = document.querySelectorAll('a'); for (url in urls) console.log(urls[url].href);
Shortened:
n=$$('a');for(u in n)console.log(n[u].href)
Another alternative might be
Array.from(document.querySelectorAll("a")).map(x => x.href)
With your $$( its even shorter
Array.from($$("a")).map(x => x.href)
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With