Is it possible to start at http://host/foo/bar/baz/index.cgi?page=1 and recursively fetch any content under http://host/foo/? (Can't start at http://host/foo/ since that's not a valid page.) I looked at the various options to control what wget recursive fetches, such as --no-parent and --include-directories, but I can't seem to find an option to accomplish the above, e.g. a simple URL substring filter.
Turns out --include-directories does do what I want - I just wasn't using it right. I should've done:
wget --include-directories /foo 'http://host/foo/bar/baz/index.cgi?page=1'
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With