#StackBounty: #linux #directory #raspberry-pi #wget #url Wget Won't Recursively Download

Bounty: 50

I’m trying to copy a forum thread with this directory structure:

The first page has a URL like this:

https://some.site.com/foo/bar/threadNumber

And the rest of the pages follow this format:

https://some.site.com/foo/bar/threadNumber/page/2
https://some.site.com/foo/bar/threadNumber/page/3
https://some.site.com/foo/bar/threadNumber/page/*

I’m using the command:

wget --recursive --page-requisites --adjust-extension --no-parent --convert-links https://some.site.com/foo/bar/threadNumber

This command can copy any single URL just fine. However, I want to put in the higher directory, and get all of the /page/* files as well. I want no higher directories, and nothing other than the lower /page/ files. I have also thrown --mirror into the mix with no success.

Any ideas why this command isn’t going any lower to download the rest of the pages?


Get this bounty!!!

Leave a Reply