/ Published in: Bash
If this command seems to run forever, it's because there may be parts of the site that generate an infinite series of different URLs. You can solve this in many ways, the simplest being to use the -l option to specify how many links “away†from the home page wget should travel. For instance, -l 3 will refuse to download pages more than three clicks away from the home page. You’ll have to experiment with different values for -l. Consult man wget for additional workarounds.
Expand |
Embed | Plain Text
Copy this code and paste it in your HTML
wget -m -k -K -E http://url/of/web/site