Download Webpage Files from the Command Line

Use the wget command to download any file if you have the URL.

Downloading Multiple Files

Place a list of URLs in a .txt file. No special symbols are required to seperate the URLs, just make sure there is a line between each.

Once you have a list of your file URLs, run the following command and your files will download one after the other.
wget -i yourlist.txt

Avoiding Duplicate Files

If you want to avoid downloading a file you already have, use the -N option. This will skip files already in your directory if they have the same modification date.
wget -i -N yourlist.txt


Limit the Download Rate

wget –limit-rate 256k



Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s