{"id":88,"date":"2012-07-23T20:29:00","date_gmt":"2012-07-23T20:29:00","guid":{"rendered":"https:\/\/www.tech-and-dev.com\/blog\/2012\/07\/23\/working-with-wget-command-to-download-a-single-file-or-to-download-files-from-a-ftp-with-a-username-and-password\/"},"modified":"2012-07-23T20:29:00","modified_gmt":"2012-07-23T20:29:00","slug":"working-with-wget-command-to-download","status":"publish","type":"post","link":"https:\/\/www.tech-and-dev.com\/blog\/2012\/07\/working-with-wget-command-to-download.html","title":{"rendered":"Working with Wget command to download a single file or to download files from a ftp with a username and password"},"content":{"rendered":"

Wget stands for World Wide Web<\/b> and get<\/b>.<\/p>\n

Usually Wget is used to download a file from a http server (or https), and even ftp servers.
Wget can also be used to download an entire directory recursively.<\/p>\n

In this post, I will show you 5 ways for using wget <\/p>\n

1- Using Wget to download a single file<\/h3>\n

To download a single file, simply write wget followed by the url, for this example, I will download a test file from thinkbroadband.com<\/p>\n

wget http:\/\/download.thinkbroadband.com\/100MB.zip<\/div>\n

Below, you will see the file being downloaded<\/p>\n

Saving to: ‘100MB.zip’<\/p>\n

34% [============>                          ] 36,639,898  5.90M\/s  eta 13s<\/p><\/div>\n

Saving to: 100MB.zip<\/b> : This is the filename that is being saved on your server\/computer
34%<\/b>:  Percentage of the completion of the file being downloaded
36,639,898<\/b> : Number of bytes downloaded so far
5.90M\/s<\/b> : Current download speed
eta 13s<\/b> : The remaining estimation time left to complete the download<\/p>\n

Once the download is completed, you will see something that look like this:<\/p>\n

Saving to: ‘100MB.zip’<\/p>\n

100%[======================================>] 104,857,600 4.17M\/s   in 23s<\/p>\n

2012-07-23 23:29:16 (4.33 MB\/s) – ‘100MB.zip ‘<\/p><\/div>\n

In the last line, you will see:
2012-07-23 23:29:16<\/b> : the date the file was completely downloaded
(4.33 MB\/s) <\/b>: Average download speed for the entire download
100MB.zip <\/b>: the filename of the downloaded file<\/p>\n

<\/p>\n

2- Using Wget to resume a single file (-c option)<\/h3>\n

If you were downloading a file, and the download was interrupted whether you had to restart your computer, or internet disconnected or any other reason, you can use wget command with -c option to resume it:<\/p>\n

wget -c http:\/\/download.thinkbroadband.com\/512MB.zip<\/div>\n

<\/p>\n

Saving to: ‘512MB.zip’<\/p>\n

100%[++++++================================>] 536,870,912 8.99M\/s   in 54s<\/p>\n

2012-07-23 23:42:16 (8.04 MB\/s) – ‘512MB.zip’<\/p><\/div>\n

Notice the ++++ in the download bar, this means that this portion of the file was already downloaded, the ======= is the new portion being downloaded.<\/p>\n

3- Using Wget to download in the background (-b option)<\/h3>\n

If you want to download a file while doing other stuff in the command line, you can use the -b option, for example:<\/p>\n

wget -b http:\/\/download.thinkbroadband.com\/512MB.zip
Continuing in background, pid 26530.
Output will be written to ‘wget-log’<\/div>\n

This will start the download in the background while giving back the shell command to you to allow you to write other commands.<\/p>\n

To check the status of the download, simply enter the following command:<\/p>\n

tail -f wget-log<\/div>\n

and you will see the download status, for example:<\/p>\n

509450K ………. ………. ………. ………. ………. 97% 25.2M 3s
509500K ………. ………. ………. ………. ………. 97% 10.8M 3s
509550K ………. ………. ………. ………. ………. 97% 6.25M 2s
509600K ………. ………. ………. ………. ………. 97% 22.4M 2s
509650K ………. ………. ………. ………. ………. 97% 11.5M 2s<\/div>\n

<\/p>\n

4- Using Wget to download from a FTP<\/h3>\n

For this example, I will download a file from the mozilla ft:p<\/p>\n

wget ftp:\/\/ftp.mozilla.org\/index.html<\/div>\n

<\/p>\n

5- Using Wget to recursively download a directory from a FTP with a username and password<\/h3>\n

To recursively download all the files from a ftp with a username and password, use the following wget command:<\/p>\n

wget -r ftp:\/\/test:test@ftp.secureftp-test.com:21\/subdir1\/*<\/div>\n

username <\/b>= test
password <\/b>= test
host <\/b>= ftp.secureftp-test.com
port<\/b>=21
directory to download<\/b> = subdir1<\/p>\n

 <\/h3>\n

Installing Wget (on CentOS 6.2)<\/h3>\n

If you get the following message while using wget:<\/p>\n

-bash: wget: command not found<\/div>\n

This means that your Wget is not installed.<\/p>\n

To install wget, run the below command:<\/p>\n

[root@myserver ~]# yum install wget
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: mirror.beyondhosting.net
 * extras: centos.corenetworks.net
 * updates: mirrors.serveraxis.net
Setting up Install Process
Resolving Dependencies
–> Running transaction check
—> Package wget.x86_64 0:1.12-1.4.el6 will be installed
–> Finished Dependency Resolution<\/p>\n

Dependencies Resolved<\/p>\n

================================================================================
 Package        Arch             Version                   Repository      Size
================================================================================
Installing:
 wget           x86_64           1.12-1.4.el6              base           481 k<\/p>\n

Transaction Summary
================================================================================
Install       1 Package(s)<\/p>\n

Total download size: 481 k
Installed size: 1.8 M
Is this ok [y\/N]: y
Downloading Packages:
wget-1.12-1.4.el6.x86_64.rpm                             | 481 kB     00:00
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
  Installing : wget-1.12-1.4.el6.x86_64                                     1\/1<\/p>\n

Installed:
  wget.x86_64 0:1.12-1.4.el6<\/p>\n

Complete!<\/p><\/div>\n

Happy WGETting \ud83d\ude42<\/p>\n","protected":false},"excerpt":{"rendered":"

Wget stands for World Wide Web and get. Usually Wget is used to download a file from a http server (or https), and even ftp servers.Wget can also be used to download an entire directory recursively. In this post, I will show you 5 ways for using wget 1- Using Wget to download a single […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[123,6,122,7],"tags":[],"class_list":["post-88","post","type-post","status-publish","format-standard","hentry","category-download","category-linux","category-recursive","category-ssh"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.tech-and-dev.com\/blog\/wp-json\/wp\/v2\/posts\/88","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.tech-and-dev.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tech-and-dev.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tech-and-dev.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tech-and-dev.com\/blog\/wp-json\/wp\/v2\/comments?post=88"}],"version-history":[{"count":0,"href":"https:\/\/www.tech-and-dev.com\/blog\/wp-json\/wp\/v2\/posts\/88\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.tech-and-dev.com\/blog\/wp-json\/wp\/v2\/media?parent=88"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tech-and-dev.com\/blog\/wp-json\/wp\/v2\/categories?post=88"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tech-and-dev.com\/blog\/wp-json\/wp\/v2\/tags?post=88"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}