Wget!

More..

GNU Wget is a free software http://gnu.org/philosophy/free-sw
package for retrieving files using HTTP, HTTPS and FTP, the most widely-used Internet protocols. It is a non-interactive commandline tool, so it may easily be called from scripts, `cron` jobs, terminals without X-Windows support, etc. GNU Wget has many features to make retrieving large files or mirroring entire web or FTP sites easy, including: * Can resume aborted downloads, using `REST` and `RANGE` * Can use filename wild cards and recursively mirror directories * NLS-based message files for many different languages * Optionally converts absolute links in downloaded documents to relative, so that downloaded documents may link to each other locally * Runs on most UNIX-like operating systems as well as Microsoft

Wget alternatives

  • cURL

  • cURL is a computer software project providing a library and command-line tool for transferring data using various protocols with URL syntax: supporting FTP, FTPS, SCP, SFTP, HTTP, HTTPS, TFTP, TELNET, DICT, LDAP, LDAPS and FILE. cUrl supports HTTPS certificates, HTTP POST, HTTP PUT, FTP uploading, kerberos, HTTP form based upload, proxies, cookies, user+password authentication, file transfer resume, http proxy tunneling and a busload of other useful tricks.

    tags: command-line command-line-interface data-transfer file-transfer http-client

  • WebCopy

  • Cyotek WebCopy is a free tool for copying full or partial websites locally onto your harddisk for offline viewing.

    tags: Portable download-manager offline-browser save-web-page website-copier

  • UnMHT

  • UnMHT adds MHT file reading/writing support to Firefox.MHT (MHTML, RFC2557) is the webpage archive format to store HTML and images, CSS into single file.

    tags: firefox-extension firefox plugins mozilla mht

  • webui-aria2

  • The aim for webui-aria2 is to create the worlds best interface to interact with aria2. Very simple to use, just download and open index.html in any web browser.

    tags: download-accelerator download-manager resume-downloads web-based web-interface

  • Persepolis Download Manager

  • Persepolis Download Manager is utility for download easier and faster with aria2 and improved it.

    tags: download-manager internet-download-manager

  • PageArchiver

  • PageArchiver (previously called "Scrapbook for SingleFile") is a Chrome extension that helps you to archive web pages for offline reading.

    tags: file-archiving offline-browser save-web-page

  • cliget

  • Download files using curl or wget. This addon generates curl/wget commands that emulate the request as though it's coming from your browser allowing you to download protected files directly to a separate machine (e.g. server).

    tags: download-manager firefox-extension

  • lftp

  • lftp is a command-line file transfer program which besides FTP, also supports FTPS, HTTP, HTTPS, HFTP, FISH, and SFTP. A BitTorrent client is also built-in as torrent command.

    tags: bittorrent-client command-line-interface file-sharing file-transfer file-transfer-protocol

  • SiteSucker

  • SiteSucker is a Macintosh application that automatically downloads Web sites from the Internet. It does this by asynchronously copying the sites Web pages, images, backgrounds, movies, and other files to your local hard drive.

    tags: download-manager mirroring website-downloader

  • grab-site

  • grab-site is a crawler for archiving websites to WARC files. It includes a dashboard for monitoring multiple crawls, and supports changing URL ignore patterns during the crawl.

    tags: command-line-interface offline-website web-archive web-crawler website-downloader