RafaBot

RafaBot is a high-speed, multi-threading, large scale web spidering robot. An ideal tool for bulk website download. It can download website from a starting URL, search engine results or web dirs and able to follow external links. It can process either a single website or many thousands of websites in one session.

RafaBot saves all downloaded files in user hard drive in native format and user can view / research / extract them off-line without being connected to the Internet. It has numerous filters to restrict download like - URL filter, date modified, text, file type, file size, etc. It allows user-selectable recursion levels, retrieval threads, timeout, proxy support and accesses password-protected sites.

Limitations:

Limited features