Crawler4j 3.3

Crawler4j is an open source Java crawler which provides a simple interface for the Web crawling. You can setup a multi-threaded web crawler in 5 minutes. You can create a crawler class that extends WebCrawler and it decides which URLs should be crawled...
Last Viewed Software