Software Details:
Version: 2.2.2
Upload Date: 11 Jul 15
Distribution Type: Freeware
Downloads: 21
Size: 977 Kb
Crawl a Web site with this free ActiveX spidering component. Advanced features include caching, "avoid" patterns, and robots.txt compliance. Automatically handles HTTPS URLs. Includes safety measures for avoiding large / infinite size Web pages or infinitely growing-in-length URLs. Includes a wind-down features for crawling a maximum number of pages per site.
Comments not found