WebsiteSpider

The seoBOXX is a free, unlimited URL's website crawler with basic onpage analysis and report generation. It works multithreaded using the MTWS-CoreEngine (MultiThreadedWebsiteSpider) and stores the collected data into a database. WIth this method you are able to load the data of the analysis and create the reports or check the data anytime you want to. During the analysis you receive a constantly updated view of the associated URL's as well as the HTTP status and the mime type of the respective URL. For better differentiation are analyzed URLs in green, being processed in blue and faulty shown in red. The analysis process takes multithreaded, which means that depending on the setting not only a URL to the other but several URL's are analyzed in parallel. This will increase the analysis speed by a multiple. Furthermore you have the possibility to adjust the analysis parameters, the multithreading parameters and the HTTP access parameters in the settings to the last detail to meet your needs. The WebsiteSpider has different results views. On the one hand there is the detail view of the domain analysis. Here you will find all the information of the server, the hoster and website analysis statistics. Additional informations are GEO IP information of the server, the robots.txt and the humans.txt. The registration information of the domain are also available via reverse DNS lookup. Furthermore, there is a detailed view for each analysed URL. Here you will find all information and analysis results of this special URL. For better and faster overview the results have been provided with additional charts and graphics. The WebsiteSpider generates three different report types. The SEO Analysis Report includes a complete summary of the domain data and any URL data. The domain analysis report in particular contains information relating to the domain itself. Also a small statistical summary of the analysis results is added to the report. The URL analysis report generates an overview of all data of the selected URL. The absolute highlight of the built-in tools is the image downloader. He works as an assistant and guides you through the entire process of downloading all crawled files to a folder sorted by MIEM-Type. The integrated UpdateManager keeps the seoBOXX WebsiteSpider up to date and announces available updates to you.