Software Screenshot:
Software Details:
Version: 0.9.4
Upload Date: 12 May 15
Developer: Eugene Kalinin
Distribution Type: Freeware
Downloads: 258
Can be used to pull out data from the robots.txt file and feed it to other applications or statistics tools.
Will extract target URL, reason for access and status data.
What is new in this release:
- Handles http(s) request errors.
What is new in version 0.7.2:
- Fixed package.json meta info for bugs.
Requirements:
- Node.js 0.6 or higher
Comments not found