WP Web Scraper

It can support any type of generic content.

The scraper is built using timetested libraries cURL for scraping and phpQuery for parsing HTML.

Installation

Unpack and upload it to the /wp-content/plugins/ directory.
Activate the plugin through the 'Plugins' menu in WordPress.

What is new in this release:

• Minor bug fixes.

What is new in version 3.4:

• Minor bug fixes.

What is new in version 3.0:

• Enhancement:
• Complete code rewrite, uses PHP DOM directly for faster processing
• Sandbox to test and debug
• Deprecation:
• Dropped removetags
• Changes:
• Changes in arguments

What is new in version 2.8:

• Enhancement:
• Migrated caching to the Transients API.
• Clear and find / replace now supports selectors.
• Cleaner code - faster processing.
• More debugging data including processing time.
• Deprecation:
• Modules are deprecated in support of callback functions.

What is new in version 2.4:

• Bug fix: Added xpathdecode to handle complex xpath queries in shortcode.

What is new in version 2.3:

• Enhancement: Added support for xpaths.
• Enhancement: Uses builtin WP_HTTP classes instead of raw cURL or Fopen.
• Enhancement: Complete overhaul of code, architecture and documentation.
• Enhancement: Reversed to filebased cache instead of MySQL tables.

What is new in version 1.2:

• Bug fix: Can also accept urls with special charecters such as [ or ]. Such charecters need to be replaced by the equivalent URL-encoded string like [ for [ or ] for [ etc.

Requirements:

• WordPress 2.6 or higher