Full-Text RSS

Full-Text RSS is a free software project to help people extract and read full-text web content. It can extract content from a standard HTML page and return a 1-item feed or it can transform an existing feed into a full-text feed. It is being developed as part of the Five Filters project to promote alternative, non-corporate media.

What is new in this release:

• Site patterns for better control over extraction (see site_config/README.txt)
• hNews support (improves content extraction for sites using hNews microformatting)
• Cookie Jar now used to store and sends cookies when following HTTP redirects
• Better handling of certain cases where HTML Tidy fails to clean up properly
• Bug fix: curl_multi_select() timing out in certain environments (fixed in HumbleHttpAgent.php)
• Bug fix: broken HTTP header parsing in some environments (fixed in SimplePie_HumbleHttpAgent.php)
• Bug fix: invalid API URL shown (fixed in index.php)
• Plus other minor fixes

What is new in version 2.6:

• Rewriting of hash-bang (#!) URLs (see http://www.tbray.org/ongoing/When/201x/2011/02/09/Hash-Blecch for an explanation)
• Improved parallel fetching support (HumbleHttpAgent uses curl_multi_* functions if PECL HTTP extension is not present)
• Improved HTTP redirect support (now handled in HumbleHttpAgent, no longer relies on PHP)
• Improved performance for single page (non-feed) requests: (SimplePie connected to HumbleHttpAgent)
• Improved memory use for processing large feeds (HumbleHttpAgent's stored responses cleared as they're retrieved)
• Bug fix: exclude on fail option no longer requires valid key
• Bug fix: workaround for PHP bug http://bugs.php.net/51192 (fixed in makefulltextfeed.php)
• Plus other minor changes

What is new in version 2.5:

• New option: custom extraction pattern (CSS selectors)
• New option: allowed URLs (restrict service to pre-defined feeds/domains)
• New option: exclude items on fail (remove items from feed if content extraction fails)
• Remove 'http://' from URL before form submission (prevents errors on hosts which have overly vigilant security software)
• Allow overriding of index.php with custom_index.php
• config.php now required (override with custom_config.php)
• index.php now uses config.php to determine what to display
• Bug fix: occasional fatal error in IRI::__toString() (IRI updated)
• Bug fix: workaround for PHP bug http://bugs.php.net/51192 (fixed in HumbleHttpAgent.php)

What is new in version 2.5 Beta:

• Custom extraction patterns (using CSS) now accepted, allowing you to:
• override auto-detection
• specify which element should get extracted from within the auto-detected block
• Option to exclude feed items if extraction fails

What is new in version 2.1:

• Better content extraction (using PHP Readability 1.7.1)
• Parallel HTTP requests (using Humble HTTP Agent)
• Auto loading of necessary classes
• Rewriting of relative URLs (using IRI)
• Added compatibility test file (to check if server meets requirements)
• Character-encoding support improved (using SimplePie)

What is new in version 2.0 Beta:

• The new version of the Full-Text RSS service is now running on http://fivefilters.org/content-only/
• The major change is that we've updated our port of Arc90's Readability - which means the service should now be a little more accurate in correctly identifying content blocks and story titles.
• The source code is not yet available but once we've tested, tweaked, and raised a little more money, it will be released. If you can, please donate to speed up development.

What is new in version 1.5:

• Support for PHP 5.3 (thanks Murilo!)
• Character-encoding support improved (favours iconv over mb_convert_encoding)

Requirements:

• PHP