Swarm

Swarm was created under the principle of "move the computation, not the data".

The way it works is similar to Map-Reduce algorithms, but the concept goes even beyond, allowing developers to use it on operations that normally wouldn't be supported by similar Map-Reduce-based data processing servers.

Swarm is like a generic structure on which you can plug-in your operations, and allow them to scale and grow over a distributed network as the application's data flow increases.

Here's Ian Clarke, Swarm's creator, explaining how the framework works:

Requirements:

• Scala 2.10.1 or higher
• Java 1.7 or higher