Apache Helix

Apache Helix can be used for managing large computing resources, hosted on cloud infrastructures or in computing clusters.

It is built on top of another Apache project, Zookeeper, and provides a generic interface for managing clusters with large number of nodes and resources.

Unlike similar project from Apache, Helix does not care about the data and targets the physical resources (the servers themselves) that manipulate the data streams.

It is intended for usage in creating resource usage and administration plans for the server, controlling how resources are used, when and how data is moved from one server to another.

Features:

• Automatic resource assignment
• Automatic partition assignment
• Failure detection
• Failure recovery
• Can handle adding new resources and nodes in real-time
• Load balancing
• Load throttling
• Pluggable infrastructure

What is new in this release:

• Automatic assignment of resource/partition to nodes
• Node failure detection and recovery
• Dynamic addition of Resources
• Dynamic addition of nodes to the cluster
• Pluggable distributed state machine to manage the state of a resource via state transitions
• Automatic load balancing and throttling of transitions

What is new in version 0.6.0:

• Automatic assignment of resource/partition to nodes
• Node failure detection and recovery
• Dynamic addition of Resources
• Dynamic addition of nodes to the cluster
• Pluggable distributed state machine to manage the state of a resource via state transitions