Apache Giraph

Giraph is Apache's response to the developer market's need for social graph data analysis tools.

Apache Giraph is capable of taking inter-linked social data and running various data analysis and processing operations on it without needing huge server infrastructures to do so.

For better integration in already existing structures, Giraph is compatible with well-known data processing tools from Apache, like Hadoop and ZooKeeper.

What is new in this release:

• Scales out to hundreds of machines easily and hundreds of billions of
• edges (memory permitting)
• Efficient use of memory via fast byte-based serialization by default
• and can use primitive specific types when better performance is required
• Multithreaded input and computation can take advantage of multicore
• machines efficiently
• Simplified vertex API
• Vertex-based and/or edge-based input supported
• Master compute API for handling application-wide logic
• Sharded aggregators for handling large (memory) aggregators
• Easy access to/from Hive tables to integrate with your data warehouse
• Out-of-core graph and messaging support
• YARN support

What is new in version 0.1.0:

• Create VertexRunner to make it easier to run users' computations
• Provide AdjacencyList InputFormat for Ids of Strings and double values
• Need outputformat for just vertex ID and value
• Data input sampling and testing improvements
• Port of the HCC algorithm for identifying all connected components of a graph
• Aggregators are not exported
• Support for the Facebook Hadoop branch
• Introduce new primitive-specific MutableVertex subclasses
• Implement TextVertexInputFormat for text-format graph data
• Provide input format for reading graphs stored as adjacency lists

Requirements:

• Java 1.6 or higher
• Apache Maven 3 or higher