Apache Hadoop is an open source and free software library, designed as a framework that allows the distribution of large data sets across computer clusters, using nothing but simple programming models.
Apache Hadoop is designed in such a way that it can scale up from single server machines to thousands of machines, each providing local storage and computation.
The software includes the following modules: Hadoop Common, Hadoop Distributed File System (HDFS), Hadoop YARN, and Hadoop MapReduce. It is distributed as a standalone application by the Apache Software Foundation.
Among some Hadoop-related projects related distributed by the Apache Software Foundation, we can mention Apache Ambari, Apache Cassandra, Apache Chukwa, Apache HBase, Apache Hive, Apache Mahout, Apache Pig, and Apache ZooKeeper.
What is new in this release:
- IMPORTANT notes
- This release drops support for JDK6 runtime and works with JDK 7+ only.
- This release is not yet ready for production use. Critical issues are being ironed out via testing and downstream adoption. Production users should wait for a 2.7.1/2.7.2 release.
- Hadoop Common
- HADOOP-9629 - Support Windows Azure Storage - Blob as a file system in Hadoop.
- Hadoop HDFS
- HDFS-3107 - Support for file truncate
- HDFS-7584 - Support for quotas per storage type
- HDFS-3689 - Support for files with variable-length blocks
- Hadoop YARN
- YARN-3100 - Make YARN authorization pluggable
- YARN-1492 - Automatic shared, global caching of YARN localized resources (beta)
- Hadoop MapReduce
- MAPREDUCE-5583 - Ability to limit running Map/Reduce tasks of a job
- MAPREDUCE-4815 - Speed up FileOutputCommitter for very large jobs with many output files.
What is new in version 1.2.1 / 2.1.0 Beta:
- HDFS Snapshots
- Support for running Hadoop on Microsoft Windows
- YARN API stabilization
- Binary Compatibility for MapReduce applications built on hadoop-1.x
- Substantial amount of integration testing with rest of projects in the ecosystem
What is new in version 1.2.1:
- This release include new developer and user-facing incompatibilities, features, and major improvements.
Requirements:
- Java 2 Standard Edition Runtime Environment
Comments not found