Apache Hadoop v2 Framework

An Apache Hadoop v2 Framework is a Hadoop framework that was released October 15th, 2013.

• Context:
  • It can (typically) include:
    • Map/Reduce v2 - Yet Another Resource Negotiator (YARN).
    • HDFS v2 (a federated system).
    • a highly-available NameNode.
• Example(s):
  • hadoop-0.24/Hadoop r2.4.0 http://hadoop.apache.org/docs/r2.4.0/ .
  • …
• Counter-Example(s):
  • Hadoop v1.
• See: Data Processing Framework.

---

---

References

2014

• http://hortonworks.com/blog/apache-hadoop-2-is-ga/

• http://www.ibm.com/developerworks/library/bd-yarn-intro/
  • Apache Hadoop is one of the most popular tools for big data processing. It has been successfully deployed in production by many companies for several years. Though Hadoop is considered a reliable, scalable, and cost-effective solution, it is constantly being improved by a large community of developers. As a result, the 2.0 version offers several revolutionary features, including Yet Another Resource Negotiator (YARN), HDFS Federation, and a highly available NameNode, which make the Hadoop cluster much more efficient, powerful, and reliable. In this article, learn about the advantages YARN provides over the previous version of the distributed processing layer in Hadoop. …

    … Apache Hadoop 2.0 includes YARN, which separates the resource management and processing components. The YARN-based architecture is not constrained to MapReduce. This article describes YARN and its advantages over the previous distributed processing layer in Hadoop. Learn how to enhance your clusters with YARN's scalability, efficiency, and flexibility.

---