Computing Atlas

How Computing Was Built
Sign In
Text size
100%
Theme

Switch Atlas

System

Apache Hadoop

Network and Internet Systems

Apache Hadoop is a collection of open-source software utilities for reliable, scalable, distributed computing, providing a framework for distributed storage, the Hadoop Distributed File System, and distributed processing of very large datasets using the MapReduce programming model. Doug Cutting and Mike Cafarella created it starting in 2006, building on ideas published by Google about the Google File System and MapReduce, and naming the project after Cutting's son's toy elephant. Hadoop made it practical for ordinary organizations to store and process web-scale data across clusters of commodity hardware, and it became the foundation of the broader big-data software ecosystem that followed it. This description is adapted from Wikipedia contributors under CC BY-SA 4.0; changes were made. https://creativecommons.org/licenses/by-sa/4.0/

Facts
Year
2006 1
Significance
An open-source framework that made distributed storage and MapReduce processing of very large datasets practical on clusters of ordinary hardware. 1
Status
Status
Active / In Use 1
Classification
License
Apache License 2.0 2
FAQs

How does Hadoop keep data available when a rack or switch fails?

It replicates data across multiple racks so the data stays available.

HDFS replicates data across multiple racks for redundancy. This reduces the impact of a rack power outage or switch failure, and if either of those hardware failures occurs, the data remains available.
Connections

In Field

Distributed Computing, Fields

Licensed Under

Apache License 2.0, Concepts
Sources
1. Wikipedia: Apache Hadoop
Wikimedia Foundation
  • Lead section
    Apache Hadoop () is a collection of open-source software utilities for reliable, scalable, distributed computing. It provides a software framework for distributed storage and processing of big data using the MapReduce programming model.
  • Lead sentence
    Apache Hadoop () is a collection of open-source software utilities for reliable, scalable, distributed computing.
  • In Group: Distributed Data Processing Infrastructure, Lead
    Apache Hadoop () is a collection of open-source software utilities for reliable, scalable, distributed computing.
View the Source
2. Wikidata: Apache Hadoop
  • Wikidata Q29120, resolved via en.wikipedia pageprops (wave rule R-L)
  • Wikidata Q29120 P275 (license)
View the Source
Comments (0)
No comments yet. Be the first to share a thought.
Reader Challenges (0)
No disputes yet. Spotted an error or a better source? Open the first one.