Skip to content

The Google file system

Sanjay Ghemawat, Howard Gobioff, Shun-Tak A. Leung

ACM SIGOPS Operating Systems Review · 2003 · 5,184 citations

No retraction on record in OpenAlex.Check Crossref now

Cite this paper

Ghemawat, S., Gobioff, H., & Leung, S.-T. A. (2003). The google file system. ACM SIGOPS Operating Systems Review, 37(5), 29–43. https://doi.org/10.1145/1165389.945450

In text: (Ghemawat et al., 2003)

Ask a question about this research

One question, free, no account. Anchorcite finds the papers, checks each against Crossref and links every sentence of the answer to the passage it comes from.

Abstract

We have designed and implemented the Google File Sys-tem, a scalable distributed file system for large distributed data-intensive applications. It provides fault tolerance while running on inexpensive commodity hardware, and it delivers high aggregate performance to a large number of clients. While sharing many of the same goals as previous dis-tributed file systems, our design has been driven by obser-vations of our application workloads and technological envi-ronment, both current and anticipated, that reflect a marked departure from some earlier file system assumptions. This has led us to reexamine traditional choices and explore rad-ically different design points. The file system has successfully met our storage needs. It is widely deployed within Google as the storage platform for the generation and processing of data used by our ser-vice as well as research and development efforts that require large data sets. The largest cluster to date provides hun-dreds of terabytes of storage across thousands of disks on over a thousand machines, and it is concurrently accessed by hundreds of clients. In this paper, we present file system interface extensions designed to support distributed applications, discuss many aspects of our design, and report measurements from both micro-benchmarks and real world use. Categories and Subject Descriptors D [4]: 3—Distributed file systems

  1. MapReduce2008
  2. The Anatomy of the Grid: Enabling Scalable Virtual Organizations2001
  3. Xen and the art of virtualization2003
  4. CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms2010

Metadata from OpenAlex (CC0). Citations are generated from the published record.