Jupiter Rising: A Decade of Clos Topologies and Centralized Control in Google's Datacenter Network.

Saved in:

Bibliographic Details
Title:	Jupiter Rising: A Decade of Clos Topologies and Centralized Control in Google's Datacenter Network.
Authors:	Singh, Arjun, Joon Ong, Agarwal, Amit, Anderson, Glen, Armistead, Ashby, Bannon, Roy, Boving, Seb, Desai, Gaurav, Felderman, Bob, Germano, Paulie, Kanagala, Anand, Hong Liu, Provost, Jeff, Simmons, Jason, Tanda, Eiichi, Wanderer, Jim, Hölzle, Urs, Stuart, Stephen, Vahdat, Amin
Source:	Communications of the ACM. Sep2016, Vol. 59 Issue 9, p88-97. 10p. 1 Color Photograph, 10 Diagrams, 2 Charts, 1 Graph.
Subjects:	Computer network design & construction, Computer network management, Google Inc., Cloud computing, History
Abstract:	We present our approach for overcoming the cost, operational complexity, and limited scale endemic to datacenter networks a decade ago. Three themes unify the five generations of datacenter networks detailed in this paper. First, multi-stage Clos topologies built from commodity switch silicon can support cost-effective deployment of buildingscale networks. Second, much of the general, but complex, decentralized network routing and management protocols supporting arbitrary deployment scenarios were overkill for single-operator, pre-planned datacenter networks. We built a centralized control mechanism based on a global configuration pushed to all datacenter switches. Third, modular hardware design coupled with simple, robust software allowed our design to also support inter-cluster and wide-area networks. Our datacenter networks run at dozens of sites across the planet, scaling in capacity by 100x over 10 years to more than 1 Pbps of bisection bandwidth. A more detailed version of this paper is available at Ref. [ABSTRACT FROM AUTHOR]
	Copyright of Communications of the ACM is the property of Association for Computing Machinery and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database:	Engineering Source

Description
Abstract:	We present our approach for overcoming the cost, operational complexity, and limited scale endemic to datacenter networks a decade ago. Three themes unify the five generations of datacenter networks detailed in this paper. First, multi-stage Clos topologies built from commodity switch silicon can support cost-effective deployment of buildingscale networks. Second, much of the general, but complex, decentralized network routing and management protocols supporting arbitrary deployment scenarios were overkill for single-operator, pre-planned datacenter networks. We built a centralized control mechanism based on a global configuration pushed to all datacenter switches. Third, modular hardware design coupled with simple, robust software allowed our design to also support inter-cluster and wide-area networks. Our datacenter networks run at dozens of sites across the planet, scaling in capacity by 100x over 10 years to more than 1 Pbps of bisection bandwidth. A more detailed version of this paper is available at Ref. [ABSTRACT FROM AUTHOR]
ISSN:	00010782
DOI:	10.1145/2975159