HyperTransport Over Ethernet – A Scalable, Commodity Standard for Resource Sharing in the Data Center

A Scalable, Commodity Standard for Resource Sharing in the Data Center

Jeffrey Young, Sudhakar Yalamanchili, Brian Holden, Mario Cavalli, Paul Miranda. “HyperTransport Over Ethernet – A Scalable, Commodity Standard for Resource Sharing in the Data Center” The Second International Workshop on HyperTransport Research and Applications (WHTRA). February 2011.

Abstract

Future data center configurations are driven by total cost of ownership (TCO) for specific performance capabilities. Low-latency interconnects are central to performance, while the use of commodity interconnects is central to cost. This paper reports on an effort to combine a very high-performance, commodity interconnect (HyperTransport) with a high-volume interconnect (Ethernet). Previous approaches to extending HyperTransport (HT) over a cluster used custom FPGA cards and proprietary extensions to coherence schemes, but these solutions mainly have been adopted for use in research-oriented clusters. The new HyperShare strategy from the HyperTransport Consortium proposes several new ways to create low-cost, commodity clusters that can support scalable high performance computing in either clusters or in the data center.

HyperTransport over Ethernet (HToE) is the newest specification in the HyperShare strategy that aims to combine favorable market trends with a high-bandwidth and low-latency hardware solution for non-coherent sharing of resources in a cluster. This paper illustrates the motivation behind using 10, 40, or 100 Gigabit Ethernet as an encapsulation layer for HyperTransport, the requirements for the HToE specification, and engineering solutions for implementing key portions of the specification.

Download

Paper [PDF] Slides [PDF]

Citation

@inproceedings{young_htoe_whtra_11,
author = {Young, Jeffrey and Yalamanchili, Sudhakar and Holden, Brian and Cavalli, Mario and Miranda, Paul},
title = {Hyper{T}ransport Over {E}thernet – A Scalable, Commodity Standard for Resource Sharing in the Data Center},
booktitle = {WHTRA},
year = {2011}}