Skip Links

Network World

  • Social Web 
  • Email 
  • Close

Data center networks often exclude Ethernet

By Phil Hochmuth , NetworkWorld.com , 05/29/2006

It’s not often that Ethernet is on the outside of an emerging network technology market. But in linking some data center equipment to high-speed pipes, Ethernet sometimes has its nose pressed to the glass door, looking in.

For data center network managers, server interconnect technology falls into two distinct camps. For most, Ethernet, the world standard for networked computers, is how Windows, Linux, Unix and mainframe boxes are plugged in and accessed. But in the rarefied realm of high-performance data center clustering, technologies such as InfiniBand and some niche, proprietary interconnect technologies, such as Myricom’s Myrinet, still have a strong hold.

Over the past several years, InfiniBand switches have emerged as an alternative for some users. Makers such as Voltaire and Infinicon came to market with high-speed clustering switches that connect servers with specialized host bus adapters (HBA). These systems can provide as much as 30Gbps of throughput, with latency as low as the sub-200-nanosec range. (By comparison, latency in standard Ethernet gear is sometimes measured in microseconds -- one millionth of a second -- rather than nanoseconds, which are one-billionth of a second). This server-to-switch technology was so attractive that Cisco purchased InfiniBand switch start-up TopSpin a little more than a year ago for $250 million.

A need for speed, and more

“Ethernet is a good, versatile technology that can handle almost anything,” says Patrick Guay, vice president of marketing for Voltaire. “But Ethernet never had to address the levels of [traffic] efficiency and latency” required in clustered computer systems, storage networking and high-speed server interconnects, he adds.

“It’s not that there is no place for 10G Ethernet in data centers,” Guay says. “There is just a certain subset of customers who need more than what Ethernet and IP offer.”

This was the case at Mississippi State University’s Engineering Research Center (ERC), which runs several large Linux clusters used in engineering simulations for defense, medical and automotive industry research, among other areas. The ERC’s Maverick is a 384-processor Linux cluster connected by Voltaire InfiniBand products. Voltaire’s Intros 96-port InfiniBand switch is used to connect the diskless processor nodes, which access storage — and even operating system boot images — over the InfiniBand links.

Partner Content

Simplify Your Branch Infrastructure

Learn how to simplify your branch infrastructure while dramatically increasing app performance with Citrix Branch Repeater.

Download the Free Info Kit

Next-Gen Load Balancing

Free Guide: "Next Gen Load Balancing: 8 Things You Need to Handle Today's Network Traffic" shows you the functionality needed in your next load balancer.

Download the Free Guide

Accelerate Your Web Apps by up to 5x

Free Guide: "The Secret to Getting Maximum Speed from your Web Applications." Learn how you can deliver Web apps up to 5x faster.

Download the Free Guide

Comments (1)
Login
Forgot your account info?

Data center networks often exclude EthernetBy Anonymous on January 3, 2007, 9:03 am"This allows for around 2 microsec of latency in node-to-node communications, and up to 20Gbps — more than 16 times faster than 10G Ethernet — of bandwidth." 20Gbps...

Reply | Read entire comment

View all comments

Add comment
Anonymous comments subject to approval. Register here for member benefits.
Have a NetworkWorld account? Log in here. Register now for a free account.

Videos

rssRss Feed
Get instant email notification when white papers, webcasts, executive guides are added to our library. Stay informed and up-to-date with the latest on IT Technologies with Network World's Resource Alerts.