Testing 10Gig Ethernet switches

Lab tests prove that most first-generation 10G Ethernet switches don't deliver anywhere close to 10 gigabits of throughput. But the latest backbone switches  do deliver more bandwidth than earlier gear that used link aggregation, and they do a better job of quality-of-service enforcement.

In Network World's first hands-on assessment of the new 10G Ethernet switches, we put boxes from five major vendors through a comprehensive set of performance tests - both 1 and 10 Gigabit flavors of Ethernet. Avaya, Force10 Networks, Foundry Networks, HP and Nortel accepted our challenge. Other major players went missing, citing various reasons (see "No shows" ).

Hardware gremlins plagued Nortel's devices, and we couldn't obtain valid results. For the remaining players, the results offer limited encouragement:

•  Force10's E1200 delivers true 10G bit/sec throughput with any frame size, a performance that earned it the Network World Blue Ribbon award.

•  Foundry's FastIron 400 and HP's ProCurve Routing Switch 9300m series (which HP buys from Foundry) achieved fast failover times.

•  Avaya's Cajun P882 MultiService Switch kept jitter to a minimum and dropped no high-priority packets in our QoS tests.

But, when all is said and done, none of these first-generation devices represent the perfect switch. Force10's E1200 aced the throughput tests, but its delay and jitter numbers are far higher than they should be. As for the others, they won't really be true 10 Gigabit devices until they get capacity upgrades.

While the 10 Gigabit performance results are disappointing, it's important to put those numbers in context. Few, if any, users are planning pure 10G Ethernet networks, so these devices support a variety of interfaces and other features useful for enterprise core networking, such as support for highly redundant components and multiple device management methods (see full feature listing - Excel file ). It's important to note that these switches did a pretty good job of handling tasks not directly related to 10G Ethernet, such as failover and QoS  enforcement.

To the tests

We evaluated switch performance with four sets of tests: 10 Gigabit alone; Gigabit Ethernet across a 10G Ethernet backbone; failover times; and QoS enforcement.

The main goal of our pure 10G Ethernet tests was to describe the basic forwarding and delay characteristics of the new technology. Would it really go at 10 gigabits? And how much delay and jitter would the new interfaces incur at that speed?

To answer these questions, we set up a test bed comprising a single switch equipped with 10G Ethernet interfaces and SmartBits traffic generator/analyzers from Spirent Communications (see How we did it ). All vendors supplied four 10G Ethernet interfaces for this event except Avaya, which supplied two.

We configured the SmartBits to offer traffic from more than 2,000 virtual hosts (more than 1,000 hosts in Avaya's case), representing the large number of devices attached to a typical 10 Gigabit switch.