Last week I read this blog on the Riverbed website:
http://blog.riverbed.com/2009/09/thank-you-cisco-thank-you-miercom.html
If true, the events portrayed in this blog are quite interesting. Miercom, an "independent" research company commissioned by Cisco, claims that Riverbed's Steelhead 6020 appliance exhibited "system instability" when exposed to ~3000 TCP connections. They used official-looking reports to lead readers to that conclusion. Miercom's report can be accessed at:
http://www.miercom.com/dl.html?fid=20090915&type=report
The following is an excerpt from the Miercom report:
The test results shown in Figure 1 on page 1, illustrate that Cisco WAAS appliance achieved full target 4,000 concurrent sessions, while the Riverbed RiOS Steelhead appliance exhibited system instability and process crash at 3,012 concurrent sessions. In a three minute period of complete TCP blocking, the Riverbed Steelhead appliance took an additional 16 minutes to recover before TCP optimization resumed, as the device completed the system dump of log information. This recovery time could vary between 30 to 45 minutes as illustrated in Riverbed technical notes.
These are very profound allegations, and at first I didn't know who to believe. The so-called "independent" 3rd-party who supposedly provides a neutral perspective? Or Riverbed, the leading vendor in WAN optimization. So I did my own research, by directly asking one of Riverbed's customers. The following is a screenshot from the management interface of their Steelhead 6020 that they provided to me:

According to the customer, the above diagrams show a Riverbed Steelhead 6020 delivering optimized performance for more than 25,000 TCP connections. Assuming each user consumes on average about five TCP connections, this represents a user population of about 5000 remote users that are receiving optimized performance through this particular Steelhead 6020. It seems from this data that Miercom's assertion that the 6020 exhibit "system instability" at ~3000 TCP connections is clearly wrong. Note that the above shows the management console of a Steelhead that is in an actual live production network environment, as compared to Miercom's test which was performed in a lab environment.
The customer also told me that he was extremely happy with his Steelhead 6020's. He even offered me the following data on the performance benefits that they received from this 6020:

So the above findings bring me back to the events that are portrayed in the Riverbed blog. Certainly, the findings from my research seem to support Riverbed's assertion that Miercom and Cisco rigged their test results unfairly. That leaves me wondering, has Cisco's obsession with Riverbed driven them to resort to borderline ethical means in a desperate attempt to bring them down? Was Miercom just a hired gun paid by Cisco to perform the hatchet job on their smaller competitor with the superior product?
Larry Chaffin Ph.D is the Chief Executive Officer/Chairman and founder of Pluto Networks, a Consulting and VAR partner specializing in WAN Acceleration, VoIP, WLAN, Telepresence and Security and a Riverbed reseller. Pluto Networks specializes in the needs of small, large and enterprise companies by always giving them a great ROI on the products they sell. Pluto Networks has a presence in 23 countries around the world enabling all of its consultants to be virtual. Larry was a Judge at Interop for the Best of Interop Awards for 2009 and is looking forward to the 2010 awards in Las Vegas.
Larry has also co-authored all of the books listed below:
Managing Cisco Secure Networks, Skype Me, Practical VOIP Security, Configuring Check Point NGX VPN-1/Firewall-1,Configuring Juniper Networks NetScreen & SSG Firewalls,Essential Computer Security: Everyone's Guide to Email, Internet, and Wireless Security, How to Cheat at Microsoft Vista Administration, Microsoft Vista for IT Security Professionals, Asterisk Hacking, 2008 VoIP and Video Conferencing, Infosecurity 2008 Threat Analysis and author of Building a VOIP Network with Nortel's MS5100, along with co-authoring/ghost writing eleven other technology books for VIOP, WLAN, security and optical technologies. Larry is currently working on a follow up to Building a VoIP network with Nortel's MCS 5100 Book as well as new books on Cisco Telepresence Networks, Practical VoIP case studies and WAN Acceleration with Riverbed.
Larry also has more than 29 vendor certifications and has been working on many others. Larry has been a principal architect around the world in 22 countries for many Fortune 100 companies designing VoIP, security, wireless and optical networks. He has expanded over time also to include application acceleration. Larry is working with worldwide company now out of Asia as a Special Assistant to the CEO and CIO as they go through organizational and network changes, helping them with strategic advice from his years or experience. Pluto Networks is a channel partner of Cisco, ProCurve, LifeSize, Riverbed, Call Copy, Fastsoft and Symantec.
Ready to open Pandora's Box?
If we really want to have a discussion about ethics lets first ask Riverbed why their optimization reports DO NOT INCLUDE PACKET HEADER DATA.
Riverbed is scamming their customers with false advertising of exaggerated optimization claims.
Riverbed Reporting
Riverbed is clear about what we report in the Steelhead management interface. Page 264 in the Steelhead Management Console Users Guide states the following:
What This Report Tells You
The Data Reduction report answers the following questions:
i think just the fact that
i think just the fact that cisco paid mierkom for the report shows who is desperate. 7000 + riverbed customers and growin cant be wrong -:) ... i am not sure what cisco is these days - a switch company, a security company, a wan optimization company, a cable box company or it seems to more like a marketing company -:) what a joke.
Let's open Pandora's Box with Cisco and the WAAS.
I think we should talk about the list price of the product and as soon as you buy it from a partner you get 44% off and more. My friends company was told by Cisco it would be more like 53% to 60% off list if they purchased the product.
How can you take that much off the product and make money if you are Cisco? Is the product that bad and cheap that they have to take the much off? I know the typical discount off list for customer is 40% off, that on about all products so are all of the product made cheap overseas?
When Riverbed came to my friends office and said they don't give that much discount off the product the said it was a better product, would produce a better ROI and they are in the business of making money for the company. How can you do that if you are going to give the product away at 50% off just to sell it and say you have market share?
There was also mention of if you upgrade your core router and your company router with switches we would just give you the WAAS. That would just be working the numbers so it looks like the WAAS was free.
I know of a local company in my area that went with Cisco due to the fact that the staff are former Cisco employees and they would never put anything else in the network. These are the people that cause a CFO to lose money and get fat off Cisco steak dinners.
It is sad that this company did not give a far shake or evaluation to the products in testing, I was told they just said they tested it but had made the decision at dinner with Cisco before the evaluation even starter. I know of 5 large companies who have removed Cisco WAAS after putting it in for a year due to problems and it did not work like said. They all went with Riverbed, I have never heard of a Riverbed Customer removing the product and putting in Cisco WWAS.
It is said you never will get fired for buying a Cisco product or putting it in the network. So I guess no one will ever get fired for buying a Cisco WAAS, but maybe they should!!
I do remember this picture made me laugh
This was a great picture from another post about Cisco.
http://www.networkworld.com/community/node/44997
Ethics with Cisco, statement made by Chambers
The following quote is attributed to John Chambers, but I wonder...does Mr. Chambers really have control of his company???
"Discussions of corporate ethics and integrity have become increasingly important in today's business environment, but these discussions are not new to Cisco. Ethics, especially integrity, have always been a significant part of both our culture and the way we conduct business. Operating with a strong sense of integrity is critical to maintaining trust and credibility with our customers, partners, employees, and shareholders."
John Chambers
Chairman and CEO
Cisco
URL: https://www.cisco.com/web/about/ac227/about_cisco_ethics.html
So what does this say about the testing Cisco has done by other company's?
Cisco WAAS
If you want an independent view of the WAN optimisation/acceleration market look at Gartner. They have consistently warned prospective customers to beware of using Cisco WAAS. I don't often see that from Gartner.
They state that you would have to have a very compelling reason not to go with other vendors.
Riverbed's best PR is the Cisco WAAS.
We have tried to use the Cisco WAAS over the years and put it back in the box because it didn't deliver. Perhaps it has changed since then but I certainly have no issue with the Steelhead we put in. Worked first time with excellent results.
There is a danger any time a
There is a danger any time a research company is paid by any organization - hardware vendor, software vendor, etc - to write a whitepaper or report for public consumption.
Let's face it, if you are paid by a customer to produce a marketing document you are not going to produce a document that is negative towards your customer. This is the same for EVERY report from EVERY vendor.
The test conditions - if a test takes place - are going to be optimized for the customer's product in question thus leading it to succeed.
Most IT managers are smart enough to take any marketing docs they receive from a vendor with the proverbial grain of salt.
Cisco, ethical??? They talk
Cisco, ethical??? They talk it but they dont walk it.
Anyone believing in their code of 'ethics' must be delusional.
They are a huge company that needs to make money to keep its stock price up.
Riverbed and Miercom
I find it more than a little unconscionable that Mr. Chaffin attacks Miercom’s credibility when he fails to admit that he is a reseller of Riverbed equipment for application acceleration devices.
My contacts at Miercom inform me they did not state that the Riverbed device is incapable of supporting upward of 25,000 concurrent connections. However, under certain load conditions the product can crash before it reaches even 3,000 concurrent connections. Furthermore, to be as fair as possible to all parties, Miercom invites companies whose products have been featured in its competitive testing to be retested within 60 days of publication of results; this invitation was duly extended to Riverbed. Additionally, Riverbed has admitted to the deficiency referenced in the published report. I discovered this is true based on Riverbed’s own rebuttal document on page 2, where they indicate that they found and fixed this bug in RiOS 5.5.5.
From my conversation I gather that Miercom stands firmly by the results of their testing and invites Riverbed customers to contact the company directly for further information regarding these.
netguardianangel2@yahoo.com
Post new comment