IBM analysis of Amazon finds cloud support forums lacking

Cloud problem resolution often takes days

When you use the cloud, you get what you pay for.

And if you're expecting diligent support and quick resolution of technical problems, then – to state the obvious - choosing the cheapest support option might not be the best idea.

If you purchase virtual server capacity from a cloud provider, there's a very good chance you're a customer of the Amazon Elastic Compute Cloud (EC2). Amazon offers a "Premium Support" package at a price, but many customers opt to instead use the free support forums, with mixed results.

To continue reading, register here to become an Insider. You'll get free access to premium content from CIO, Computerworld, CSO, InfoWorld, and Network World. See more Insider content or sign in.

When you use the cloud, you get what you pay for.

And if you're expecting diligent support and quick resolution of technical problems, then – to state the obvious - choosing the cheapest support option might not be the best idea.

If you purchase virtual server capacity from a cloud provider, there's a very good chance you're a customer of the Amazon Elastic Compute Cloud (EC2). Amazon offers a "Premium Support" package at a price, but many customers opt to instead use the free support forums, with mixed results.

Greatest tech arguments: Public vs. Private Cloud

Amazon support forum administrators usually respond to posts within 10 or 12 hours, but problem resolution often takes days, according to a new analysis of the forums by a team of researchers from the University of Wisconsin-Madison and IBM Research.

Their paper - titled "A First Look at Problems in the Cloud" - will be presented at the Usenix technical conference in Boston later this month, and examined 9,575 message threads posted between August 2006 and December 2009 in the Amazon support forums. (The paper refers to Amazon only as "a prominent IaaS provider," but lead author Theophilus Benson confirmed to Network World that Amazon is the company that was analyzed.)

Connectivity, virtual image management and performance are common problems for Amazon EC2 users, but resolving technical issues is often a headache, the researchers suggest.

Even though Amazon is highly experienced at operating its own data centers, customers may still face challenges operating their own virtual machines.

"In a typical commercial cloud, the cloud provider is mainly responsible for problems associated with its own infrastructure," the authors write. "The provider monitors its physical resources such as servers, storage and network systems to provide reasonably stable resources up to the hypervisor level. While the cloud provider tries to ensure a highly available infrastructure, it typically does not provide guarantees on individual instance availability. Users should expect that the provided virtual resources may become unavailable at times, thus requiring users to restart their application instances on a new server."

The researchers did not examine the effectiveness of Amazon's Premium Support, which offers one-on-one problem resolution at prices starting at $100 and $400 per month. Premium customers get unlimited support cases and help building and running applications on the Amazon cloud infrastructure.

While this is a key limitation of the study, the researchers said "we do believe that our preliminary evaluation sheds light on the most common problems faced by a typical user of IaaS clouds."

Over the three-year-period studied, 166 administrators participated in the threads, responding to 60% of problems in less than nine hours, but sometimes taking nearly 20 hours to respond. A group of 10 administrators are responsible for solving most problems.

"We observe that problems seem to be resolved within 11 to 110 hours of the administrator's first response," the researchers write. "It is likely that much of the time after the first response from an administrator is spent in an iterative trial and error process as customers explorer possible root causes."