GridWorld: Panelists weigh grid’s promise, obstacles

News
Sep 13, 20065 mins

Underuse of grids, lack of development tools among challenges.

WASHINGTON, D.C. — Grid technology once reserved for high-end research centers is making its way into more enterprises, though plenty of obstacles to wider adoption remain.

This is according to a panel of vendors gathered to address the impact of grid computing on business at the GridWorld conference held in Washington, D.C., this week. Online auctioneer eBay, which exploits a massive computing grid to power its site, is one an example of a successful implementation and was the topic of a Tuesday keynote at the conference.

Acknowledging that grids aren’t appropriate for every application a company runs, Ken King, vice president of grid computing with IBM, said the technology is becoming more mainstream.

“To me mainstream means something is used in [a company’s] core data center for mission-critical applications, things that are core to revenue-generating aspects of business,” he said. “We are just starting to see aspects of grid move into that.”

But that point at which companies attempt to expand their use of grid computing is also where they often run into headaches, said another panelist.

“Often grids just don’t get used to the degree promised, therefore they can’t achieve enterprise adoption” or the expected ROI, said Dan Hushon, chief technologist with EMC.

Some hurdles to wider adoption are what IBM’s King called “perceived inhibitors,” such as the belief that the IT department has to give over ownership of grid projects to the business units – but still carry the expense on the IT budget – and security concerns.

“Companies have to deal with getting over those types of perceptions they have because it’s grid, really it’s not different” than adopting other new technologies in the past, he said.

Of course there are companies for which grid computing makes perfect sense, such as eBay. The online auction Web site began putting together a grid infrastructure about five years ago, says Paul Strong, a distinguished research scientist at eBay. The site’s fast-growing user base and huge catalog of items for sale made the flexibility and agility of grid computing particularly attractive.

Grid computing was an obvious choice because “there was no way the existing technology would scale,” said Strong, who has been with eBay for about a year and gave a keynote presentation at GridWorld. The company decided to abstract its databases and scaled them, building a “primordial grid,” he said.

Currently eBay has more than 15,000 servers in its production environment and uses a grid made up of about 350 Windows, Linux and Solaris computers, he said. It takes the site about 20 minutes to update with new features, and on average the company adds 300 new features to the site per quarter, Strong said.

It’s not possible to simply buy a grid, said both Strong and the vendor panelists; instead a grid infrastructure must be built. But if companies begin thinking of their data centers as grids and treating them accordingly, they can rather easily start taking advantage of the benefits.

“It’s almost philosophical,” Strong said. Companies have to decide “not to develop applications in silos, but to build virtual silos. It’s something to bear in the back of your mind.”

Sometimes companies become victims of their grids, said Jim Parkinson, vice president of engineering at Sun, and wind up building a distinct grid for each application.

“Every time they build a grid, it’s just for one thing,“ he said. “We have to teach organizations how to share resources, to make resources generic enough so they can put lots of different resources on them.”

Unlike with many other new technologies, the benefits of grid computing are often first understood by business unit managers within an organization, Parkinson said. “We see it coming from the business units and being pushed into IT.”

IBM’s King agreed: “Grid is a lot closer to the business unit and its processes because it’s about virtualizing the application. Grid enables you to get closer to the business.”

But that dynamic also can create roadblocks to adoption. Skill sets for grid-specific tasks, such as writing the appropriate policies, need to be developed, which can lead to resistance from the IT department, panel members said. 

Another hurdle is the lack of software development tools for building grid-aware applications, Sun’s Parkinson said.

“That’s where the maturation is going to have to pick up some speed…someone wants to put an application out [on a grid] but can’t get there either for skill set reasons or tool reasons,” he said. “As the applications catch up, grid will become more mainstream.”

IBM’s King added: “Five to ten years from now grid will be more mainstream, when the applications [are available] and the core technology is engrained into the operating system and middleware so you see characteristics like provisioning and registration built into mainstream products.”