Virtual server technologies used in preproduction environments promise cost, time and labor savings, yet the same tools left unchecked can result in complex configurations, wasted resources and management nightmares for IT staff.
Virtualization removes the physical server constraints of test environments and enables sharing of resources among IT staff to make test work easier, but its use needs to be carefully controlled, industry analysts and IT professionals say.
"One of the pitfalls of using virtualization in test environments is the proliferation of images, especially when testing multiple configurations across different operating systems," says Carey Schwaber, a senior analyst at Forrester Research. "There has to be a real effort around controlling this environment with policies to prevent the environment from growing too much or becoming unused resources."
Tim Antonowicz, systems engineer at Bowdoin College in Brunswick, Maine, says virtualization helps his team test software without requiring the build of a new operating system or cluttering a developer's workstation with another piece of software. He has 55 test stage, or sandbox, virtual machines (VM) running.
"Sandboxes are basic VMs where we test and evaluate various software offerings without expectation. If we want to try out something new, run a beta version or just play with a new idea, we roll out a sandbox VM," Antonowicz says.
Using virtualization in such a way — as a tactical tool for testing — is common. But most IT organizations haven't standardized their use of virtualization for testing across the enterprise. Different IT groups wind up operating their own pockets of virtual servers that aren’t always properly managed or decommissioned. Industry watchers argue the benefits of using virtualization in test labs have yet to be fully realized because of these inconsistencies.
"It is important to have consistency when testing, and IT needs a comprehensive management approach to ensure proper coordination between physical machines and virtual resources," says Melinda Ballou, a principal analyst at IDC.
To help IT managers gain control of their testing resources, virtual test lab management vendors have been coming out with new tools.
Vendors such as Akimbi (acquired by VMware), CollabNet, VMLogix and Surgient have emerged in the past two years with products aimed squarely at those enterprise companies using virtual server tools to quickly build up and tear down testing environments. The products include automated features that track virtual machines and capture configuration data to be stored in libraries for future use.
For instance, Akimbi's Slingshot product, now VMware's Lab Manager, lets IT managers build a software test infrastructure to automate the setup and teardown of multiple VM environments. Surgient's Virtual QA/Test Lab Management System speeds the test process for enterprise IT managers by consolidating test infrastructure and making it possible to automate the setup and teardown of complex test configurations on demand.