Technology testers

Changing passwords, swapping out bad hardware and answering users' dumb questions are all part of being in IT. But often the reward for time in the tech trenches is a spot in a corporation's technology evaluation group.

Keeping up with the latest and greatest IT products can be daunting. Some IT shops in large organizations set up subgroups to evaluate new products and determine the business value they might bring. Other big firms assemble IT teams to test products in a specific category, such as security or open source. Smaller shops also may rely on a technology evaluator to separate the wheat from the chaff.

At package-delivery giant UPS, a separate Advanced Technology Group consists of about a dozen people who evaluate new hardware and software on a technical level and business-case perspective.

"We're looking out on an ongoing basis for new technology," says John Nallin, vice president of information services, global network systems and technology infrastructure at UPS in Atlanta. Key vendors visit several times per year to lay out their product road maps.

Most technology plans formed inside UPS come from needs of the business units, which dispatch liaisons. When a problem is identified, IT finds a technical solution.

The Advanced Technology Group is also proactive, with members looking out on their own for new technologies that might help the company. When someone in the group identifies a potentially useful new product, an evaluation is set up, which usually lasts four to eight weeks. During this time, the hardware or software is tested as it would be used in real-world deployment. If the product has technical merit, the group considers whether it would be cost-effective to deploy and the ROI.

At this stage, "we're looking into everything that is required - how many locations would need this technology, what that would cost," Nallin says. "Understanding the cost is very important in technology evaluation."

The team has found some great products that have reduced UPS' costs and boosted productivity, but there have been some misses, too.

Nallin points to a compression technology that was deployed in the company's data center a few years ago. "It ended up costing more to run the compression than it would have to just buy more [storage]," he says. "We lost some money on that."