Exam cheating and braindump sites are persistent problems in the high-stakes world of IT certifications, and vendors serious about protecting the integrity of their certifications have to fight cheaters on many levels.

Take Cisco. Exam security vendor CertGuard recently discovered 326 braindump sites selling replicas of Cisco certification exams, second only to Microsoft’s 328.

Cisco officials say they are well aware of the problem and are tackling it on many levels, from changes in the tests that minimize cheating, to penalties levied against individual cheaters and legal actions against braindump sites.

“We want to protect the overall value of the program for the candidate who didn’t cheat,” says Erik Ullanderson, who is based on Minnesota and manages Cisco’s certification program. “It’s not about busting the cheaters or finding the cheaters, it’s about protecting the brand for people who do not cheat.”

Of course, sometimes it is about busting the cheaters. Cisco is constantly examining exam results both to tease out general trends and figure out who knew the answers in advance. Certain parts of exams can be passed easily if the test taker sees a copy of the test in advance and memorizes it. Other parts of exams, especially for expert-level certifications, have practical components that might consist of eight hours of configuring and troubleshooting in a lab.

“It’s just not possible to fake being able to configure and troubleshoot,” says Fred Weiller, director of marketing for careers and training at Cisco.

So if one person does exceptionally well on a written portion of the test and then fails the practical portion miserably – well, that’s a good sign of cheating. In those cases, Cisco might ask the person to take the test again, and if it’s clear there was cheating penalties ranging up to permanent expulsion from the testing program are on the table.

The braindump sites remain a problem, though. To stay ahead of them, Cisco is constantly evaluating data to find which parts of the tests need to be changed. “A week does not go by that we are not evaluating the data that comes in,” and changing test questions as needed, Ullanderson says.

Cisco officials would not reveal how many cheaters they have caught. But they say a large portion of braindump sites have such out-of-date content that they wouldn’t even help a willing cheater. Still, Robert Williams, CEO of CertGuard, remains impressed by how quickly braindump sites obtain and post tests in violation of Cisco’s – and many other vendors – intellectual property.

Jon Brodkin is senior writer at Network World.