So what is this new Simulation Technology?

In an earlier blog I had stated that the only “real” way to accurately test the knowledge of an examinee was to have them take a “hands-on” test; either with physical equipment or through virtual machines. Only by demonstrating your ability to perform tasks on the technology being tested could you demonstrate that you have both the knowledge and mastery of the subject matter. Microsoft has developed five exams that use Performance-based testing with a new one due out in a few months.

Now you may be asking yourself exactly what is this performance-based testing? In short – you are tested on your ability to perform tasks on the tested technology. What separates this from other testing formats is that you are not picking form multiple-choice answers or using a drag and drop format – you are being tested on your ability to perform real-world tasks ON the technology. In other words – it is a hands-on test that validates the candidates’ ability to work with and perform tasks on a technology and not memorize minutiae about the tested technology.

Performance based testing will have two important impacts in the Microsoft certification filed – helping to eliminate or diminish braindumps and dramatically improve the value of Microsoft certifications. One of the many benefits of this testing scheme is that there are not pools of questions that braindumpers can download, memorize and regurgitate in the testing booth. True – a braindumper may be able to get a hold of the tasks they are to be performed on the test – but they will still need to know and learn HOW to do the tasks in order to pass the test. This will provide more validity to these tests and their associated certifications (as well as reducing paper MCSE’s). The second major benefit is the increased value of these tests and certifications with employers and the IT industry. The CCIE is so highly valued, in part, due to the lengthy and difficult hands-on test. In this case, as with the Performance based testing, you must actually demonstrate your competency on the technology. What is going to prove challenging for testers is finding testing centers that can support the new hardware levels required for the next generation performance based testing. So – all you Prometric testing centers that are procrastinating in purchasing new hardware – hop to it!

I believe that more Microsoft Certification tests (if not all of them!) should be performance based as this truly tests the depth and breadth of knowledge of a candidate and not a multiple-guess test.