One key to quality software is the quality of the people involved in creating and maintaining it. One of the tools for increasing the quality of your team is through training of existing employees, which I’ll address in a later blog post. For this post, I want to focus on something that is often confused with training, but actually is (or at least should be) something entirely different: certification.
All IT managers–whether software test managers or other software managers–want to hire qualified people. Certainly, IT certification can be part of the qualification puzzle in many IT fields. IT professionals often use certification in key skill areas to demonstrate their qualifications. However, with all the certification programs floating around out there, how do managers and professionals distinguish useful certifications from pointless wallpaper? In this post, I’ll examine how you can pick the right IT certifications for yourself (as an individual) or for your team and the people you hire (as a manager).
Any certification worth considering will have, at its basis, a body of knowledge or syllabus. This document should describe the skills and abilities that the certification measures. Those people who have mastered most of these skills and abilities (sometimes called “learning objectives” in the syllabus) will be able to earn the certification, usually through some kind of exam.
So, the first and most important step is to determine whether the skills and abilities listed in the syllabus are useful. Does the syllabus relate to your day-to-day work? Will the benefits of achieving the certification—increased effectiveness and efficiency, credibility of the team, etc.—justify the cost?
Of course, it’s possible that your day-to-day work should more closely resemble what is described in the syllabus. This can happen when your organization is not following industry best practices. So, you should also evaluate the source of the syllabus. If the syllabus was written by a broad, international team of recognized, published industry experts, perhaps you should consider moving your practices towards those required for certification. Adopting the certification as a guideline for your practices—and hiring people with the certification—can be a good way to move in this direction.
Selecting a certification developed by a broad team of recognized, published industry experts is important because, in general, such certifications enjoy increased acceptance over certifications developed by a small clique of like-minded people. People in the industry will recognize the names of the authors and developers of the syllabus. To some extent, the credibility and thus value of all certifications rests upon the reputation and credibility of the people who stand behind those certifications.
I also mentioned that the team of experts should be international, because so often now we are engaged in globally distributed work. If you are not working in a globally distributed fashion today, you probably will be soon. So, you need certifications that have a global reach. If you want to hire (or be part of) a global team of certified professionals, a single common certification is key. This way, the whole team speaks the same language and knows the same concepts.
Of course, if you plan to hire people who hold a certification because you believe the syllabus has value, you want to be confident that those people have indeed mastered the topics in the syllabus. This brings us back to the matter of the exam.
Certification exams are a complicated issue, and some ill-informed polemics about exams occur on a few internet web sites. Proper creation of exams is the province of a profession called psychometrics. Psychometrics applies the fields of psychology, education, and statistics to the process of qualifying people through exams. Any legitimate certification body (i.e., the organization developing and administering an exam against a syllabus) will employ professional psychometricians to ensure proper exams.
In evaluating whether an exam properly assesses someone’s qualifications, you need answers to four questions. First, is the exam statistically valid, and can the certification body prove validity? Second, is the exam a quality instrument, free from grammatical and spelling errors, formatting problems, and other glitches that might distract exam takers, and what process does the certification body use to ensure quality? Third, is the exam of uniform difficulty and quality whenever and wherever it is administered, and how does the certification body accomplish uniformity? And, fourth and finally, since exam questions are developed by people, what steps does the certification body use to ensure the integrity of the exams; i.e., that the questions are not leaked to candidates, onto the internet, or to accredited training providers?
This last point—that of accredited training providers—brings us to an important consideration. It is certainly valuable to have training available to support certification programs. Accrediting training, whereby the certification body checks the content of the training to ensure compliance with and coverage of the syllabus, can help busy managers and professions narrow their search for quality training. However, when the accreditation process is opaque, when only members of the certification body offer accredited training, or, worse yet, when accredited training is required to take an exam, you are not looking at a real certification: you are looking at a marketing vehicle for some company’s or cartel’s training programs. You should pick certification programs that have open, transparent processes for accreditation, with a diverse, competitive field of training providers, and which do not require any training at all to take the exams.
Certifications can help IT managers and professionals grow their teams and their skills, if chosen carefully. If you select the right bodies of knowledge, developed by the right people and delivering the right skills for your work, certification can lead to improvements in effectiveness, efficiency, and communication within teams. It’s also essential that the certification body follow best practices in the creation and delivery of the exams. And, if you decide to use training to help achieve certification, make sure to pick a program where the training supports the certification, not vice versa. If you follow these basic concepts, you can obtain good value from IT certification programs, both as a professional and as a hiring manager.








Rex Black is President of RBCS (