Performance–Based Certification – How to Design a Valid, Defensible, Cost–Effective Program

List of Tables, Figures, and Exhibits / xi
<p>Contents of the Website / xiii</p>
<p>Introduction / 1</p>
<p>Chapter 1 The Driver / 11</p>
<p>Why Organizations Certify / 11</p>
<p>Protecting the Public / 12</p>
<p>Reinforcing Professional Stature and Promoting Universal Standards / 13</p>
<p>Preparing People for Jobs Requiring Competence in Multiple Disciplines / 14</p>
<p>Protecting Jobs and Enhancing Professional Stature / 15</p>
<p>Improving Business Processes / 16</p>
<p>Establishing Professional Credibility and Influencing Academic Curricula / 18</p>
<p>Establishing Uniform Performance Standards / 18</p>
<p>Protecting the Brand Name / 19</p>
<p>Raising the Level of Core Competencies / 20</p>
<p>Success Measures / 21</p>
<p>Who to Involve / 21</p>
<p>The Players / 21</p>
<p>Target Audience / 22</p>
<p>Stakeholders / 22</p>
<p>Benefits of Certification / 25</p>
<p>Missteps and Oversights / 26</p>
<p>Tips / 27</p>
<p>Summary / 30</p>
<p>Where to Learn More / 31</p>
<p>Notes / 32</p>
<p>Chapter 2 The Business Case / 33</p>
<p>What Goes into a Business Case / 34</p>
<p>Hypotheses, Premises, and Best Guesses / 36</p>
<p>Metrics or Key Success Indicators / 37</p>
<p>Economic Metrics / 39</p>
<p>Noneconomic Metrics / 42</p>
<p>The Requirements / 43</p>
<p>Missteps and Oversights / 43</p>
<p>Tips / 44</p>
<p>Summary / 48</p>
<p>Where to Learn More / 50</p>
<p>Note / 51</p>
<p>Chapter 3 The Requirements / 53</p>
<p>Distinctions Among Eligibility, Qualification, and Certification / 53</p>
<p>Roles Certification Plays / 54</p>
<p>Gatekeeping or Screening / 54</p>
<p>Recognizing Demonstrated Performance / 57</p>
<p>Recognizing Different Levels of Accomplishment or Different Capabilities / 57</p>
<p>Typical Requirements for Certification / 58</p>
<p>Acceptance of a Code of Conduct / 61</p>
<p>Eligibility / 61</p>
<p>Education, Training, and Development / 65</p>
<p>Endorsements / 67</p>
<p>Experience / 67</p>
<p>External Credentials / 69</p>
<p>Tests / 69</p>
<p>Work Samples / 72</p>
<p>Work or Personnel Records / 72</p>
<p>Maintenance and Recertification / 73</p>
<p>Missteps and Oversights / 74</p>
<p>Tips / 74</p>
<p>Summary / 76</p>
<p>Where to Learn More / 77</p>
<p>Notes / 78</p>
<p>Chapter 4 The Standards / 79</p>
<p>Competencies, Standards, and Criteria / 81</p>
<p>Defi ning the Scope of the Effort / 85</p>
<p>The Job or Task Analysis / 89</p>
<p>Traditional Job/Task Analysis Methodologies / 89</p>
<p>Controlling Bias / 91</p>
<p>Sampling Error / 92</p>
<p>Design Error / 95</p>
<p>Administrative Error / 109</p>
<p>Design of the Credential / 111</p>
<p>Certification vs. Certificate / 111</p>
<p>The Elements / 114</p>
<p>Missteps and Oversights / 115</p>
<p>Tips / 116</p>
<p>Standards / 118</p>
<p>The Design / 119</p>
<p>Summary / 119</p>
<p>Procedures / 121</p>
<p>Focus Groups / 121</p>
<p>The NGT / 122</p>
<p>Outcome–Based Competency Session / 123</p>
<p>Delphi Study / 124</p>
<p>Where to Learn More / 125</p>
<p>Note / 126</p>
<p>Chapter 5 Assessment / 127</p>
<p>Definitions / 127</p>
<p>Rigor and Validity / 130</p>
<p>Sampling Error / 131</p>
<p>Under–Representation / 131</p>
<p>Extraneous Abilities / 132</p>
<p>Test Specifications / 133</p>
<p>Design Errors / 134</p>
<p>Administrative Error / 136</p>
<p>Types of Test Items / 137</p>
<p>Response–Supplied Items / 137</p>
<p>Response–Not–Supplied Items / 138</p>
<p>Computer–Based Testing / 141</p>
<p>Determining the Passing Score / 142</p>
<p>Informed Judgment Method / 143</p>
<p>Contrasting Group Method / 143</p>
<p>Conjectural (Angoff–Nedelsky) Method / 145</p>
<p>Issues in Assessment and Testing / 146</p>
<p>Opportunity to Learn / 146</p>
<p>Adequate Time and Resources / 147</p>
<p>Face Validity / 147</p>
<p>Documentation / 148</p>
<p>Missteps and Oversights / 148</p>
<p>Tips / 149</p>
<p>Summary / 155</p>
<p>Where to Learn More / 161</p>
<p>Chapter 6 Governance and Administration / 163</p>
<p>Responsibilities of the Governance Board / 163</p>
<p>Candidate Rights / 165</p>
<p>Disclosure / 165</p>
<p>Appeals and Exemptions / 167</p>
<p>Preparation and Remediation / 169</p>
<p>Ethics / 170</p>
<p>Fees and Compensation / 170</p>
<p>Test Administration / 174</p>
<p>Responsibilities of the Program Administrator / 175</p>
<p>Establishing Administrative Support Systems / 176</p>
<p>Analyzing Test Items / 177</p>
<p>Missteps and Oversights / 178</p>
<p>Tips / 179</p>
<p>Summary / 187</p>
<p>Where to Learn More / 190</p>
<p>Notes / 191</p>
<p>Chapter 7 Recertification and Maintenance / 193</p>
<p>Stability of Enabling Knowledge / 194</p>
<p>Distinguishing Between Knowledge Atrophy and Knowledge Evolution / 195</p>
<p>Defining the Purpose of Recertification or Maintenance / 198</p>
<p>Redoing the Job/Task Analysis / 199</p>
<p>Timing the Requirement / 200</p>
<p>Missteps and Oversights / 201</p>
<p>Tips / 201</p>
<p>Summary / 203</p>
<p>Where to Learn More / 205</p>
<p>Chapter 8 Implementation / 207</p>
<p>The Marketing Strategy / 208</p>
<p>Defining the Market / 209</p>
<p>Branding the Credential / 210</p>
<p>Launching the Credential / 211</p>
<p>Rolling Out the Credential and Penetrating a Market / 212</p>
<p>Developing and Executing a Communication Plan / 213</p>
<p>Developing Effective Program Materials / 214</p>
<p>Celebrating Success / 215</p>
<p>Missteps and Oversights / 216</p>
<p>Tips / 217</p>
<p>Summary / 220</p>
<p>Where to Learn More / 220</p>
<p>Chapter 9 Going Global / 221</p>
<p>Distinctions Among National, International, Global, and Multi–National Programs / 221</p>
<p>Why Go Global or International? / 224</p>
<p>Determining Reciprocity, Equivalency, and Exemptions / 225</p>
<p>Safeguarding Against Fraud or Misrepresentation / 226</p>
<p>Cultural Issues / 227</p>
<p>Language and Translation / 227</p>
<p>Missteps and Oversights / 229</p>
<p>Tips / 230</p>
<p>Summary / 230</p>
<p>Where to Learn More / 233</p>
<p>Note / 233</p>
<p>Chapter 10 Evaluation / 235</p>
<p>Developing an Evaluation Strategy / 235</p>
<p>Defining Evaluation Processes / 236</p>
<p>Determining What to Measure / 237</p>
<p>Determining Where to Start / 238</p>
<p>Being Clear About Your Purpose / 242</p>
<p>Developing an Agenda / 244</p>
<p>Presenting Your Data / 244</p>
<p>Missteps and Oversights / 246</p>
<p>Tips / 247</p>
<p>Summary / 248</p>
<p>Where to Learn More / 251</p>
<p>Index / 253</p>
<p>About the Author / 269</p>