4. How to assure the quality of an evaluation

When commissioning an evaluation to external evaluators, you need to make sure the evaluation is in line with the Terms of Reference and of good quality. For an overview of how to manage an evaluation with an eye on quality and usability, look at Module 12 (Managing for Quality and Use) of the IPDET manual. On pp. 637-640, the manual describes the six key elements of a good evaluation: impartiality, usefulness, technical adequacy, stakeholder involvement, feedback and dissemination, and value for money. The text also describes the option of using “meta-evaluators” for quality assurance.

Especially for assuring the quality of an evaluation, the evaluation manager should make use of checklists. A useful and comprehensive checklist to assess the quality of an evaluation is Daniel Stufflebeam’s Program Evaluation Metaevaluation Checklist. The checklist concentrates on the utility, the feasibility, the propriety and the accuracy of an evaluation and assigns a score from 0/1 (poor) to 6 (excellent) to each of a total of 30 criteria. In addition, the Deliberative Democratic Evaluation Checklist highlights a different angle of evaluation quality. The assumption is that incorporating democratic processes within the evaluation helps to secure better conclusions. This list is useful when an evaluation is conducted in an environment of conflicting views.

 TOPIC LEARNING RESOURCE AUTHOR TYPE OF RESOURCE LANGUAGE
Key manual/guide Module 12 (Managing for Quality and Use) of the IPDET manual International Program for Development Evaluation Training (IPDET) PDF toolbox English
Checklists and
Templates
Program Evaluation Metaevaluation Checklist Daniel Stufflebeam PDF Checklist English
  Deliberative Democratic Evaluation Checklist Ernest R. House & Kenneth R. Howe PDF checklist English

 


Like what you just read? Share it with others!