A meta-framework for conducting mixed methods impact evaluations: Implications for altering practice and the teaching of evaluation

Educational interventions are becoming increasingly more complex, far-reaching, and high-stakes. Thus, there is a need for an evaluation meta-framework that is comprehensive, flexible, and meets enhanced complexity. Therefore, we provide a new and comprehensive definition of impact evaluations—what we call a comprehensive impact evaluation—that draws out the importance of collecting and analyzing both quantitative and qualitative data, thereby resulting in a rigorous approach that can allow for strong inferences. Further, we provide an overview of impact evaluation designs that can be used in comprehensive impact evaluations along with a rationale for using both quantitative and qualitative research techniques. This leads to the central purpose of the article: to provide a meta-framework for conducting what we call a Mixed Methods Theory-Based Impact Evaluations, wherein mixed methods techniques are used at every phase of the process. Building on White's (2009) work, we outline an 8-phase Mixed Methods Theory-Based Impact Evaluation.