TY - JOUR
T1 - An organizational model to distinguish between and integrate research and evaluation activities in a theory based evaluation
AU - Sample McMeeking, Laura B.
AU - Basile, Carole
AU - Brian Cobb, R.
N1 - Funding Information:
Development of this manuscript was funded in part through a grant by the U.S. National Science Foundation . The opinions expressed herein do not necessarily reflect the policy or position of the U.S. National Science Foundation, and no endorsement should be inferred.
Funding Information:
Carole G. Basile is Dean of the College of Education at the University of Missouri – St. Louis. She has served as Principal Investigator or Co-Principal Investigator on several math and science related projects funded by the National Science Foundation, the U.S. Department of Education, and the National Governors Association. A former Associate Dean of Teacher Education her teaching and research have focused on teacher preparation and professional learning.
PY - 2012/11
Y1 - 2012/11
N2 - Theory-based evaluation (TBE) is an evaluation method that shows how a program will work under certain conditions and has been supported as a viable, evidence-based option in cases where randomized trials or high-quality quasi-experiments are not feasible. Despite the model's widely accepted theoretical appeal there are few examples of its well-implemented use, probably due to time and money limitations necessary for planning and a confusion over the definitions between research and evaluation functions and roles. In this paper, we describe the development of a theory-based evaluation design in a Math and Science Partnership (MSP) research project funded by the U.S. National Science Foundation (NSF). Through this work we developed an organizational model distinguishing between and integrating evaluation and research functions, explicating personnel roles and responsibilities, and highlighting connections between research and evaluation work. Although the research and evaluation components operated on independent budgeting, staffing, and implementation activities, we were able to combine datasets across activities to allow us to assess the integrity of the program theory, not just the hypothesized connections within it. This model has since been used for proposal development and has been invaluable as it creates a research and evaluation plan that is seamless from the beginning.
AB - Theory-based evaluation (TBE) is an evaluation method that shows how a program will work under certain conditions and has been supported as a viable, evidence-based option in cases where randomized trials or high-quality quasi-experiments are not feasible. Despite the model's widely accepted theoretical appeal there are few examples of its well-implemented use, probably due to time and money limitations necessary for planning and a confusion over the definitions between research and evaluation functions and roles. In this paper, we describe the development of a theory-based evaluation design in a Math and Science Partnership (MSP) research project funded by the U.S. National Science Foundation (NSF). Through this work we developed an organizational model distinguishing between and integrating evaluation and research functions, explicating personnel roles and responsibilities, and highlighting connections between research and evaluation work. Although the research and evaluation components operated on independent budgeting, staffing, and implementation activities, we were able to combine datasets across activities to allow us to assess the integrity of the program theory, not just the hypothesized connections within it. This model has since been used for proposal development and has been invaluable as it creates a research and evaluation plan that is seamless from the beginning.
KW - Logic models
KW - Organizational model
KW - Program evaluation
KW - Theory based evaluation
UR - http://www.scopus.com/inward/record.url?scp=84860861181&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84860861181&partnerID=8YFLogxK
U2 - 10.1016/j.evalprogplan.2012.04.003
DO - 10.1016/j.evalprogplan.2012.04.003
M3 - Article
C2 - 22580233
AN - SCOPUS:84860861181
SN - 0149-7189
VL - 35
SP - 508
EP - 516
JO - Evaluation and Program Planning
JF - Evaluation and Program Planning
IS - 4
ER -