ITEST Resources

ITEST LRC Data Brief Volume 1, Issue 2 This Data Brief explores findings reported in the 2011-2012 Management Information System (MIS). In this edition we focus on the topic of validated instruments, by analyzing information reported by the projects regarding their use of instruments to measure youth and teacher outcomes, their research questions and their evaluation questions. The MIS asked project Principal Investigators (PIs) whether or not they use externally developed and validated instruments to measure youth or teacher outcomes. For those projects using external instruments, the MIS

In today's world of high accountability, strong evidence on intended outcomes is key to building credibility and replicability of science, technology, engineering and mathematics (STEM) programs. This primer, for program directors/managers, educators and others responsible for developing and implementing STEM programs: Provides evaluation guidelines and resources for program leaders who are implementing STEM programs in schools and community-based organizations. Reduces "evaluation anxiety" for individuals who are not professional evaluators by providing guidelines for good evaluation

Multi-site evaluations are becoming increasingly common in federal funding portfolios. Although much thought has been given to multi-site evaluation, there has been little emphasis on how it might interact with participatory evaluation. Therefore, this paper reviews several National Science Foundation educational, multi-site evaluations for the purpose of examining the extent to which these evaluations are participatory. Based on this examination, the paper proposes a model for implementing multi-site, participatory evaluation.

Produced by the Association for the Study and Development of Community (ASDC) for the Robert Wood Johnson Foundation, this document offers an orientation to handbooks and basic primers on evaluation. These resources are designed to meet the needs of the non-expert, explaining some of the central issues in evaluation and why they are important. The Guide itself helps organizations to assess which evaluation primer might be most useful for their needs and what to expect, in terms of information, from each.

Multisite evaluations are increasingly being used by the federal government and large foundations. A framework for understanding the variations among multisite evaluations and developing ways to improve them is presented in this chapter.

Publicly funded multisite evaluations should help bring safe, effective interventions to the mental health and substance abuse treatment fields. Two principles, science-based practice and stakeholder participation, drive multisite evaluations of behavioral interventions. We examine the roles of these principles in the five programs described in this volume and draw lessons for future studies.

OERL, the Online Evaluation Resource Library, was developed for professionals seeking to design, conduct, document, or review project evaluations. The purpose of this system is to collect and make available evaluation plans, instruments, and reports for NSF projects that can be used as examples by Principal Investigators, project evaluators, and others outside the NSF community as they design proposals and projects. OERL also includes professional development modules that can be used to better understand and utilize the materials made available. A collection of evaluation report resources for