Ten Years of Youth Programs at The American Museum of Natural History: An Independent Perspective and Lessons Learned

Publication

In this report, Inverness Research summarizes their findings based on evaluating the American Museum of Natural History (AMNH)'s high school program over 10 years. The report includes: A discussion of the theory of action and the rationale that underlies the AMNH youth programs A description of three of the programs that have been offered and the evolution in program design that has taken place over the years A description of the core common features of the programs

Read More

ITEST Data Brief: Published Instruments Used by ITEST Projects to Measure Impact

Publication

ITEST LRC Data Brief Volume 1, Issue 2 This Data Brief explores findings reported in the 2011-2012 Management Information System (MIS). In this edition we focus on the topic of validated instruments, by analyzing information reported by the projects regarding their use of instruments to measure youth and teacher outcomes, their research questions and their evaluation questions. The MIS asked project Principal Investigators (PIs) whether or not they use externally developed and validated instruments to measure youth or teacher outcomes. For those projects using external instruments, the MIS

Read More

A Program Director's Guide to Evaluating STEM Education Programs: Lessons Learned from Local, State, and National Initiatives

Publication

In today's world of high accountability, strong evidence on intended outcomes is key to building credibility and replicability of science, technology, engineering and mathematics (STEM) programs. This primer, for program directors/managers, educators and others responsible for developing and implementing STEM programs: Provides evaluation guidelines and resources for program leaders who are implementing STEM programs in schools and community-based organizations. Reduces "evaluation anxiety" for individuals who are not professional evaluators by providing guidelines for good evaluation

Read More

How Can Multi-Site Evaluations Be Participatory?

Publication

Multi-site evaluations are becoming increasingly common in federal funding portfolios. Although much thought has been given to multi-site evaluation, there has been little emphasis on how it might interact with participatory evaluation. Therefore, this paper reviews several National Science Foundation educational, multi-site evaluations for the purpose of examining the extent to which these evaluations are participatory. Based on this examination, the paper proposes a model for implementing multi-site, participatory evaluation.

Read More

A Guide to Evaluation Primers

Publication

Produced by the Association for the Study and Development of Community (ASDC) for the Robert Wood Johnson Foundation, this document offers an orientation to handbooks and basic primers on evaluation. These resources are designed to meet the needs of the non-expert, explaining some of the central issues in evaluation and why they are important. The Guide itself helps organizations to assess which evaluation primer might be most useful for their needs and what to expect, in terms of information, from each.

Read More

Lessons Learned About Science and Participation from Multisite Evaluations

Publication

Publicly funded multisite evaluations should help bring safe, effective interventions to the mental health and substance abuse treatment fields. Two principles, science-based practice and stakeholder participation, drive multisite evaluations of behavioral interventions. We examine the roles of these principles in the five programs described in this volume and draw lessons for future studies.

Read More

OERL Evaluation Reports for ITEST Projects

Publication

OERL, the Online Evaluation Resource Library, was developed for professionals seeking to design, conduct, document, or review project evaluations. The purpose of this system is to collect and make available evaluation plans, instruments, and reports for NSF projects that can be used as examples by Principal Investigators, project evaluators, and others outside the NSF community as they design proposals and projects. OERL also includes professional development modules that can be used to better understand and utilize the materials made available. A collection of evaluation report resources for

Read More

Gender Indicators in Science, Engineering and Technology

Instruments

This Toolkit for Gender Indicators in Engineering, Science and Technology, designed for guidance in collecting sex-disaggregated data in scientific and technological activities, aims at helping decision-makers, researchers, and practitioners understand gender issues better and formulate successful policy and programming. It intends to promote a common approach in the systematic collection of sex-disaggregated data in science and technology. In addition to guidance in collecting data, each Toolkit provides an overview of the participation of women in STEM fields, both in industrialized and

Read More

Science Teaching Efficacy Belief Instrument (STEBI)

Instruments

The Science Teaching Efficacy Belief Instrument (STEBI) is used in many studies to measure science teaching self-efficacy and outcome expectancy in preservice elementary teachers. This 25-item instrument uses a 5-point Likert scale. The STEBI-A is the version recommended for use with in-service teachers; the STEBI-B is the version recommended for use with pre-service teachers. Attached and linked are both versions of the STEBI as well as its documentation. Authors provide instrument validity and/or reliability information.

Read More