A School Connectedness Scale for Use with Adolescents

Instruments

Evaluators are frequently asked to assess the effectiveness of school programs implemented to improve academic achievement. School connectedness has been shown to be directly related to academic achievement and is therefore of interest to evaluators. The construct of school connectedness has been shown to consist of 3 elements: connectedness to adults in schools, connectedness to peers, and connectedness to the school. This paper reports the psychometric properties and factor analyses findings from a School Connectedness Scale (SCS) given to adolescents in 2 very different high schools in the

Read More

What Makes for Powerful Classrooms, and How Can We Support Teachers in Creating Them? A Story of Research and Practice, Productively Intertwined

Publication

This article and my career as an educational researcher are grounded in two fundamental assumptions: (a) that research and practice can and should live in productive synergy, with each enhancing the other, and (b) that research focused on teaching and learning in a particular discipline can, if carefully framed, yield insights that have implications across a broad spectrum of disciplines. This article begins by describing in brief two bodies of work that exemplify these two fundamental assumptions. I then elaborate on a third example, the development of a new set of tools for understanding and

Read More

Utilizing Collaboration Theory to Evaluate Strategic Alliances

Instruments

Increasingly, collaboration between business, non-profit, health and educational agencies is being championed as a powerful strategy to achieve a vision otherwise not possible when independent entities work alone. But the definition of collaboration is elusive and it is often difficult for organizations to put collaboration into practice and assess it with certainty. Program evaluators can assist practitioners concerned with the development of a strategic alliance predicated on collaboration by understanding and utilizing principles of collaboration theory. The Strategic Alliance Formative

Read More

2018 STELAR ITEST Principal Investigator and Evaluator Summit

Event

On behalf of the National Science Foundation, STELAR hosted more than 90 ITEST projects at the 2018 Summit.

2018 STELAR ITEST Principal Investigator and Evaluator Summit
Equity and Access at the Human-Technology Frontier

Monday, May 14 - Tuesday, May 15, 2018
(Legislative visits to be held Wednesday, May 16)
The Westin Alexandria, 400 Courthouse Square, Alexandria VA 22314

Read More

Teaching Strategies that Promote Science Career Awareness

Publication

This monograph shares results of our inquiry into pedagogical strategies that infuse career awareness into science lessons. We first identify four cognitive building blocks of career development and four promising approaches for raising awareness of science careers. We then provide a typology of ten replicable teacher practice strategies, with accompanying examples of each. These findings are part of a larger exploration into the potential for secondary science teachers to increase student awareness of, and interest in, science careers, and are intended to contribute to field-building efforts

Read More

How Do Propensity Score Methods Measure Up in the Presence of Measurement Error? A Monte Carlo Study

Publication

Considering that the absence of measurement error in research is a rare phenomenon and its effects can be dramatic, we examine the impact of measurement error on propensity score (PS) analysis used to minimize selection bias in behavioral and social observational studies. A Monte Carlo study was conducted to explore the effects of measurement error on the treatment effect and balance estimates in PS analysis across seven different PS conditioning methods. In general, the results indicate that even low levels of measurement error in the covariates lead to substantial bias in estimates of

Read More

Innovations and Challenges in Project-Based STEM Education: Lessons from ITEST

Publication

For over a decade, the National Science Foundation’s Innovative Technology Experiences for Students and Teachers (ITEST) program has funded researchers and educators to build an understanding of best practices, contexts, and processes contributing to K-12 students’ motivation and participation in Science, Technology, Engineering, and Mathematics (STEM) activities that lead to STEM career pathways. The outcomes from these projects have contributed significantly to the national body of knowledge about strategies, successes, models, and interventions that support and encourage youth to pursue

Read More

Framework for Evaluating Impacts of Broadening Participation Projects: Report from a National Science Foundation Workshop

Publication
Image
Cover of Report

Background This report grew out of a workshop and follow-up session sponsored by the National Science Foundation (NSF), Directorate for Education and Human Resources (EHR). The two-day workshop and subsequent meeting sought to develop and validate evaluation practices to assess the value of NSF’s investment in broadening participation across all directorates and programs. Invited participants included NSF grantees, professional evaluators, and the policy community (which included representatives from Congress, the Office of Management and Budget (OMB), NSF staff, and staff from other federal

Read More

ITEST Data Brief: Research Methods in ITEST

Publication
Image
Image of ITEST Data Brief: Research Methods in ITEST

ITEST Data Brief Volume 3, Issue 3, September 2016 The ITEST program requires that all proposals include a research component. This data brief examines the 63 projects that described their research between September 1, 2014 and August 31, 2015 as reported in the 2015 Management Information System (MIS) survey. Questions addressed include: - What kinds of study designs do projects use? - Which tools do projects use to measure outcomes? - What kinds of instruments do projects use to measure outcomes? - What data do projects intend to collect from participants after funding is over? - How do

Read More

Principal Investigator’s Guide: Managing Evaluation in Informal STEM Education Projects

Publication

An initiative of the Visitor Studies Association, produced in partnership with the Center for Advancement of Informal Science Education (CAISE). This Guide is designed to help principal investigators and other leaders of informal STEM (Science, Technology, Engineering, and Math) education projects integrate evaluation into all phases of project design, development, and implementation. Such projects include exhibits, media projects, websites, community science projects, afterschool programs, festivals, family activities, online games, citizen science projects, and other efforts to help people

Read More