Evaluation

Scaling professional development: Integrity of implementation as a measurement approach.

Lori Ann Rubino-Hare — Thu, 21 Dec 2023 17:55:13 +0000

Scaling professional development: Integrity of implementation as a measurement approach.

Lori Ann Rubino-Hare Thu, 12/21/2023 - 12:55

Scaling professional development: Integrity of implementation as a measurement approach.

Description

Professional learning about an innovative teaching method is a demonstrated way to improve teacher practices, and ultimately impact student learning. One way to scale up professional learning is a facilitator development model, in which professional learning and development (PLD) designers prepare facilitators to understand the innovation and they in turn, teach teachers. To understand the effectiveness of this model, identifying how facilitators implement the model with teachers is critical. As such, the Power of Data (POD) team scaled-up effective PLD by providing Facilitation Academies to teach others to facilitate POD Teacher Workshops (TWs). The expectation was that changes based on local contexts would occur; thus, we focused on Integrity of Implementation (IOI) rather than fidelity of implementation. A measurement approach for IOI was created to understand how facilitators (n=13) delivered TWs and how they retained or modified the program principles. Examples from this project illustrate how a robust IOI measurement approach based on a variety of data sources can inform the design of PLD experiences, enable understanding of teacher PLD experiences, and allow researchers to determine whether the scaled-up model is effective

Resources submitted by ITEST projects may be hosted on third-party sites or require a fee or membership for access. Permission to use these materials must be obtained from the publisher or the author listed on each resource.

PUBLICATION DETAILS

Type

Article

Author

Brooke A. Whitworth

Lori A. Rubino-Hare

Nena E. Bloom

Publication Website URL

https://tigerprints.clemson.edu/teach_learn_pub/43/

Topic(s)

Evaluation

Teacher Professional Development and Pedagogy

Publication Year

2022

Discipline(s)

Interdisciplinary

STELAR Research & Evaluation Webinar: How and When to Engage an Evaluator & Role of the Evaluator on NSF ITEST Grants

Sarah MacGillivray — Fri, 20 May 2022 21:12:08 +0000

STELAR Research & Evaluation Webinar: How and When to Engage an Evaluator & Role of the Evaluator on NSF ITEST Grants

Sarah MacGillivray Fri, 05/20/2022 - 17:12

STELAR Research & Evaluation Webinar: How and When to Engage an Evaluator & Role of the Evaluator on NSF ITEST Grants

Description

On Thursday, April 15, 2021 STELAR hosted the third webinar in our Proposal Development Course series on Research & Evaluation. The webinar presented information about options for research and evaluation designs, and how evaluation provides ongoing feedback on your work as well as on the overall success of the project.

In this selection, Dr. Melissa K. Demetrikopoulos of the Program development and Evaluation Institute for Biomedical Policy shares her presentation "How and When to Engage an Evaluator" followed by Dr. Karen Gareis of Goodman Research Group on "Role of the Evaluator on NSF ITEST Grants."

Click the fullscreen icon in the video for better viewing Expand

All resources

Topic(s)

Evaluation

SciGirls Strategies Implementation Evaluation Report

Rita Karl — Fri, 05 Jun 2020 16:11:16 +0000

SciGirls Strategies Implementation Evaluation Report

Rita Karl Fri, 06/05/2020 - 12:11

SciGirls Strategies Implementation Evaluation Report

Description

For the SciGirls Strategies supplemental activity, ten educators were trained to be SciGirls Strategies trainers during June 2019 (see the Training Evaluation Report). During that time, they developedaction plans for their local teacher training. The goal was for each Trainer to train ten or moreteachers in their local schools/districts. Trainers could plan and schedule their workshops to fittheir local context in order to accomplish the objectives of building teacher’s confidence andskills in using gender equitable and culturally responsive teaching strategies. After the trainingworkshop, the trainers met once a month virtually and had continual access to the facilitators oftheir training (University of Minnesota professor Dr. Barbara Billington and St. Kate professor,Dr. Siri Anderson, the project’s Co-PI Dr. Brenda Britsch and two TPT staff members, LeahDefenbaugh and Alex Dexheimer).This report characterizes the implementation of the local training using data from trainerinterviews, trainer surveys, and teacher surveys. The data were analyzed to draw conclusionsabout the critical factors in the preparation and implementation of the Train the Trainer (TTT)model and its success with participating teachers.

PUBLICATION DETAILS

Type

Report

Author

Hilarie Davis

Bradford Davey

Publisher

Technology for Learning LLC

Publication Website URL

http://www.scigirlsconnect.org/evaluations/

Topic(s)

Evaluation

Sustainability and Scale-Up

Teacher Professional Development and Pedagogy

File Attachment(s)

SciGIrls Strategies Implementation Evaluation Report May 2020.pdf

Publication Year

2020

Discipline(s)

Chemistry

Computer and informational technology science

Engineering

Environmental sciences

Life sciences

Mathematical sciences

Physics and astronomy

SciGirls Strategies Training Evaluation Report

Rita Karl — Fri, 05 Jun 2020 16:07:44 +0000

SciGirls Strategies Training Evaluation Report

Rita Karl Fri, 06/05/2020 - 12:07

SciGirls Strategies Training Evaluation Report

Description

For the SciGirls Strategies supplemental activity, ten educators were trained to be SciGirls Strategies

Trainers in June 2019. SciGirls Strategies Trainers participated in a four-day (36 hour) in person training Tuesday through Friday, June 25-28, 2019 at Twin Cities PBS in St. Paul. The Gender Equitable Teaching and Advising Strategies (GETAS) training workshop included information on the newly updated (in 2019) SciGirls Strategies: How to Engage Girls in STEM which includes gender equitable and culturally responsive teaching strategies to advise, encourage, recruit and retain girls into CTE-STEM pathways along with adult learning practices and strategies for leading professional development. During the workshop, educators began to develop plans for their localized professional development for STEM and CTE educators. The goal of the Train-the-Trainer program was for each Trainer to train 10 teachers in their school and/or school district in Minnesota and Western Wisconsin. Trainers could plan and schedule the implementation of the course to fit their school/district’s needs in order to accomplish the primary course objectives of building high school teacher’s confidence and skills in using gender equitable and culturally responsive teaching strategies. This evaluation report evaluates the Train-the-Trainer (TTT) 2019 June workshop using data from daily surveys and questions asked of Trainers in May 2020 reflecting on their training.

PUBLICATION DETAILS

Type

Report

Author

Hilarie Davis

Bradford Davey

Publisher

Technology for Learning LLC

Publication Website URL

http://www.scigirlsconnect.org/evaluations/

Topic(s)

Evaluation

Sustainability and Scale-Up

Teacher Professional Development and Pedagogy

File Attachment(s)

SciGirls Strategies Training Evaluation Report May 2020.pdf

Publication Year

2020

Discipline(s)

Chemistry

Computer and informational technology science

Engineering

Mathematical sciences

Physics and astronomy

SciGirls Strategies - Year Three Evaluation Reports

Rita Karl — Thu, 03 Jan 2019 16:20:55 +0000

SciGirls Strategies - Year Three Evaluation Reports

Rita Karl Thu, 01/03/2019 - 11:20

SciGirls Strategies - Year Three Evaluation Reports

Description

SciGirls Strategies year three evaluation and case studies reports on each participating educator.

PUBLICATION DETAILS

Type

Report

Author

Hilarie Davis

Publisher

Technology for Learning LLC

Publication Website URL

http://www.scigirlsconnect.org/evaluations/

Topic(s)

Evaluation

Teacher Professional Development and Pedagogy

Youth Motivation and Interests in STEM

File Attachment(s)

Y3 SciGirls Eval 5.21.18.pdf

Y3 Educator Case Studies 5.21.18.pdf

Publication Year

2018

2019 NSF ITEST Principal Investigator and Evaluator Summit

Anonymous — Mon, 12 Nov 2018 17:11:14 +0000

2019 NSF ITEST Principal Investigator and Evaluator Summit

Anonymous (not verified) Mon, 11/12/2018 - 12:11

2019 NSF ITEST Principal Investigator and Evaluator Summit

Thursday, Jun 13, 2019

DESCRIPTION

2019 NSF ITEST Principal Investigator & Evaluator Summit:

Living, Learning and Working in the Digital Age

Thursday, June 13 and Friday, June 14

Optional Legislative visits to be held June 12

Westin Alexandria, 400 Courthouse Square, Alexandria, VA.

Invitations to register for the Summit were sent on April 11th to all active ITEST PIs, co-PIs, and Evaluators. If you did not receive this email please contact STELAR at stelar@edc.org.

Join your colleagues for two days of programming designed to encourage collaboration, learning, and discussion. During the summit, active ITEST projects will share their successes, challenges, and lessons learned from the ITEST program, and discuss implications for a national community of stakeholders. Programming for the Summit will include informative sessions for projects at any phase - newly funded projects are highly encouraged to attend!

Every project active in 2019 will receive two seats at the Summit; projects decide who will represent them at this year’s summit, however projects typically send their PI or Co-PI and their evaluator.

Upon completion of the registration form you will receive an email with additional information, including the link to reserve your hotel room at the conference rate. Please note that this rate will be available on a first come, first serve basis until the room block fills, and will not be available after May 10.

Present at this year's Summit!
Presentation proposals accepted February 25, 2019 - March 31, 2019 - THANK YOU FOR YOUR SUBMISSIONS

First time attending the Summit? Review last year's event: http://stelar.edc.org/events/2018-stelar-itest-principal-investigator-a…

Our event hashtags (#ITEST2019 #STELAR2019)

Visit the 2019 Summit Online Program

Questions? Email stelar@edc.org.

ALL EVENTS

EVENT DETAILS

Start date

Thursday, 13 June, 2019 07:00 AM

End date

Friday, 14 June, 2019 05:00 PM

Timezone

Link

Online Program

Registration Open Date

Wednesday, Apr 10, 2019

Registration Close Date

Friday, May 10, 2019

Topic(s)

Evaluation

Address

400 Courthouse Square, Alexandria, VA.

Additional Link(s)

2018 Summit

Location

Westin Alexandria

Massachusetts K–12 Computer Science Curriculum Guide

Anonymous — Wed, 25 Jul 2018 19:28:53 +0000

Massachusetts K–12 Computer Science Curriculum Guide

Anonymous (not verified) Wed, 07/25/2018 - 15:28

Massachusetts K–12 Computer Science Curriculum Guide

Description

This guide helps school districts choose the computer science (CS) curricula that best suit their communities’ needs. The guide was developed as part of an initiative for school districts to accelerate the creation of classroom opportunities for learning CS that are standards based, high quality, career relevant, and accessible to all students at all grade levels.

Project Curricula Details

Topic(s)

Accessibility

Evaluation

STEM Content and Standards

Teacher Professional Development and Pedagogy

File Attachment(s)

Massachusetts K-12 Computer Science Curriculum Guide.pdf

Target Setting(s)

Elementary school (K-5)

Middle school (6-8)

High school (9-12)

Post-secondary

Additional Disciplines

Computer Science - general

Computer Science - computer hardware

Computer Science - gaming and simulations

Computer Science - general skills and mathematics

Computer Science - multimedia - audio, video and animation

Computer Science - programming

Computer Science - web development

CPS/CWIC Employability Assessment

Anonymous — Thu, 12 Jul 2018 12:28:26 +0000

CPS/CWIC Employability Assessment

Anonymous (not verified) Thu, 07/12/2018 - 08:28

CPS/CWIC Employability Assessment

Description

The CPS/ CWIC Employability Assessment (EA) is conducted twice a year in year in the first and third quarters. EA is an observed assessment of 16 core 21st century college and career skills. Employability Assessments measure behavioral skills required for college and career success. This CPS custom tool was created by the Chicago Workforce Investment Council after extensively researching industry, education and academic reports on career readiness. Assessment tool includes Online Assessment Scoring and Rubric.

INSTRUMENT DETAILS

Topic(s)

Evaluation

STEM Career Opportunities and Workforce Development

Author

Chicago Public School

File Attachment(s)

Instrument with documentation

Target Gradespan(s)

Elementary school (K-5)

Middle school (6-8)

High school (9-12)

Additional Disciplines

Bioscience - general

Computer Science - general

Engineering - general

Environmental Science - general

Mathematics - general

National Science Foundation - Instructional Materials Development Program

Anonymous — Thu, 12 Jul 2018 12:20:08 +0000

National Science Foundation - Instructional Materials Development Program

Anonymous (not verified) Thu, 07/12/2018 - 08:20

National Science Foundation - Instructional Materials Development Program

Description

This document presents the final report on the evaluation of the Instructional Materials Development (IMD) program of the National Science Foundation (NSF) and focuses on issues related to the development, dissemination, adoption, implementation, and impact of new instructional materials. The IMD program evaluates products at each step, from product development to classroom use. Instruments are included for evaluating elementary and secondary school science and mathematics materials for classroom use.

INSTRUMENT DETAILS

Topic(s)

Evaluation

Informal Learning and Afterschool

STEM Content and Standards

Teacher Professional Development and Pedagogy

Author

National Science Foundation

File Attachment(s)

Instrument with Documentation

Target Gradespan(s)

Elementary school (K-5)

Middle school (6-8)

High school (9-12)

Additional Disciplines

Bioscience - general

Bioscience - bioinformatics

Bioscience - biomedicine

Bioscience - biotechnology

Bioscience - DNA analysis/sequencing

Bioscience - neuroscience

Computer Science - general

Environmental Science - general

Environmental Science - climate modeling

Environmental Science - ecological research and analysis

Environmental Science - GIS/GPS

Environmental Science - remote sensing technology

Mathematics - general

The Impact of Environmental Education on Sense of Place Among Urban Youth

Anonymous — Wed, 11 Jul 2018 17:22:32 +0000

The Impact of Environmental Education on Sense of Place Among Urban Youth

Anonymous (not verified) Wed, 07/11/2018 - 13:22

The Impact of Environmental Education on Sense of Place Among Urban Youth

Description

Research suggests that an ecologically informed sense of place, including strong place attachment and ecological place meaning, contributes to pro-environmental behaviors. Yet it is unclear whether an intervention such as environmental education can intentionally influence sense of place, especially in cities. To investigate the impact of urban environmental education programs on sense of place, we used pre/post surveys of youth in 5-week environmental and non-environmental summer youth programs in the Bronx, New York City, in 2010. Results show that urban environmental education programs—which engaged urban high school students in environmental stewardship, recreation, environmental skills development, and environmental monitoring in the Bronx—were successful in nurturing ecological place meaning, but did not strengthen students’ place attachment. No significant changes in place attachment or place meaning were observed after non-environmental, control programs.

PUBLICATION DETAILS

Type

Article

Author

A. Kudryavtsev

Marianne E. Krasny

Richard C. Stedman

Publisher

www.esajournals.org

Topic(s)

Evaluation

Sustainability and Scale-Up

Youth Motivation and Interests in STEM

File Attachment(s)

Kudryavtsev et al (2012).pdf

Publication Year

2012

Additional Disciplines

Environmental Science - general

Environmental Science - climate modeling

Environmental Science - ecological research and analysis

Environmental Science - GIS/GPS

Environmental Science - remote sensing technology