The Education Connection Project

Project Administation & Partnership

Evaluation

Approach: Evaluation, on a small scale, is a relatively expensive activity. But once the project is built on a larger scale and the initial project evaluation design is complete, the evaluation costs should become more affordable. Curently, the approach is to focus on the content componet of the project. The content evaluation is focused primarily on how the middle school students are doing on customized pre and post assessment tests given to participants and a control group.

Partners: WHYY, Public Allies

Evaluation: The evaluation of the Delaware site will continue to examine both the process of implementing the project and the outcomes during the 1999-2000 school year. For implementation, the evaluation will monitor the distribution of computers, software, and on-line accounts to the participating families, the maintenance of technical support, provision of ongoing education in technology use, development of quality mathematics and science curricular materials, and integration of technology at home and in school in mathematics and science lessons.

For outcomes, the evaluation is looking for:

  • changes in participating students' knowledge and performance in mathematics and science, using the current local assessment systems of the participating schools. Student use of computers in class and work products such as Web pages will be electronically monitored.
  • changes in knowledge and skill of participating teachers using technology to enhance mathematics and science instruction and their own professional development. Observations will be made of a sample of mathematics and/or science lessons using the computer. Teachers will be interviewed at the end of each school year.
  • changes in knowledge and skills of students using computers at home to enhance math and science learning. Evaluation will monitor the frequency and depth of computer use, interview students, and look at student work products. Pre and post-surveys on technology skill and use will be administered.
  • changes in the involvement of parents in their students' education. Changes in attitude and skill of family members in computer literacy. Pre and post-surveys on technology skill and use will be administered to parents. Follow-up phone interviews will be conducted with a sample of participating families.

In addition to the local evaluation, all Education Connection Projects partake in a national evaluation. Instruments were designed to collect data for the national evaluation. The collection of student achievement data is part of the national evaluation.

The primary task of evaluation during the second year of implementation will be to monitor the timely completion of project tasks and to collect impact data at the close of the school year.

Education Connection Project Process and Outcomes and Impacts

Evaluation Framework

Project Inputs

Interim Outcomes

Project Impacts

Technology infrastructure

Computers in home and in the school

Utilization of technology

Demonstrated student achievement/performance in math and science through surveys and sample work

Technical Support

Technical training

Improved technical skills of students, teachers, possibly parents, and other family members

Demonstrated student achievement/ performance in math and science through surveys and sample work

Curriculum Development

Implementation of modules in classroom

Demonstrated student achievement/ performance in math and science through surveys and sample work

Professional Development for teachers and possibly parents-teacher interaction.

Improved relationships/ communication between home and school. Improved teaching and learning in the classroom.

Demonstrated student achievement/ performance in math and science through surveys and sample work

The Delaware Project Director has assembled a team that includes technical support, educational support, community outreach support, and evaluation. Because evaluation is considered part of the team, the evaluator is in the unique position to provide immediate feedback that the team will be able to use.
The report will be completed by October 1st, 2000.

ChartObject Evaluation (Cost per computer)

Timeline

Project Administration - Evaluation

Before June

Select Evaluator

July/August

Finalize evaluation design

August

Go over with teachers final evaluation design

September

Pre-Test of students and control group

Feb/Mar

Mid-year post test of students and control group

June

Final post-test of students and control group along with student, parent and teacher interviews.



Page last updated on 08/13/00

Send comments to the Education Connection Project Director, Jay Cohen

Table of Contents

Title Page

About the project

Low-Cost Home Technology

Workforce Dev. Technology Support

Standards-Based Content

Administration & Partnership
   Coordination & Dissemination
   Evaluation



Project Links
   Calendar (in development)
   Tech-Support (in development)
   National Project
   Project Materials (in development)
   Student Pages (in development)