AISD REACH Evaluation Objectives

Evaluation objectives will include the following:

• To collect and analyze data from all stakeholders, including program participants and program staff, to determine whether the program is accomplishing its objectives
• To provide ongoing formative feedback for program staff and stakeholders (e.g., the Strategic Compensation Steering Committee, AISD Board of Trustees, and the District Advisory Council)

Scope and Method

Data Collection

Perceptions of the impact of the program on staff and student performance will be collected from participants throughout the school year in the form of surveys and focus groups. District human resources data and student performance data will be used to evaluate the relationships among program elements and activities, educator recruitment and retention, and student performance.

Data Analyses

Data analysis procedures will include summaries of survey responses regarding topics including program knowledge and satisfaction, data use, PLCs, reflective practice, teacher self-efficacy, school climate, attachment to school and the profession, and job satisfaction. Focus group data will be examined for themes and summarized for formative evaluation purposes. Correlations, regressions, and other appropriate analyses will be performed to examine the possible relationships between and among factors (e.g., SLO quality, rigor, and achievement; student TAKS performance; number of years in program; novice teacher status; and teacher retention).

Time Line

• September 2011: Staff will publish results from the 2010–2011 employee surveys and focus groups.
• October 2011: Staff will publish results from the 2010–2011 TAKS analyses.
• November 2011: Staff will conduct focus groups with participants at new program schools.
• December 2011: Staff will publish a report with final results from 2010–2011, including school-wide growth, novice teacher mentoring, and teacher retention; cost-benefit analyses will be included, as available.
• January 2012: Staff will conduct principal focus groups and administer the annual Staff Climate Survey.
• February 2012: Staff will publish results from teacher and principal focus groups and prepare for the Spring Employee Coordinated Survey.
• March 2012: Staff will conduct the Employee Coordinated Survey, including targeted items for mentees and mentors, program staff, and all staff.
• April–May 2012: Staff will conduct focus groups with new program staff.
• June 2012: Staff will publish results from spring participant surveys.
• August 2012: Staff will publish the results from end-of-year focus groups.

Reporting

A series of evaluation reports will be published as data become available and will identify successes, challenges, and recommendations. Data will be submitted to TEA for the D.A.T.E. grant and the Beginning Teacher Induction grant, and to the USDE for the TIF grant.

Program Support

DRE staff will assist with the following additional activities:

• Sampling for SLO audits
• Ad hoc data requests pertaining to the formative evaluation and TAKS results