CAEP Accountability Measures – Advanced Programs

Measure 2: Satisfaction of employers and stakeholder involvement. (RA4.1)

Satisfaction of Employers
As part of ongoing program improvement efforts, the UConn Neag School of Education advanced programs collect feedback on employers’ satisfaction. The employer satisfaction survey for the Administrator Preparation program (UCAPP – 092 certification endorsement) and the Executive Leadership program (ELP – 093 certification endorsement) was distributed in summer 2023 to a sample of Connecticut superintendents and principals. The respondents were asked to rate UConn alumni administrators and leaders on their preparation for district and school leadership roles. The survey was distributed to 570 building and district administrators and 50 surveys were completed (response rate of 9%). Thirty-three respondents had not employed or supervised a UCAPP or ELP graduate in a leadership role within the last three years. Fifteen respondents provided feedback on recent UCAPP graduates (within last 3 years) and six respondents provided feedback on recent ELP graduates (within last three years). The survey was set up so that respondents remained anonymous.

ELP 2023 Employer Survey Results
One hundred percent of ELP employer respondents rated graduates as being prepared or very prepared for their job role and responsibilities. One hundred percent of ELP employer respondents stated that they were satisfied or very satisfied with how the graduates understand and apply knowledge and skills appropriate to their professional field of specialization so that learning and development opportunities for all P-12 are enhanced through the six CAEP RA1.1 core skill areas, the job performance of the ELP graduates they employ (CAEP RA4.1), and the ELP graduates’ preparation to work with diverse P-12 students and their families (CAEP RA4.1). One hundred percent of ELP employer respondents stated that ELP graduates typically or consistently apply the knowledge, skills, and commitments documented within the NELP District Standards (1 – 7).

UCAPP 2023 Employer Survey Results
Ninety-two percent of UCAPP employer respondents rated graduates as being prepared or very prepared for their job role and responsibilities. Ninety-two percent of UCAPP employer respondents stated that they were satisfied or very satisfied with how the graduates understand and apply knowledge and skills appropriate to their professional field of specialization so that learning and development opportunities for all P-12 are enhanced through the CAEP RA1.1 core skills of 1 (data literacy), 2 (use of research), and 4 (leading and/or participating in collaborative activities). Eighty-five percent of UCAPP employer respondents stated that they were satisfied or very satisfied with how the graduates understand and apply knowledge and skills appropriate to their professional field of specialization so that learning and development opportunities for all P-12 are enhanced through the sixth CAEP RA1.1 core skill of ‘application of professional dispositions’ and seventy-seven percent of respondents were satisfied or very satisfied regarding the third and fifth CAEP RA1.1 core skills of ‘employment of data analysis’ and ‘supporting appropriate applications of technology’. Ninety-two percent of UCAPP employer respondents stated that they were satisfied or very satisfied with the job performance of the UCAPP graduates they employ (CAEP RA4.1) and one hundred percent of UCAPP respondents stated that they were satisfied or very satisfied with the UCAPP graduates’ preparation to work with diverse P-12 students and their families (CAEP RA4.1). Ninety percent or more of UCAPP employer respondents stated that UCAPP graduates typically or consistently apply the knowledge, skills, and commitments documented within the NELP Building Standards (1 – 5). For NELP Building Standards 6 and 7, 80% or more of UCAPP employer respondents stated that UCAPP graduates typically or consistently apply the knowledge, skills, and commitments documented within the standards.

Summary
Results of the 2023 ELP and UCAPP employer survey provide evidence of employers’ satisfaction with completers’ preparation and their effectiveness. We will continue to monitor employer satisfaction in the advanced programs. The Reading and Language Arts/Literacy Specialist advanced program recently revised their employer satisfaction survey, and the survey will be distributed in 2024.

Stakeholder Involvement
The Neag School of Education regularly involves internal and external stakeholders in program design, evaluation, and continuous improvement processes. Program faculty meet frequently throughout the academic year and each of the advanced programs also host advisory board meetings at least once a semester to review program data and discuss program design, evaluation, and improvement. The advisory board meetings provide stakeholders an opportunity to share the strengths of each program, offer input on program evaluations, and provide suggestions on ways to improve the program. Stakeholder feedback is also systematically sought at multiple points of each program. For example, students provide feedback on entrance and/or exit surveys, graduates provide feedback on completer/alumni surveys, employers provide feedback on employer surveys, and students receive feedback on their performance from faculty throughout the program. The Neag School of Education faculty review the feedback elicited from each of these methods and use it to develop and monitor continuous improvement processes for the educational programs.

Measure 3: Candidate competency at program completion. (RA3.4)

The tables below include pass rates for the Reading Specialist Tests (097 and 102), School Psychologist Praxis (5402), and Connecticut Administrator Test (6412) for those candidates in each graduation year attempting the exam. For student privacy, due to low numbers of candidates attempting the Reading Specialist exams per year, the pass rates for the 097 and 102 certifications have been combined and the pass rates for the last three academic years have been combined. For the same reason, the School Psychologist Praxis pass rates for the last three academic years have been combined.

The Reading Specialist, School Psychologist Praxis, and Connecticut Administrator Test candidate pass rates of 100% over the past three academic years demonstrate candidate competency at program completion.

Name of Exam Combined Pass Rates for AY 2020-2021, AY 2021-2022, and AY 2022-2023 Graduates Who Took Exam*
Reading and Language Arts Consultant (097) and Remedial Reading & Remedial Language Arts (102) Graduates – Reading Specialist Tests* 26/26
100%
School Psychology – Master’s / Sixth Year Program Graduates – School Psychologist Praxis (5402) 15/15
100%

Note: *For student privacy, due to low numbers of candidates attempting the Reading Specialist exams per year, the pass rates for the 097 and 102 certifications have been combined and the pass rates for the last three academic years have been combined. For the same reason, the School Psychologist Praxis pass rates for the last three academic years have been combined.

Name of Exam Pass Rate for AY 2020-2021 Graduates Who Took Exam Pass Rate for AY 2021-2022 Graduates Who Took Exam Pass Rate for AY 2022-2023 Graduates Who Took Exam
UCAPP Graduates – Connecticut Administrator Test (6412) 30/30
100%
32/32
100%
25/25
100%

Measure 4: The ability of completers to be hired in education positions for which they have prepared.

For all advanced programs for which we have data, graduates from the 2020-2021, 2021-2022, and 2022-2023 academic years report 100% employment in the fall immediately following graduation. The employment data provide evidence of completers’ ability to retain/obtain employment positions after completion of their program.

% Employed in fall after graduation 2020-2021 Graduates 2021-2022 Graduates 2022-2023 Graduates
Executive Leadership Program (ELP) 100% 100% 100%
Literacy Specialist Program 100% 100% 100%
School Psychology MA/SDPE Program 100%* No data available 100%*
UConn Administrator Preparation Program (UCAPP) 100% 100% 100%

Note: The numbers reflect all employment reported by graduates and not necessarily employment in a position that is based upon having attained an advanced certification. *These values were obtained from self-reported graduate survey responses. Survey responses varied per year, and all graduates did not respond to the surveys. In some years, very few graduates responded to the survey employment question. The percentages reported were obtained by comparing the number of graduates who self-reported employment each year by the number of graduates who responded to the survey each year.

Additional School Psychology Outcomes and Data

School Psychology Student Admissions, Outcomes, and Other Data