CAEP Accountability Measures – Advanced Programs

Measure 2: Satisfaction of employers and stakeholder involvement. (RA4.1)

Satisfaction of Employers

As part of ongoing program improvement efforts, the UConn Neag School of Education advanced programs collect feedback on employers’ satisfaction. The employer satisfaction survey for the Administrator Preparation program (UCAPP - 092 certification endorsement) and the Executive Leadership program (ELP - 093 certification endorsement) was distributed in summer 2023 to a sample of Connecticut superintendents and principals. The respondents were asked to rate UConn alumni administrators and leaders on their preparation for district and school leadership roles. The survey was distributed to 570 building and district administrators and 50 surveys were completed (response rate of 9%). Thirty-three respondents had not employed or supervised a UCAPP or ELP graduate in a leadership role within the last three years. Fifteen respondents provided feedback on recent UCAPP graduates (within last 3 years) and six respondents provided feedback on recent ELP graduates (within last three years). The survey was set up so that respondents remained anonymous.

ELP 2023 Employer Survey Results
One hundred percent of ELP employer respondents rated graduates as being prepared or very prepared for their job role and responsibilities. One hundred percent of ELP employer respondents stated that they were satisfied or very satisfied with how the graduates understand and apply knowledge and skills appropriate to their professional field of specialization so that learning and development opportunities for all P-12 are enhanced through the six CAEP RA1.1 core skill areas, the job performance of the ELP graduates they employ (CAEP RA4.1), and the ELP graduates' preparation to work with diverse P-12 students and their families (CAEP RA4.1). One hundred percent of ELP employer respondents stated that ELP graduates typically or consistently apply the knowledge, skills, and commitments documented within the NELP District Standards (1 - 7).

UCAPP 2023 Employer Survey Results
Ninety-two percent of UCAPP employer respondents rated graduates as being prepared or very prepared for their job role and responsibilities. Ninety-two percent of UCAPP employer respondents stated that they were satisfied or very satisfied with how the graduates understand and apply knowledge and skills appropriate to their professional field of specialization so that learning and development opportunities for all P-12 are enhanced through the CAEP RA1.1 core skills of 1 (data literacy), 2 (use of research), and 4 (leading and/or participating in collaborative activities). Eighty-five percent of UCAPP employer respondents stated that they were satisfied or very satisfied with how the graduates understand and apply knowledge and skills appropriate to their professional field of specialization so that learning and development opportunities for all P-12 are enhanced through the sixth CAEP RA1.1 core skill of ‘application of professional dispositions’ and seventy-seven percent of respondents were satisfied or very satisfied regarding the third and fifth CAEP RA1.1 core skills of ‘employment of data analysis’ and ‘supporting appropriate applications of technology’. Ninety-two percent of UCAPP employer respondents stated that they were satisfied or very satisfied with the job performance of the UCAPP graduates they employ (CAEP RA4.1) and one hundred percent of UCAPP respondents stated that they were satisfied or very satisfied with the UCAPP graduates' preparation to work with diverse P-12 students and their families (CAEP RA4.1). Ninety percent or more of UCAPP employer respondents stated that UCAPP graduates typically or consistently apply the knowledge, skills, and commitments documented within the NELP Building Standards (1 - 5). For NELP Building Standards 6 and 7, 80% or more of UCAPP employer respondents stated that UCAPP graduates typically or consistently apply the knowledge, skills, and commitments documented within the standards.

Summary
Results of the 2023 ELP and UCAPP employer survey provide evidence of employers’ satisfaction with completers’ preparation and their effectiveness. We will continue to monitor employer satisfaction in the advanced programs. The Reading and Language Arts/Literacy Specialist advanced program recently revised their employer satisfaction survey, and the survey will be distributed in 2024.

2023 ELP Employer Survey Results

Item Very Dissatisfied (1) Dissatisfied (2) Neither Satisfied nor Dissatisfied (3) Satisfied (4) Very Satisfied (5) Total Responses Mean
Please rate your satisfaction or dissatisfaction with how the ELP graduates understand and apply knowledge and skills appropriate to their professional field of specialization so that learning and development opportunities for all P-12 are enhanced through the following six core areas. (CAEP RA1.1)
  • Skill 1 - Applications of data literacy
0
0%
0
0%
0
0%
4
67%
2
33%
6 4.33
  • Skill 2 - Use of research and understanding of qualitative, quantitative and/or mixed methods research methodologies
0
0%
0
0%
0
0%
3
50%
3
50%
6 4.50
  • Skill 3 - Employment of data analysis and evidence to develop supportive, diverse, equitable, and inclusive school environments
0
0%
0
0%
0
0%
3
50%
3
50%
6 4.50
  • Skill 4 - Leading and/or participating in collaborative activities with others such as peers, colleagues, teachers, administrators, community organizations, and parents
0
0%
0
0%
0
0%
2
33%
4
67%
6 4.67
  • Skill 5 - Supporting appropriate applications of technology for their field of specialization
0
0%
0
0%
0
0%
2
33%
4
67%
6 4.67
  • Skill 6 - Application of professional dispositions, laws and policies, codes of ethics and professional standards appropriate to their field of specialization
0
0%
0
0%
0
0%
2
33%
4
67%
6 4.67
Please rate your satisfaction or dissatisfaction with the job performance of the ELP graduates you employ (CAEP RA4.1) 0
0%
0
0%
0
0%
2
33%
4
67%
6 4.67
Please rate your satisfaction or dissatisfaction with the ELP graduates' preparation to work with diverse P-12 students and their families (CAEP RA4.1) 0
0%
0
0%
0
0%
3
50%
3
50%
6 4.50
Total – All Items Combined 0
0%
0
0%
0
0%
21
44%
27
56%
48 4.56

 

Do the ELP graduates apply the knowledge, skills, and commitments necessary for the following areas: No, they consistently do not (1) No, they typically do not (2) Neither yes nor no (3) Yes, they typically do (4) Yes, they consistently do (5) Total Responses Mean
To collaboratively lead, design, and implement a district mission, vision, and process for continuous improvement that reflects a core set of values and priorities? (NELP District 1) 0
0%
0
0%
0
0%
2
33%
4
67%
6 4.67
To understand and demonstrate the capacity to advocate for ethical decisions and cultivate and enact professional norms? (NELP District 2) 0
0%
0
0%
0
0%
2
33%
4
67%
6 4.67
To develop and maintain a supportive, equitable, culturally responsive, and inclusive district culture? (NELP District 3) 0
0%
0
0%
0
0%
3
50%
3
50%
6 4.50
To evaluate, design, cultivate, and implement coherent systems of curriculum, instruction, data systems, supports, assessment, and instructional leadership? (NELP District 4) 0
0%
0
0%
0
0%
3
50%
3
50%
6 4.50
To understand and engage families, communities, and other constituents in the work of schools and the district and to advocate for district, student, and community needs? (NELP District 5) 0
0%
0
0%
0
0%
2
33%
4
67%
6 4.67
To develop, monitor, evaluate, and manage data-informed and equitable district systems for operations, resources, technology, and human capital management?? (NELP District 6) 0
0%
0
0%
0
0%
3
50%
3
50%
6 4.50
To cultivate relationships and lead collaborative decision making and governance? (NELP District 7) 0
0%
0
0%
0
0%
4
67%
2
33%
6 4.33
To represent and advocate for district needs in broader policy conversations? (NELP District 7) 0
0%
0
0%
0
0%
5
83%
1
17%
6 4.17
Total – All Items Combined 0
0%
0
0%
0
0%
24
50%
24
50%
48 4.50

2023 UCAPP Employer Survey Results

Item Very Dissatisfied (1) Dissatisfied (2) Neither Satisfied nor Dissatisfied (3) Satisfied (4) Very Satisfied (5) Total Responses Mean
Please rate your satisfaction or dissatisfaction with how the UCAPP graduates understand and apply knowledge and skills appropriate to their professional field of specialization so that learning and development opportunities for all P-12 are enhanced through the following six core areas. (CAEP RA1.1)
  • Skill 1 - Applications of data literacy
0
0%
0
0%
1
8%
6
46%
6
46%
13 4.38
  • Skill 2 - Use of research and understanding of qualitative, quantitative and/or mixed methods research methodologies
0
0%
1
8%
0
0%
8
62%
4
31%
13 4.15
  • Skill 3 - Employment of data analysis and evidence to develop supportive, diverse, equitable, and inclusive school environments
0
0%
0
0%
3
23%
6
46%
4
31%
13 4.08
  • Skill 4 - Leading and/or participating in collaborative activities with others such as peers, colleagues, teachers, administrators, community organizations, and parents
0
0%
0
0%
1
8%
6
46%
6
46%
13 4.38
  • Skill 5 - Supporting appropriate applications of technology for their field of specialization
0
0%
1
8%
2
15%
6
46%
4
31%
13 4.00
  • Skill 6 - Application of professional dispositions, laws and policies, codes of ethics and professional standards appropriate to their field of specialization
0
0%
1
8%
1
8%
5
39%
6
46%
13 4.23
Please rate your satisfaction or dissatisfaction with the job performance of the UCAPP graduates you employ (CAEP RA4.1) 0
0%
1
8%
0
0%
3
23%
9
69%
13 4.54
Please rate your satisfaction or dissatisfaction with the UCAPP graduates' preparation to work with diverse P-12 students and their families (CAEP RA4.1) 0
0%
0
0%
0
0%
6
46%
7
54%
13 4.54
Total – All Items Combined 0
0%
4
4%
8
8%
46
44%
46
44%
104 4.29

 

Do the UCAPP graduates apply the knowledge, skills, and commitments necessary for the following areas: No, they consistently do not (1) No, they typically do not (2) Neither yes nor no (3) Yes, they typically do (4) Yes, they consistently do (5) Total Responses Mean
To collaboratively lead, design, and implement a school mission, vision, and process for continuous improvement that reflects a core set of values and priorities? (NELP Building 1) 0
0%
1
10%
0
0%
5
50%
4
40%
10 4.20
To understand and demonstrate the capacity to advocate for ethical decisions and cultivate and enact professional norms? (NELP Building 2) 0
0%
0
0%
0
0%
2
20%
8
80%
10 4.80
To develop and maintain a supportive, equitable, culturally responsive, and inclusive school culture? (NELP Building 3) 0
0%
0
0%
0
0%
2
20%
8
80%
10 4.80
To evaluate, develop, and implement coherent systems of curriculum, instruction, data systems, supports, and assessment? (NELP Building 4) 0
0%
1
10%
0
0%
4
40%
5
50%
10 4.30
To engage families, community, and school personnel in order to strengthen student learning, support school improvement, and advocate for the needs of their school and community? (NELP Building 5) 0
0%
0
0%
0
0%
5
50%
5
50%
10 4.50
To improve management, communication, technology, school-level governance, and operation systems to develop and improve data-informed and equitable school resource plans and to apply laws, policies, and regulations? (NELP Building 6) 0
0%
0
0%
2
20%
5
50%
3
30%
10 4.10
To build the school’s professional capacity and engage staff in the development of a collaborative professional culture? (NELP Building 7) 0
0%
0
0%
0
0%
4
40%
6
60%
10 4.60
To improve systems of staff supervision, evaluation, support, and professional learning? (NELP Building 7) 0
0%
1
10%
1
10%
4
40%
4
40%
10 4.10
Total – All Items Combined 0
0%
3
4%
3
4%
31
39%
43
54%
80 4.43

Stakeholder Involvement
The Neag School of Education regularly involves internal and external stakeholders in program design, evaluation, and continuous improvement processes. Program faculty meet frequently throughout the academic year and each of the advanced programs also host advisory board meetings at least once a semester to review program data and discuss program design, evaluation, and improvement. The advisory board meetings provide stakeholders an opportunity to share the strengths of each program, offer input on program evaluations, and provide suggestions on ways to improve the program. Stakeholder feedback is also systematically sought at multiple points of each program. For example, students provide feedback on entrance and/or exit surveys, graduates provide feedback on completer/alumni surveys, employers provide feedback on employer surveys, and students receive feedback on their performance from faculty throughout the program. The Neag School of Education faculty review the feedback elicited from each of these methods and use it to develop and monitor continuous improvement processes for the educational programs.

Measure 3: Candidate competency at program completion. (RA3.4)

The tables below include pass rates for the Reading Specialist Tests (097 and 102), School Psychologist Praxis (5402), and Connecticut Administrator Test (6412) for those candidates in each graduation year attempting the exam. For student privacy, due to low numbers of candidates attempting the Reading Specialist exams per year, the pass rates for the 097 and 102 certifications have been combined and the pass rates for the last three academic years have been combined. For the same reason, the School Psychologist Praxis pass rates for the last three academic years have been combined.

The Reading Specialist, School Psychologist Praxis, and Connecticut Administrator Test candidate pass rates of 100% over the past three academic years demonstrate candidate competency at program completion.

Name of Exam Combined Pass Rates for AY 2020-2021, AY 2021-2022, and AY 2022-2023 Graduates Who Took Exam*
Reading and Language Arts Consultant (097) and Remedial Reading & Remedial Language Arts (102) Graduates – Reading Specialist Tests* 26/26
100%
School Psychology – Master’s / Sixth Year Program Graduates – School Psychologist Praxis (5402) 15/15
100%

Note: *For student privacy, due to low numbers of candidates attempting the Reading Specialist exams per year, the pass rates for the 097 and 102 certifications have been combined and the pass rates for the last three academic years have been combined. For the same reason, the School Psychologist Praxis pass rates for the last three academic years have been combined.

Name of Exam Pass Rate for AY 2020-2021 Graduates Who Took Exam Pass Rate for AY 2021-2022 Graduates Who Took Exam Pass Rate for AY 2022-2023 Graduates Who Took Exam
UCAPP Graduates – Connecticut Administrator Test (6412) 30/30
100%
32/32
100%
25/25
100%

Measure 4: The ability of completers to be hired in education positions for which they have prepared.

For all advanced programs for which we have data, graduates from the 2020-2021, 2021-2022, and 2022-2023 academic years report 100% employment in the fall immediately following graduation. The employment data provide evidence of completers’ ability to retain/obtain employment positions after completion of their program.

% Employed in fall after graduation 2020-2021 Graduates 2021-2022 Graduates 2022-2023 Graduates
Executive Leadership Program (ELP) 100% 100% 100%
Literacy Specialist Program 100% 100% 100%
School Psychology MA/SDPE Program 100%* No data available 100%*
UConn Administrator Preparation Program (UCAPP) 100% 100% 100%

Note: The numbers reflect all employment reported by graduates and not necessarily employment in a position that is based upon having attained an advanced certification. *These values were obtained from self-reported graduate survey responses. Survey responses varied per year, and all graduates did not respond to the surveys. In some years, very few graduates responded to the survey employment question. The percentages reported were obtained by comparing the number of graduates who self-reported employment each year by the number of graduates who responded to the survey each year.

Additional School Psychology Outcomes and Data

School Psychology Student Admissions, Outcomes, and Other Data