Measure 2: Satisfaction of employers and stakeholder involvement. (RA4.1)
Satisfaction of Employers
As part of ongoing program improvement efforts, the UConn Neag School of Education advanced programs collect feedback on employers’ satisfaction. The employer satisfaction survey for the Administrator Preparation program (UCAPP - 092 certification endorsement) and the Executive Leadership program (ELP - 093 certification endorsement) was distributed in summer 2023 to a sample of Connecticut superintendents and principals. The respondents were asked to rate UConn alumni administrators and leaders on their preparation for district and school leadership roles. The survey was distributed to 570 building and district administrators and 50 surveys were completed (response rate of 9%). Thirty-three respondents had not employed or supervised a UCAPP or ELP graduate in a leadership role within the last three years. Fifteen respondents provided feedback on recent UCAPP graduates (within last 3 years) and six respondents provided feedback on recent ELP graduates (within last three years). The survey was set up so that respondents remained anonymous.
ELP 2023 Employer Survey Results
One hundred percent of ELP employer respondents rated graduates as being prepared or very prepared for their job role and responsibilities. One hundred percent of ELP employer respondents stated that they were satisfied or very satisfied with how the graduates understand and apply knowledge and skills appropriate to their professional field of specialization so that learning and development opportunities for all P-12 are enhanced through the six CAEP RA1.1 core skill areas, the job performance of the ELP graduates they employ (CAEP RA4.1), and the ELP graduates' preparation to work with diverse P-12 students and their families (CAEP RA4.1). One hundred percent of ELP employer respondents stated that ELP graduates typically or consistently apply the knowledge, skills, and commitments documented within the NELP District Standards (1 - 7).
UCAPP 2023 Employer Survey Results
Ninety-two percent of UCAPP employer respondents rated graduates as being prepared or very prepared for their job role and responsibilities. Ninety-two percent of UCAPP employer respondents stated that they were satisfied or very satisfied with how the graduates understand and apply knowledge and skills appropriate to their professional field of specialization so that learning and development opportunities for all P-12 are enhanced through the CAEP RA1.1 core skills of 1 (data literacy), 2 (use of research), and 4 (leading and/or participating in collaborative activities). Eighty-five percent of UCAPP employer respondents stated that they were satisfied or very satisfied with how the graduates understand and apply knowledge and skills appropriate to their professional field of specialization so that learning and development opportunities for all P-12 are enhanced through the sixth CAEP RA1.1 core skill of ‘application of professional dispositions’ and seventy-seven percent of respondents were satisfied or very satisfied regarding the third and fifth CAEP RA1.1 core skills of ‘employment of data analysis’ and ‘supporting appropriate applications of technology’. Ninety-two percent of UCAPP employer respondents stated that they were satisfied or very satisfied with the job performance of the UCAPP graduates they employ (CAEP RA4.1) and one hundred percent of UCAPP respondents stated that they were satisfied or very satisfied with the UCAPP graduates' preparation to work with diverse P-12 students and their families (CAEP RA4.1). Ninety percent or more of UCAPP employer respondents stated that UCAPP graduates typically or consistently apply the knowledge, skills, and commitments documented within the NELP Building Standards (1 - 5). For NELP Building Standards 6 and 7, 80% or more of UCAPP employer respondents stated that UCAPP graduates typically or consistently apply the knowledge, skills, and commitments documented within the standards.
Summary
Results of the 2023 ELP and UCAPP employer survey provide evidence of employers’ satisfaction with completers’ preparation and their effectiveness. We will continue to monitor employer satisfaction in the advanced programs. The Reading and Language Arts/Literacy Specialist advanced program recently revised their employer satisfaction survey, and the survey will be distributed in 2024.
2023 ELP Employer Survey Results
| Item | Very Dissatisfied (1) | Dissatisfied (2) | Neither Satisfied nor Dissatisfied (3) | Satisfied (4) | Very Satisfied (5) | Total Responses | Mean |
Please rate your satisfaction or dissatisfaction with how the ELP graduates understand and apply knowledge and skills appropriate to their professional field of specialization so that learning and development opportunities for all P-12 are enhanced through the following six core areas. (CAEP RA1.1)
|
0 0% |
0 0% |
0 0% |
4 67% |
2 33% |
6 | 4.33 |
|
0 0% |
0 0% |
0 0% |
3 50% |
3 50% |
6 | 4.50 |
|
0 0% |
0 0% |
0 0% |
3 50% |
3 50% |
6 | 4.50 |
|
0 0% |
0 0% |
0 0% |
2 33% |
4 67% |
6 | 4.67 |
|
0 0% |
0 0% |
0 0% |
2 33% |
4 67% |
6 | 4.67 |
|
0 0% |
0 0% |
0 0% |
2 33% |
4 67% |
6 | 4.67 |
| Please rate your satisfaction or dissatisfaction with the job performance of the ELP graduates you employ (CAEP RA4.1) | 0 0% |
0 0% |
0 0% |
2 33% |
4 67% |
6 | 4.67 |
| Please rate your satisfaction or dissatisfaction with the ELP graduates' preparation to work with diverse P-12 students and their families (CAEP RA4.1) | 0 0% |
0 0% |
0 0% |
3 50% |
3 50% |
6 | 4.50 |
| Total – All Items Combined | 0 0% |
0 0% |
0 0% |
21 44% |
27 56% |
48 | 4.56 |
| Do the ELP graduates apply the knowledge, skills, and commitments necessary for the following areas: | No, they consistently do not (1) | No, they typically do not (2) | Neither yes nor no (3) | Yes, they typically do (4) | Yes, they consistently do (5) | Total Responses | Mean |
| To collaboratively lead, design, and implement a district mission, vision, and process for continuous improvement that reflects a core set of values and priorities? (NELP District 1) | 0 0% |
0 0% |
0 0% |
2 33% |
4 67% |
6 | 4.67 |
| To understand and demonstrate the capacity to advocate for ethical decisions and cultivate and enact professional norms? (NELP District 2) | 0 0% |
0 0% |
0 0% |
2 33% |
4 67% |
6 | 4.67 |
| To develop and maintain a supportive, equitable, culturally responsive, and inclusive district culture? (NELP District 3) | 0 0% |
0 0% |
0 0% |
3 50% |
3 50% |
6 | 4.50 |
| To evaluate, design, cultivate, and implement coherent systems of curriculum, instruction, data systems, supports, assessment, and instructional leadership? (NELP District 4) | 0 0% |
0 0% |
0 0% |
3 50% |
3 50% |
6 | 4.50 |
| To understand and engage families, communities, and other constituents in the work of schools and the district and to advocate for district, student, and community needs? (NELP District 5) | 0 0% |
0 0% |
0 0% |
2 33% |
4 67% |
6 | 4.67 |
| To develop, monitor, evaluate, and manage data-informed and equitable district systems for operations, resources, technology, and human capital management?? (NELP District 6) | 0 0% |
0 0% |
0 0% |
3 50% |
3 50% |
6 | 4.50 |
| To cultivate relationships and lead collaborative decision making and governance? (NELP District 7) | 0 0% |
0 0% |
0 0% |
4 67% |
2 33% |
6 | 4.33 |
| To represent and advocate for district needs in broader policy conversations? (NELP District 7) | 0 0% |
0 0% |
0 0% |
5 83% |
1 17% |
6 | 4.17 |
| Total – All Items Combined | 0 0% |
0 0% |
0 0% |
24 50% |
24 50% |
48 | 4.50 |
2023 UCAPP Employer Survey Results
| Item | Very Dissatisfied (1) | Dissatisfied (2) | Neither Satisfied nor Dissatisfied (3) | Satisfied (4) | Very Satisfied (5) | Total Responses | Mean |
Please rate your satisfaction or dissatisfaction with how the UCAPP graduates understand and apply knowledge and skills appropriate to their professional field of specialization so that learning and development opportunities for all P-12 are enhanced through the following six core areas. (CAEP RA1.1)
|
0 0% |
0 0% |
1 8% |
6 46% |
6 46% |
13 | 4.38 |
|
0 0% |
1 8% |
0 0% |
8 62% |
4 31% |
13 | 4.15 |
|
0 0% |
0 0% |
3 23% |
6 46% |
4 31% |
13 | 4.08 |
|
0 0% |
0 0% |
1 8% |
6 46% |
6 46% |
13 | 4.38 |
|
0 0% |
1 8% |
2 15% |
6 46% |
4 31% |
13 | 4.00 |
|
0 0% |
1 8% |
1 8% |
5 39% |
6 46% |
13 | 4.23 |
| Please rate your satisfaction or dissatisfaction with the job performance of the UCAPP graduates you employ (CAEP RA4.1) | 0 0% |
1 8% |
0 0% |
3 23% |
9 69% |
13 | 4.54 |
| Please rate your satisfaction or dissatisfaction with the UCAPP graduates' preparation to work with diverse P-12 students and their families (CAEP RA4.1) | 0 0% |
0 0% |
0 0% |
6 46% |
7 54% |
13 | 4.54 |
| Total – All Items Combined | 0 0% |
4 4% |
8 8% |
46 44% |
46 44% |
104 | 4.29 |
| Do the UCAPP graduates apply the knowledge, skills, and commitments necessary for the following areas: | No, they consistently do not (1) | No, they typically do not (2) | Neither yes nor no (3) | Yes, they typically do (4) | Yes, they consistently do (5) | Total Responses | Mean |
| To collaboratively lead, design, and implement a school mission, vision, and process for continuous improvement that reflects a core set of values and priorities? (NELP Building 1) | 0 0% |
1 10% |
0 0% |
5 50% |
4 40% |
10 | 4.20 |
| To understand and demonstrate the capacity to advocate for ethical decisions and cultivate and enact professional norms? (NELP Building 2) | 0 0% |
0 0% |
0 0% |
2 20% |
8 80% |
10 | 4.80 |
| To develop and maintain a supportive, equitable, culturally responsive, and inclusive school culture? (NELP Building 3) | 0 0% |
0 0% |
0 0% |
2 20% |
8 80% |
10 | 4.80 |
| To evaluate, develop, and implement coherent systems of curriculum, instruction, data systems, supports, and assessment? (NELP Building 4) | 0 0% |
1 10% |
0 0% |
4 40% |
5 50% |
10 | 4.30 |
| To engage families, community, and school personnel in order to strengthen student learning, support school improvement, and advocate for the needs of their school and community? (NELP Building 5) | 0 0% |
0 0% |
0 0% |
5 50% |
5 50% |
10 | 4.50 |
| To improve management, communication, technology, school-level governance, and operation systems to develop and improve data-informed and equitable school resource plans and to apply laws, policies, and regulations? (NELP Building 6) | 0 0% |
0 0% |
2 20% |
5 50% |
3 30% |
10 | 4.10 |
| To build the school’s professional capacity and engage staff in the development of a collaborative professional culture? (NELP Building 7) | 0 0% |
0 0% |
0 0% |
4 40% |
6 60% |
10 | 4.60 |
| To improve systems of staff supervision, evaluation, support, and professional learning? (NELP Building 7) | 0 0% |
1 10% |
1 10% |
4 40% |
4 40% |
10 | 4.10 |
| Total – All Items Combined | 0 0% |
3 4% |
3 4% |
31 39% |
43 54% |
80 | 4.43 |
Stakeholder Involvement
The Neag School of Education regularly involves internal and external stakeholders in program design, evaluation, and continuous improvement processes. Program faculty meet frequently throughout the academic year and each of the advanced programs also host advisory board meetings at least once a semester to review program data and discuss program design, evaluation, and improvement. The advisory board meetings provide stakeholders an opportunity to share the strengths of each program, offer input on program evaluations, and provide suggestions on ways to improve the program. Stakeholder feedback is also systematically sought at multiple points of each program. For example, students provide feedback on entrance and/or exit surveys, graduates provide feedback on completer/alumni surveys, employers provide feedback on employer surveys, and students receive feedback on their performance from faculty throughout the program. The Neag School of Education faculty review the feedback elicited from each of these methods and use it to develop and monitor continuous improvement processes for the educational programs.
Measure 3: Candidate competency at program completion. (RA3.4)
Pass Rates
The tables below include pass rates for the Reading Specialist Tests (097 and 102), School Psychologist Praxis (5402), and Connecticut Administrator Test (6412) for those candidates in each graduation year attempting the exam. For student privacy, due to low numbers of candidates attempting the Reading Specialist exams per year, the pass rates for the 097 and 102 certifications have been combined and the pass rates for the last three academic years have been combined. For the same reason, the School Psychologist Praxis pass rates for the last three academic years have been combined.
The Reading Specialist, School Psychologist Praxis, and Connecticut Administrator Test candidate pass rates of 100% over the past three academic years demonstrate candidate competency at program completion.
| Name of Exam | Combined Pass Rates for AY 2020-2021, AY 2021-2022, and AY 2022-2023 Graduates Who Took Exam* |
|---|---|
| Reading and Language Arts Consultant (097) and Remedial Reading & Remedial Language Arts (102) Graduates – Reading Specialist Tests* | 26/26 100% |
| School Psychology – Master’s / Sixth Year Program Graduates – School Psychologist Praxis (5402) | 15/15 100% |
Note: *For student privacy, due to low numbers of candidates attempting the Reading Specialist exams per year, the pass rates for the 097 and 102 certifications have been combined and the pass rates for the last three academic years have been combined. For the same reason, the School Psychologist Praxis pass rates for the last three academic years have been combined.
| Name of Exam | Pass Rate for AY 2020-2021 Graduates Who Took Exam | Pass Rate for AY 2021-2022 Graduates Who Took Exam | Pass Rate for AY 2022-2023 Graduates Who Took Exam |
|---|---|---|---|
| UCAPP Graduates – Connecticut Administrator Test (6412) | 30/30 100% |
32/32 100% |
25/25 100% |
Graduation Rates
The tables below include the graduation rates for the recent ELP and UCAPP cohorts and the graduation or transfer rates for the recent School Psychology MA/Sixth Year cohorts. For student privacy (due to small numbers of students in each cohort), the tables below reflect a combination of multiple cohorts for the ELP graduation rates and the School Psychology graduation or transfer rates.
ELP is a 13-month program, and we calculated the one- and 1.5-year graduation rates. For the last four cohorts, the combined one-year (13-month) ELP graduation rate is 93%.
UCAPP is a two-year program, and we calculated the two- and three-year graduation rates. For the last four cohorts, the two-year graduation rate ranged from 85-96%. For the last three cohorts, the three-year graduation rate ranged from 91-97%.
School Psychology MA/Sixth Year is a three-year program, and we calculated the three- and four-year graduation or transfer rates. For School Psychology, there are students who begin in the MA/Sixth Year program but transfer directly to the PhD program without completing the MA/Sixth Year program. For this reason, the graduation or transfer rates best reflect the completion options of the School Psychology MA/Sixth year program students. For the last three cohorts, the three-year School Psychology MA/Sixth Year graduation or transfer rate is 100%.
Overall, the recent graduation rates demonstrate candidate competency at program completion. We will continue to monitor the graduation rates.
| ELP Graduation Rate |
||
|---|---|---|
| Entering Year Cohorts (Combined) | 1-Year Graduation Rate (13 Month) | 1.5-Year Graduation Rate |
| 2019-2020 through 2022-2023 | 93% | 93% |
| School Psychology MA/Sixth Year Graduation or Transfer to PhD Rate |
||
|---|---|---|
| Entering Year Cohorts (Combined) | 3-Year Graduation or Transfer Rate | 4-Year Graduation or Transfer Rate |
| 2017-2018 through 2019-2020 | 100% | 100% |
| UCAPP Graduation Rate |
||
|---|---|---|
| Entering Year Cohort | 2-Year Graduation Rate | 3-Year Graduation Rate |
| 2019-2020 | 85% | 91% |
| 2020-2021 | 91% | 97% |
| 2021-2022 | 96% | 96% |
| 2022-2023 | 87% | N/A |
Note: We are calculating the graduation rates for the other advanced program, and they will be posted as soon as they are available.
Measure 4: The ability of completers to be hired in education positions for which they have prepared.
For all advanced programs for which we have data, graduates from the 2020-2021, 2021-2022, and 2022-2023 academic years report 100% employment in the fall immediately following graduation. The employment data provide evidence of completers’ ability to retain/obtain employment positions after completion of their program.
| % Employed in fall after graduation | 2020-2021 Graduates | 2021-2022 Graduates | 2022-2023 Graduates |
|---|---|---|---|
| Executive Leadership Program (ELP) | 100% | 100% | 100% |
| Literacy Specialist Program | 100% | 100% | 100% |
| School Psychology MA/SDPE Program | 100%* | No data available | 100%* |
| UConn Administrator Preparation Program (UCAPP) | 100% | 100% | 100% |
Note: The numbers reflect all employment reported by graduates and not necessarily employment in a position that is based upon having attained an advanced certification. *These values were obtained from self-reported graduate survey responses. Survey responses varied per year, and all graduates did not respond to the surveys. In some years, very few graduates responded to the survey employment question. The percentages reported were obtained by comparing the number of graduates who self-reported employment each year by the number of graduates who responded to the survey each year.
Additional School Psychology Outcomes and Data
School Psychology Student Admissions, Outcomes, and Other Data