Annual Counseling Program Evaluation 2024
Summary of Program Evaluation Results
KPI Data
Our KPI’s are measure using portfolio assignment data. Overall, what these averages suggest is that within programs and between programs, our students are scoring well within the range of 4-5 on their portfolio assignments.
Scale: A=5, A-/B+ = 4, B= 3, B- =2, and C+ or lower = 1; Students pass Benchmark 1 with a score of 5,4 or 3. Anything lower and the student will have remediation of the assignment.
Summary
Portfolio assignments seem to be working as indicators of Key Performance Indicators. Students seem to understand the seriousness of the assignments and overall, it contributes to greater responsibility of learning.
Recommendations
None currently.
Benchmark/Professional Disposition Data
The following data is Benchmark/Professional Disposition average scores across program area. For all assignments, Students pass Benchmark 1 with a score of 5,4 or 3. Anything lower and the student must retake the course.
- Benchmark 1
- Benchmark 1 comprises basic counseling skill demonstration on a final tape. Students must successfully pass skills to progress to Practicum (Benchmark 2). For the 2023-4 cohort of students ranged from 2-5. Students with 2’s required remediation during Benchmark 2. All students passed Benchmark 1.
- Benchmark 2
- Benchmark 2 comprises a demonstration of basic counseling skills with community clients and greater conceptual ability. Students must successfully pass practicum to progress to internship (Benchmark 3). For the 2023-4 cohort of students benchmarks ranged from 4-5.
- Benchmark 3
- Benchmark 3 is a demonstration of advanced counseling skills in a community agency or school setting. The benchmark is based upon university observation, case conceptualization grade and site supervisor evaluation. For the 2023-24 cohort of students benchmarks ranged from 4-5.
- Benchmark 4
- Benchmark 4 is the comprehensive exam distributed in the spring of the students’ second year. See narrative below. Comprehensive exam data for 2023/24- 24 students took the counseling comprehensive exam in February of 2024. All of the 24 students passed.
Summary
Students performed well on benchmarks. We seem to have a good process for assisting students early when they need additional assistance and or supervision. Additionally, the benchmarks work well to discuss progress at three main developmental points in the program. An improvement we made this year was to develop a standard electronic portfolio for every student in the program.
Recommendation
It would be helpful to develop a process where we write benchmarks from the “department”. We do this already, but we think a more formal letter would be helpful. We will work on this for the upcoming academic year. Currently, the disposition is located in Tevera, so we need to adjust the form in Tevera.
CCSR Data
When looking at CCSR data from students and supervisors. There is often a disparity between the self- evaluation score, particularly during practicum. By the time internship occurs, the scores seem to be more equally matched. This may suggest that we may need to explain the purpose of the CCSR more fully during practicum, or it is indicative of developmental level.
Comprehensive Examination
In 2024, all students passed the comprehensive exam, with 2 students who needed to correct one section of the exam. Those 2 students resubmitted and subsequently passed the exam. The model portion of the exam continues to prove as a useful exercise to help students fully integrate their experience in the program. The conceptualization ensures that students walk away with a nuanced understanding of counseling theory which is a core value and focus of this counseling program.
Student Feedback
Student feedback on course evaluations suggests that students believe that the coursework is effective. Most scores range from 4-5 on a 5-point scale. There has been no significant feedback that suggests that there are areas to adjust or change.
Internship Site Data AY 2023/24
The Counseling Department added an additional grant funded internship with tuition waiver through the Rural Mental Health Preparation Practice Pathway Partnership program (RMHP4). This is a 4.1-million-dollar grant through the US (United States) Dept of Education. Dr. Koltz is the PI (Principal investigators) (Principal investigators) on this grant. This grant provides 5 additional funded internship sites in rural communities.
Summary
Overall students report being satisfied with their internship site experiences. Areas of common concern are the lack of opportunities for groups and at times MCFC students had difficulty getting their systems related hours. The sites that we utilize for internships are strong in terms of the quality of onsite supervision, relevance to career goals, exposure to a wide range of clientele and clinical issues. They prepare students for employment immediately upon graduation. We consistently hear from employers that our students are ready to start.
Recommendation
To address the lack of group counseling opportunities, for the second year in a row the GTA’s in the program are given the opportunity to run small groups with the first-year students. Additionally, we have revamped “Parenting Through Divorce” curriculum to “Collaborative Parenting” and expect after Covid that we will have increase in attendance. The clinic received some university funding to purchase the curriculum which we believe will increase attendance and opportunity for group facilitation.
Internship Site Supervision Data
Overall, students report being satisfied and supported by their site supervisors. There were no major areas of concern reported. Students reported being supported and appropriately challenged by their site supervisors. Noted by the program faculty is that site supervisors have not been giving substantive feedback on the CCSR.
Recommendation
This was addressed in a site supervisor breakfast training held in September of 2024. At this training, we addressed how to use the CCSR and student development.
