Mentoring Program Evaluation: Framework, KPIs, Timing
Mentoring program evaluation checks whether a program is running as planned and moving the goals it was set up for. You track participation, relationship quality and a few outcome indicators at fixed points, then use the findings to improve the next cycle.
Why evaluate
- To fix the program while it runs. A midpoint check showing that a third of participants stopped meeting is worth more than a polished final report.
- To decide what to keep: which format, matching rules and session plan to repeat.
- To answer the sponsor with evidence instead of anecdotes.
If only the third reason drives the work, evaluation becomes a reporting exercise. Start with the first two.
A four-level framework
The Kirkpatrick model, created by Donald Kirkpatrick for training, has four levels: reaction, learning, behavior and results (Kirkpatrick Partners). It suits mentoring because it separates what people felt from what changed.
| Level | Question for a mentoring program | Typical evidence |
|---|---|---|
| 1. Reaction | Did mentors and mentees find it worthwhile? | Post-meeting feedback, end survey |
| 2. Learning | What did mentees learn: skills, confidence, network? | Goal self-ratings at baseline and end, mentor observations |
| 3. Behavior | Do mentees act differently at work or in study? | Goal progress, examples, manager or tutor input |
| 4. Results | Did the target indicators move? | Retention, internal moves, readiness, academic progression |
Do not stop at level 1: satisfaction is easy to collect but shows no change. And do not jump to level 4 alone: results without levels 2 and 3 cannot explain why an indicator moved.
KPIs to track
Pick a few from each group. Participation shows whether the program is happening, quality whether it is worth people’s time, outcomes whether it points toward its purpose.
| Group | KPI | How to calculate or collect it |
|---|---|---|
| Participation | Applications | Mentor and mentee applications per cohort, against target |
| Participation | Match rate | Matched participants ÷ eligible applicants |
| Participation | Meetings per match | Meetings recorded ÷ active matches, against plan |
| Participation | Drop-off | Matches that stopped or left early ÷ all matches, with timing |
| Quality | Satisfaction | Rating plus one open question, after meetings and at the end |
| Quality | Goal progress | Mentee self-rating per goal at baseline, midpoint and end |
| Outcome | Retention | Mentees still in the organization after 6 or 12 months, vs a comparison group |
| Outcome | Promotion or internal move | Moves in the follow-up period, vs a comparison group |
| Outcome | Readiness | Manager or self-rated readiness for a next role |
| Outcome | Progression (students) | Continuation, completion, or move into work or further study |
Treat outcome rows as indicators, not proven effects. Write a target next to each KPI before the cohort starts, such as “at least four meetings per match by the midpoint”. A number without a target cannot be read.
When to measure
- Baseline, before the first meeting. Mentees rate themselves on each goal, plus confidence, network and intention to stay.
- Midpoint. A short pulse: are participants meeting, is it useful, is anything blocking them? This is the time to rematch or intervene.
- End of cycle. Full survey, goal re-rating, meeting totals and completion.
- Follow-up, three to twelve months later. Behavior and results take time to show.
- Baseline
- Midpoint pulse
- End-of-cycle survey
- Follow-up
Survey wording for each point is in the mentoring evaluation survey questions template.
Data sources
Say which source each number comes from.
- Surveys. Short and repeated at the same points with the same goal questions, so answers compare over time.
- Meeting records. Dates, attendance, sessions completed, post-meeting feedback. These record behavior, not opinion.
- HR, academic or membership records. Agree access with the data owner and tell participants at enrollment what will be used. Report aggregates only, and suppress groups small enough to identify people. GDPR and similar laws require a clear purpose and data minimization.
Comparing fairly
Every evaluation meets the question: would this have happened anyway? People who sign up for mentoring may already be more motivated or better connected, so “mentored vs not mentored” tables can flatter the program.
Expect modest effects. A meta-analysis of youth, academic and workplace studies linked mentoring to many favorable outcomes. The effects were generally small (Eby et al., Journal of Vocational Behavior, 2008).
- Before vs after
- Mentored vs everyone
- Matched groupSimilar role, level, tenure
- Waitlist or phasedLater starters compare
- Random assignment
- Matched comparison group: non-participants similar in role, level, tenure or year of study.
- Waitlist: when demand exceeds mentor supply, the waitlist is a natural comparison group for one cycle.
- Phased rollout: launch in some units first and compare with those starting later.
Report findings as associations (“mentees showed higher 12-month retention than a matched comparison group”), not causes. For costs and outcomes side by side, see mentoring program ROI.
Common mistakes
- No baseline. You cannot show change without a starting point.
- Only satisfaction. Match it with goal progress and behavior.
- Too many KPIs. Six tracked well beat twenty tracked loosely. Give each an owner and a target.
- Measuring only at the end. The matches that stopped in week three are long gone by then.
- Claiming causation.
- Ignoring drop-outs. Surveying only finishers inflates every number. Ask leavers briefly why.
- Data nobody reads. Decide who receives the findings and what decision they feed. See how to report mentoring results.
The rest of the program cycle is in how to manage a mentoring program.
Evaluation in Mentornity
In a spreadsheet, participation data has to be chased by email. In Mentornity, each booked meeting is recorded with its date, participants and session. Admins see which matches have met, which are behind and which have gone quiet. Sessions can carry questions before and after each meeting, feedback forms are part of the program, and reminders go to anyone with an open form. Reports export as charts, Excel or PDF, with a Program Health score updated weekly. See employee mentoring programs, or try it free with up to 10 users.