How to see and measure training session engagement 

What does engagement in a training session actually mean?

An evaluation form tells you whether people liked the day. The Kirkpatrick model, a widely used framework for training evaluation, keeps that apart from learning. Level 1, Reaction, measures whether people found the training favorable, engaging and relevant. Level 2, Learning, measures whether they acquired the intended knowledge, skills, attitude, confidence and commitment. Levels 3 and 4 cover behavior on the job and organizational results.

For a trainer in the room, a useful working definition is behavioral: engagement is the share of participants who are actively thinking about the content at a given moment. You can't see thinking, but you can see answering. If 48 of 50 people answer a question within 20 seconds, the room is with you. If 30 answer and the rest are on their laptops, it isn't.

Why do questions during training improve learning?

• Retrieval practice. In a classic experiment, students who took practice tests on a text remembered substantially more one week later than students who spent the same time re-reading it, even though the re-readers felt more confident they would remember.
• Pretesting. Asking a question before you teach the answer helps too. Across five experiments, people who were tested on concepts before reading about them did better on the final test, even for questions they got wrong on the pretest.
• Forgetting is fast. A modern replication of Ebbinghaus's forgetting curve confirmed the curve Ebbinghaus first measured in the 1880s: memory drops fastest in the first hours and days, then levels off. Plan at least one follow-up question in the week after the session.
• Active formats beat lecturing. A US-led meta-analysis of 225 studies in university science courses found exam scores improved by about 6% under active learning, and students in traditional lectures were 1.5 times more likely to fail. That research is from university courses. There is no comparable meta-analysis for workplace training, so treat it as a strong hint for adult learning.

How do you measure learning during a session?

Use a simple pre and post design. It adds about ten minutes to a session.

1. Pick three to five learning objectives that can be tested with a multiple-choice question. "Knows the escalation route for a data breach" can be tested. "Understands the importance of security" can't.
2. Write one question per objective. Use a realistic scenario: "A customer emails asking for a colleague's phone number. What do you do?"
3. Ask them at the start, before you teach. Don't reveal the answers. This is your baseline, and the pretesting effect means the questions already help learning.
4. Teach the content.
5. Ask the same questions (or close variants) at the end. Variants with the same concept and different surface details are a better test than identical questions, because people can remember the wording.
6. Compare. Show the before and after results to the group. The questions where the shift is small tell you what to fix in the course.

Add one confidence question at the end: "How confident are you that you could do this at work tomorrow?" Kirkpatrick's Level 2 includes confidence and commitment, and a gap between correct answers and confidence is useful to know.

What does a 60-minute session plan look like?

A plan for a one-hour compliance or skills session with about 30 participants.

That is about 15 questions in an hour, roughly one decision every four minutes. Keep the pair discussion: in a study of university genetics students, peer discussion improved understanding even when nobody in the discussion group had known the answer at first.

For openers that get a room of strangers talking, see these icebreaker questions. To build the quiz section inside your slides, see how to make a quiz in PowerPoint.

What questions should trainers ask?

• Scenario questions test whether people can apply a rule. "Your manager asks you to approve your own expense claim. What do you do?"
• Misconception questions target the mistake people actually make. Ask your subject matter experts which wrong answer they hear most, and make it an option.
• Opinion questions surface attitudes. "How realistic is this procedure on a busy shift?" Run these anonymously.
• Prediction questions build curiosity before a reveal. "What share of incidents start with a phishing email?" (Only if you have a sourced figure to reveal.)
• Commitment questions close the session. "Which of these three will you do first next week?"

Keep options short, keep to four, and make every wrong option something a reasonable person might choose.

How do you report results to managers or clients?

Three report views cover most needs:

1. Per question: percentage correct before and after. This shows what the session changed and what it didn't.
2. Per participant: who scored low at the end. In compliance training, this is your follow-up list.
3. Over time: the same questions asked 30 days later, in a team meeting or a short refresher. It still measures knowledge rather than behavior on the job (Level 3), but it shows what was retained.

Be honest about what the numbers show. A rise from 55% to 85% correct shows that people could answer the questions at the end of the day. It doesn't prove they will behave differently. Say that in the report, and propose the 30-day check.

Training providers can send the same per-question report to the client, next to the satisfaction scores, so the client sees what their people learned as well as whether they liked the day.

How do you keep compliance and mandatory training engaging?

People attend mandatory training because they have to, so attention is the first problem. Proof is the second. In the UK, the Health and Safety Executive's guidance on work equipment mentions training "often coupled with some form of documented competence assessment" and says training "may need to be refreshed at suitable intervals to ensure workers remain competent". Wherever you train, in the UK or the US, a knowledge check with a saved result per person is stronger evidence than a signature on an attendance sheet. What helps in the room:

• Start with a question they will get wrong. It shows that the content is not as obvious as they thought.
• Use real cases from your own organization, anonymized, so the rule is attached to a situation people recognize.
• Run a team quiz between departments, with the leaderboard shown between rounds.
• Keep the phones and laptops closed. If people answer on their own device, their inbox is one tap away. Dedicated clickers avoid that. With OMBEA, for example, participants answer on ResponsePad clickers that need no Wi-Fi, no app and no log-in, and in named mode every answer is saved per participant for your training records.

What are the common pitfalls?

• Asking only at the end. Then you measure, but you don't change learning. Spread the questions out.
• Easy questions. If everyone scores 95% on the pre-check, the question measured nothing. Make them hard enough that around half the room gets them wrong at the start.
• Ignoring the answers. If 40% of the room picks the wrong option, explain it again now.
• Named answers for every question. Keep checks during the session anonymous so people answer what they think, and use named mode for the formal post-check.
• Too long between question and result. Show results within seconds, while the room still cares.

The corporate training page shows how knowledge checks and reports look in practice, and the training providers page covers running courses at client venues. For more ideas for quick checks, see formative assessment ideas. All the question types above are on the features page.