Most training evaluation collapses because the evidence never exists in the first place. Evaluators are told to assess learning transfer, the application of skills back on the job, and to compare results across a group to spot weak topics in the CDC's evaluation guidance. That comparison needs an object. If a two-hour AI workshop ends with discussion and a satisfaction survey, you have reactions, not evidence of skill. The CDC notes specifically that learner satisfaction does not determine a training's effectiveness.
The common escape hatch is self-report. You ask people whether they feel more confident, or run a retrospective before and after question. That has a place when nothing better exists, and the CDC lists it as a fallback. But a retrospective rating tells you how someone felt in the room. It does not tell you whether the prompt they saved would survive contact with a real task, or whether the decision they made holds up three weeks later.
Here is the decision rule that saves a lot of pain. If you cannot name the file a participant will save by the end of a segment, cut the segment or convert it into an exercise that produces one. A segment with no artifact is either context (fine, keep it short, no measurement claim) or it is entertainment. The field of instructional design makes the same point in a different vocabulary: training is most effective when learners know what they will gain and how their performance will be evaluated according to ATD's definition. Evaluation is part of the design cycle, not a separate activity bolted on afterwards. ADDIE treats evaluation as the phase that feeds findings back into analysis, which only works if there is something to evaluate per this overview of instructional design models.



