Security

A Pre-Incident Briefing for Support Staff on AI Features

Antonio Evans9 min read

A rectangular table in a plain training room.
Key points

Key points

  1. 1Run three one-hour briefings before an AI feature goes live: model limits, data handling, approved wording.
  2. 2Seed every session with the exact questions agents will face, so they rehearse judgment instead of memorizing policy.
  3. 3Publish a one-page limits sheet that names each limit and the source where it was verified.
  4. 4Rehearse refusals and escalations out loud, because wording decided during an incident is usually the wording that fails.

Why brief support staff before the feature ships, not after

Most organizations treat AI incidents as a technical problem and discover, too late, that the failure happened at the conversation layer. An agent told a customer the wrong refund amount because a model produced a confident number. An agent pasted an account number into a chat window because nobody had told them not to. The remediation work in both cases is training, and training costs the least before launch.

The incident response literature draws a hard line between three documents: a policy that sets governance, a plan that covers detection through recovery, and playbooks that script specific scenarios. Fortinet's guide describes the policy as broad and rarely changing, while playbooks handle the specific incident response plans, playbooks and policy. A pre-incident briefing for support staff is closest to a playbook: narrow, scenario-driven, and useless if it is written mid-crisis.

Tabletop exercises offer the delivery model. They are discussion-based sessions where stakeholders walk through a hypothetical incident in a low-stress environment, testing the response plan without touching live systems, as Bitsight's tabletop exercise glossary explains. CISA publishes over 100 customizable exercise packages with objectives, scenarios and discussion questions, which is a useful reminder that the format is well established and does not need invention (CISA tabletop exercise packages).

Duration matters. Bitsight notes that exercises typically run one to four hours, and simpler scenarios can fit in a single hour. Sophos distinguishes rapid-fire scenarios of 10 to 30 minutes from technical sessions of one to two hours and full stakeholder sessions of two to four hours, and its security tabletop guidelines describe a "seed" event that facilitators expand as the discussion unfolds. For support staff, one hour per session is the right unit: long enough for two or three seeded scenarios, short enough to schedule across shifts.

The business case is not abstract. Employees are already using AI whether or not rules exist. Coursiv's guide on AI training for employees cites a PagerDuty survey finding that 66% of office professionals had used AI at work while believing it broke company policy, and a Verizon breach report finding that shadow AI use on corporate devices tripled to 45% of employees in a year. Support agents sit closest to customer data, so the shadow-AI risk concentrates there.

A decision rule for sequencing: if your AI feature touches money, identity, or account access, run all three sessions before launch and make session two (data handling) a blocker. If the feature only drafts internal notes, session one plus a written limits sheet is sufficient, and you can fold the other two into onboarding.

Session one: what the model can and cannot do

Session one exists to stop the two most expensive misreadings of AI: attributing intent to the model and attributing reliability to it. Agents who believe the model is "lying" escalate differently than agents who understand it produced a plausible but unsupported number.

Open with the limits sheet (below) and read the right-hand column aloud. Then run two seeded scenarios.

Scenario A: "The model gave a customer a wrong refund amount, what do you say?" Let agents draft an answer in pairs for four minutes, then collect two drafts and mark them against the approved-wording rules from session three. The point is not that they get it right; it is that they discover the gap between an apology that owns the error and one that blames "the system."

Scenario B: "A customer asks whether they are talking to a person or an AI. What do you say?" This is a disclosure question dressed as a technical one. Rehearse a plain answer and a redirect if the customer becomes upset.

Close with a capability drill. Give each agent three real tickets from the past month and ask: for each one, would you trust a model draft, verify every number, or refuse to let a model touch it? Record the answers on a whiteboard. Disagreements are the curriculum.

Facilitators should follow the tabletop discipline of separating discussion from operational control, the principle Google's SRE guidance applies to incidents, as summarized in Webalert's status update templates: one person runs the session and keeps the notes while participants talk. Do not let the session turn into a tool demo.

Session two: data handling, redaction and logs

Session two is the one with legal and privacy exposure behind it, and it should be treated as mandatory for any agent with inbox access.

Start with the question agents actually type into chat: "Can I paste this account number into the chat?" Then work through a three-bucket exercise. Put a stack of realistic ticket excerpts on the table and have agents sort each into: paste as-is, redact first, or never paste. Examples worth including: a partial account number, a full account number, a customer's email address, a screenshot of a billing page, a password reset link, and a full chat transcript containing a third party's details.

The supporting principle is permissions-aware design. Glean's overview of privacy concerns with customer data in AI argues that access control and audit trails should be built into AI workflows from the start rather than bolted on, and that limited data collection and retention policies reduce exposure. Agents do not need the full legal rationale, but they do need to know that anything pasted may leave the boundary of the system of record.

Then walk through where logs go. Draw the path on a whiteboard: prompt, model response, the tool or console that recorded it, the retention period, and who can retrieve it. If your team cannot draw that path, that is the finding of session two, and it belongs in the limits sheet as an open item with an owner.

Close with a redaction drill under time pressure. Give agents 90 seconds to rewrite a messy ticket into something safe to paste, then compare versions. Reward aggressive redaction, not elegance.

Session three: approved wording for apologies, escalations and refusals

Wording is where support teams most often improvise and most often regret it. Gorgias's catalog of customer service phrases lists the ones to avoid, including "I apologize for any inconvenience," "that's our policy" and a flat "no, I can't do that." Those phrases feel safe to write and read as dismissive to a customer who has just been given a wrong number by a machine.

Session three should produce three short scripts, each under 60 words, agreed by the room and approved by whoever owns customer communications.

Apology script for a model error: name what happened, name the correction, name the next step, give a timestamp. Indeed's roundup of customer service email response samples recommends reading the query fully, being specific, offering a solution and thanking the customer, which maps cleanly onto a model-error apology.

Escalation script for anything touching money or identity: state what is being escalated, to whom, and when the customer will hear back. Keep the estimate conservative. Status page practice is instructive here: better to give a conservative estimate or none than one you cannot meet, per OpenStatus's status page best practices.

Refusal script for requests the model or the agent cannot fulfill: say what you cannot do, say what you can do instead, and stop. Helply's analysis of auto-reply templates makes the related point that one fallback channel beats three, because three options produce no decision. The same applies to refusals: offer one alternative.

Run the word-for-word test before adjourning. Each agent reads one script aloud to a partner who plays an angry customer. Scripts that sound robotic get rewritten on the spot. Atlassian's guidance on incident communication stresses that message templates and update cadence must be decided in advance, not improvised during an incident, and that a zero-tolerance communication plan should apply to anything involving security issues or data loss.

The sample limits sheet

The limits sheet is a single page, one row per limit, each row carrying a source. Without the source column it becomes opinion and agents stop trusting it. Use a named owner and a review date per row.

LimitWhat agents should doSource of the limit
Model may produce a confident but wrong figure (refund, fee, date)Verify every number in the billing system before quoting itModel behavior, confirmed in launch evaluation by the feature owner
Model output should not be treated as policyCheck the policy library; never quote the model on eligibilityApproved wording owner, session three
Full account numbers must not be pasted into chatRedact to last four digits before pastingPrivacy review, session two, permissions-aware design guidance
Anything pasted may be logged outside the system of recordAssume retention; use the approved console onlyLog path documented by platform team
Customer must be told they are interacting with an AI when askedUse the approved disclosure lineCustomer communications approval
Model cannot commit to resolution timesUse the conservative estimate from the escalation scriptIncident communication guidance
Requests for fraud, legal or safety advice must be escalatedUse the refusal script, then escalateEscalation policy
Output may reflect training data gapsFlag to the feature owner; do not compensate informallyModel limitations session, session one

Keep the sheet to eight rows or fewer. If a limit needs a paragraph, it belongs in the playbook, not on the sheet.

Seeding questions that build judgment

The value of a briefing comes from the questions, not the slides. Seed each session with four to six questions, give agents two minutes to answer in pairs, and then compare answers rather than announcing the official one.

Session one:

  • The model gave a customer a wrong refund amount, what do you say?
  • A customer says "you're a robot, aren't you?" What do you say?
  • The model says a fee is waived. Do you honor it?
  • The model gave two different answers to the same question. Which one is wrong?

Session two:

  • Can I paste this account number into the chat?
  • A customer sends a screenshot with their card on it. Can you forward it?
  • Where does this conversation get stored, and who can read it?
  • A colleague asks you to paste a transcript into a personal AI tool. What do you do?

Session three:

  • A customer demands compensation for a model error. What do you say first?
  • How do you end a conversation where you refused a request?
  • What is the one sentence you will never say again after today?

The last question is the strongest close. It converts the session into a commitment and gives you a list of banned phrases for the next cohort.

Delivery, cadence and what to measure

Run sessions on a repeating cadence, not once. New agents need all three within their first two weeks. Existing agents should repeat session three at least once a quarter, because approved wording drifts.

Practical constraints to plan around:

  • Cap sessions at 15 participants so everyone speaks.
  • Schedule across shifts; a session only day staff can attend will not reach the people handling evening escalations.
  • Record the seeded scenarios, not the slides, so new hires can replay them.
  • Keep a one-page record per session: date, attendees, questions that exposed disagreement, and open items added to the limits sheet.

Measure three things: the number of disagreements surfaced per session (a session with zero disagreements was not seeded hard enough), the number of limits sheet rows with a verified source, and the time from first report of a model error to a corrected script in the library. If your agents are building features themselves or you are standardizing tooling across a support org, Quanta for Teams keeps a shared credit pool and a private skill library with a key per person, which makes the redaction and logging path easier to draw on the whiteboard in session two.

When the limits sheet keeps growing faster than your team can verify it, that is a signal to bring someone in rather than write faster. A free 30-minute discovery call with an AI expert is a reasonable place to sort out which limits are real and which are folklore.

FAQ

FAQ

How long should each briefing be?

One hour. Bitsight notes that cyber tabletop exercises typically run one to four hours and that simpler scenarios can fit in a single hour, and Sophos places rapid-fire scenarios at 10 to 30 minutes and technical-only sessions at one to two hours. A one-hour format with two or three seeded scenarios plus a short debrief fits between shift handovers.

Should we run the briefings before the AI feature ships or after?

Before, and session two before launch if the feature touches money, identity or account access. The incident response literature treats playbooks and templates as pre-incident work, and Atlassian's guidance explicitly recommends deciding message templates and update cadence in advance rather than improvising during an incident.

Do we need to train agents on how the model was built?

No. Agents need the observable limits, the data rules and the approved wording. Oracle's review of AI model training challenges is useful for feature owners, particularly on data quality, imbalance and overfitting, but the briefing should translate those into behavior, not architecture.

Who should attend?

Every agent who talks to customers, plus one representative each from privacy, customer communications and the feature team. Sophos recommends matching the scenario to the audience, and its full stakeholder format includes non-technical participants such as legal, marketing and HR, which is why session two benefits from a privacy representative in the room.

How often should the briefings repeat?

New agents within their first two weeks; existing agents at least quarterly for session three and twice a year for sessions one and two. Update the limits sheet whenever a model error is reported and corrected, so each cohort inherits the last cohort's findings instead of rediscovering them.

Sources

Sources

  1. A Guide to Incident Response Plans, Playbooks, and Policy - Fortinet
  2. What is a Tabletop Exercise in Cybersecurity? - Bitsight
  3. CISA Tabletop Exercise Packages
  4. Security Tabletop Exercises - Sophos Trust Center
  5. AI Training for Employees in 2026: A Practical Guide
  6. Incident Communication: Status Update Templates for Outages
  7. What are the privacy concerns of using customer data in AI?
  8. Customer Service Phrases: What to Say, What to Avoid, ...
  9. 15 Customer Service Email Response Samples for Any ...
  10. Building Trust with Status Pages
  11. Auto-Reply Email for Customer Support: 20 B2B Templates
  12. Incident Communication Best Practices & Channels
  13. 6 Common AI Model Training Challenges
About the author

About the author

Antonio Evans
Antonio Evans

Antonio Evans is the founder of Quanta Intelligence and a fractional CTO who builds HIPAA-ready AI systems for health and life-science companies. Before that he was technical co-founder of FriendsEAT for twenty years, CEO of Socialdraft, and a data engineer at IBM. Antonio lives with his dog Santino in Lisbon, Portugal.

All articles