Business

How to Write a One-Page Charter for an AI Pilot

Antonio Evans9 min read

A single sheet of paper on a desk, divided into labeled boxes: Scope (two columns, In and Out), Success metrics (a baseline bar and a target bar), Budget (a line with a cap mark), Roles (a small RACI grid).
Key points

Key points

  1. 1A one-page AI pilot charter is a roughly 500-word decision document that fixes scope, metrics, budget, roles and stop conditions before any model is trained or vendor is paid.
  2. 2The charter needs explicit in-scope and out-of-scope lists, a measured baseline next to a target, and a decision owner with a name, because pilots fail on expectations and ownership far more often than on model quality.
  3. 3A budget cap only works when it carries a review trigger, a written condition that pauses spending and forces a decision instead of letting costs drift.
  4. 4Review the page on a fixed cadence and change it only by agreement between sponsor and pilot lead, so the finish line stays where everyone originally put it.

Why a pilot needs a finish line before it starts

An AI pilot is an experiment, and an experiment without a pre-declared outcome measure cannot fail, which means it cannot succeed either. The common pattern is a team picks a use case that sounds good in a steering committee, hands it to a few volunteers, runs it for months, then presents results that can be read as success or failure depending on who is in the room. Defining success metrics after seeing the data is rationalizing, not evaluating, which is why every pilot needs go/no-go thresholds set before day one (Institute of AI PM).

The failure is structural, not technical. Writeups of charter templates identify the same six breakdowns: an unclear business problem, scope creep, missing baseline metrics, weak ownership, late governance review and no decision criteria (InitializeAI). None of those are about the model. They are about the document nobody wrote.

There is a second reason to keep the charter short and concrete. A pilot charter is a decision document that gives a team permission to learn within explicit limits; it is not approval for a production system. A useful charter lets a sponsor answer five questions: whether the problem is important and the baseline verified, whether the approach handles representative cases, whether the outcome improves without unacceptable failures, whether people can supervise and interrupt the workflow, and what evidence will support go, revise or stop (Juan Carlo). That list fits on a page. It rarely fits in a slide deck.

The one-page structure: five sections and a header

Five sections do the work, plus a compact header that names the pilot, the sponsor, the pilot lead, the decision date and the workflow under test. Keep the whole page at about 500 words; the header carries facts, the sections carry decisions.

SectionWhat it containsQuestion it closes
ScopeIn list and out list, the workflow start and end, named user group and volumeWhat will this pilot do, and what will it refuse to do?
Success metricsOne primary metric with baseline and target, plus guardrail metrics that must not regressHow will we know it worked, and what must not get worse?
Budget capA hard spending ceiling, categories included, and a review triggerHow much can this cost before someone must decide again?
RolesNamed people for sponsor, pilot lead, business owner, data owner and risk reviewerWho decides what, and who is accountable for the outcome?
Stop conditionsWritten thresholds that end the pilot early or force a stop decisionWhat would make us quit before the planned end date?

Two habits make the page usable. First, write "unknown, discovery required" wherever evidence does not exist rather than inventing precision; an explicit gap is safer than a fabricated number (Juan Carlo). Second, keep the charter free of model and vendor names. The hypothesis should describe the result, not commit the team to one framework.

A useful distinction before you draft: a proof of concept asks whether the approach can work on representative cases, a pilot asks whether it improves a real workflow under bounded conditions with named users and human oversight, and production asks whether the organization can operate it over time. Only the middle question belongs in a pilot charter, and the scale, revise or stop decision at the end is the gate into the third (Juan Carlo).

Writing the scope section so it holds

Scope is the section that prevents scope creep, and it only works if the out list is as specific as the in list. Andrew Ng's guidance for first AI projects is to start small and pick a project with a specific business thesis, noting that projects chosen because a team has a lot of data in some area, with the expectation that the AI team will find value, tend to fail (Harvard Business Review). A scope section is where that thesis gets pinned down.

Write the in list against one workflow, one user group, one volume and one time window. A strong scope statement reads like an address, not a strategy: one workflow, one queue or category, one team, one date range. If a sentence could describe two different workflows, it is too broad.

The out list is where you spend the political capital. Typical entries for a first pilot:

  • Any autonomous customer-facing output; humans review before anything is sent.
  • Adjacent workflows that share the same data, even if they look easy.
  • New data sources that require a procurement or privacy review not yet completed.
  • Changes to pricing, eligibility or account-level decisions.
  • Additional languages or regions beyond the named user group.
  • Reuse of pilot outputs in production systems before the decision date.

The charter template used in published guidance draws the same line: a support triage pilot explicitly excludes fully autonomous customer response, account-level escalation decisions and refund handling even while it includes classification, summarization and routing recommendations (InitializeAI). Naming exclusions prevents a successful narrow test from quietly becoming an uncontrolled rollout.

One more rule: the pilot tests one AI pattern, whether classification, extraction, retrieval, summarization, drafting or decision support. If the in list mixes three patterns, you have three pilots and one page that cannot describe them.

Success metrics with a baseline and a target

A metric without a baseline is an opinion. The most common consequence of undefined success criteria is that an organization runs a pilot, observes performance at the end and has nothing to compare against, so a 12 percent error rate reduction sounds significant until someone asks what the error rate was before (AI Assembly Lines).

Use four numbers on the page, and no more:

  1. The primary outcome metric, the single KPI that changes if the AI is working.
  2. The baseline, measured on the current workflow with a stated source and measurement window.
  3. The target, the minimum improvement that justifies the next investment.
  4. Guardrail metrics, the things that must not regress beyond a stated tolerance.

A worked example makes the arithmetic concrete. Suppose a team handles 8,000 inbound tickets per month and the current median handling time is 11.4 minutes, measured from the ticketing system over the previous eight weeks. The team sets a target of a 20 percent reduction in median handling time on the subset of tickets in scope, and a guardrail that first-contact resolution must not fall by more than 2 percentage points. With those numbers written down, a 14 percent improvement is a clear "revise," not a debate. Without them, it is a slide.

This is also why "productivity" is a bad metric. No one agrees what it means, so proving ROI becomes impossible (Savvi AI). Attach every success metric to a number that already exists in a system of record.

Sample size is a decision too. Guidance for AI pilots suggests defining how many participants you need, selecting them from the eligible pool rather than asking for volunteers, and running a treatment group against a comparable control that does the same work without the tool (Institute of AI PM). Volunteers inflate adoption numbers; skeptics alone tell you nothing about broad rollout. Write the selection rule on the page.

Finally, pre-register the analysis. State the metric, the measurement window and who computes it before any results arrive. If the approach changes after preliminary data, record what changed and why.

The budget cap and the review trigger

A budget cap without a trigger is a wish. The cap is the maximum the pilot may spend without returning to the sponsor, and the trigger is the event that forces a re-decision before the cap is reached.

Write the cap as a single number with categories, for example: total ceiling, split across people time, vendor or API usage, data preparation and evaluation. Then write one trigger sentence, such as: if committed spend reaches 70 percent of the cap and the primary metric has not moved by at least half the target, the pilot pauses for a sponsor review within five business days.

Three practical rules:

  • Count people time. Pilots that only count licenses underestimate cost, and one writeup of charter mistakes points out that change management and ongoing costs are routinely underfunded, not just tooling (Dan Cumberland Labs).
  • Separate run cost from build cost. Usage-based inference spend scales with volume; decide up front whether the cap covers a fixed volume of test cases.
  • Name who can raise the cap. Only the sponsor, and only in writing, appended to the page.

If your pilot spans several model types, text generation, extraction, embeddings and speech, a single API with prepaid US dollar pricing makes the usage line on the charter easy to forecast. That is what Quanta Inference provides, and it keeps the budget section to one row per model type instead of one row per vendor.

Named roles and decision rights

Diffused accountability is the quiet killer. When accountability is distributed instead of assigned, no one owns the outcome (Dan Cumberland Labs). Counter-intuitively, the charter gets clearer when one person holds several roles; what matters is that every responsibility has a name next to it.

RoleDecision rightTypical holder
SponsorApproves the charter, the budget cap and any increase; makes the final scale, revise or stop callExecutive with budget authority
Pilot leadRuns the pilot day to day; owns the review cadence and the evidence logManager close to the workflow
Business ownerConfirms the baseline and accepts or rejects the primary metric at the decision dateOperations lead for the affected team
Data ownerGrants access at the minimum permission needed; can veto new data sourcesData or platform owner
Risk reviewerSigns off on human oversight, logging and handling of sensitive data before launchSecurity, legal or compliance
UsersOperate and review the output; named group, not an open callFrontline staff in scope

Two additional rules keep this honest. First, the business owner is not the pilot lead; the person who built the thing should not be the person who certifies it worked. Second, the data owner grants the minimum permission for every action the pilot takes, and prohibited data types are listed explicitly, which is how charters handle sensitive inputs in practice (Juan Carlo).

If your team lacks an experienced pilot lead, a line-of-business expert who has run adjacent work can fill that seat. Quanta Experts pairs such a person with your context and hands back finished deliverables, which is often enough to get the charter written in a week rather than a quarter.

Stop conditions and the review cadence

Stop conditions are the part teams skip and the part sponsors remembers. Write them as conditions, not feelings, and include four kinds:

  • Performance floor. If the primary metric moves the wrong way for two consecutive measurement windows, stop.
  • Quality guardrail breach. If a guardrail metric crosses its tolerance, pause and review before more volume is processed.
  • Data or rights failure. If a required data source is unavailable, or its terms of use no longer cover the pilot, stop.
  • Cost trigger. If projected spend will exceed the cap before the decision date, stop and review.

Schedule the review before launch. A pilot that runs longer than eight weeks for a non-infrastructure AI feature is usually a sign of scope creep or unclear success criteria (Institute of AI PM). Put the decision date in the header, then add a short cadence: a weekly written check on the primary metric, the guardrails and spend, and a mid-pilot review that can invoke any stop condition.

Change control belongs on the page too. The charter is reviewed at the fixed cadence and amended only by written agreement between sponsor and pilot lead, with the amendment dated and appended. No silent edits to the target after results start arriving; that is the moving target problem in miniature (AI Assembly Lines).

A fill-in template you can copy

Print this, fill it in, and get two signatures before the first API call or vendor invoice.

AI PILOT CHARTER
Pilot name:
Sponsor (name, title):            Decision date:
Pilot lead (name):                Review cadence: weekly check, mid-point review

1. SCOPE
Workflow (start to end):
In:  (users, volume per week, systems, AI pattern)
Out: (list at least five exclusions)
Data used (source, sensitivity, minimum permission):

2. SUCCESS METRICS
Primary metric:                   Baseline (value, source, window):
Target:                           Guardrail metric and tolerance:
Participant selection and size:   Analysis owner and method:

3. BUDGET CAP
Ceiling (USD):                    Split: people / vendor or API / data / evaluation
Review trigger (spend level and metric condition):

4. ROLES
Business owner:                   Data owner:
Risk reviewer:                    Users (named group):

5. STOP CONDITIONS
Performance floor:                Guardrail breach:
Data or rights failure:           Cost trigger:

Signed (sponsor):                 Signed (pilot lead):
Amendments (dated, appended):

If you are writing several of these at once, a free consulting call is a reasonable place to pressure-test the targets and triggers before you commit them to paper; the useful output is a recommendation you can paste into section two.

FAQ

FAQ

How long should a pilot charter be?

About 500 words, or one printed page plus the header and signature block. Published charter templates often run longer, three to ten pages, because they include governance appendices and stakeholder maps, but the executable core is short. A page gets read, signed and referenced when a scope question comes up, which is the entire point.

What if we do not have a baseline number?

Write "unknown, discovery required" next to the metric and add a two-week discovery task to establish it before the pilot processes real volume. Running the pilot first and measuring afterward destroys your ability to attribute any change to the AI, which is the single most common reason pilots end inconclusive (AI Assembly Lines). No baseline, no pilot.

Can we skip the out-of-scope list if the team already agrees on the goal?

No. Agreement stated verbally dissolves the first time someone spots an easy adjacent win. The exclusion list is what lets a team say no without a meeting, and it is the documented defense when a successful narrow test threatens to become an uncontrolled rollout (Juan Carlo). Five entries is the practical minimum.

Who should own the stop decision?

The sponsor, in writing, with the pilot lead able to invoke a pause immediately when a stop condition is met. Splitting the stop decision across a committee is how pilots keep running after their learning value ends; the charter's job is to name one person and one decision date. The business owner separately certifies whether the primary metric moved.

How do we keep the charter from becoming outdated?

Set a review cadence on the page and treat amendments as formal, dated additions signed by the sponsor and pilot lead. A project without a decision owner can keep running indefinitely, so the decision date in the header is a hard gate, not a target (Juan Carlo). If the pilot needs a new scope, that is a new charter, not an edit.

Sources

Sources

  1. How to Design an AI Pilot Program Template That Proves Value Fast
  2. AI Pilot Charter Template for Measurable Pilots | InitializeAI
  3. AI Pilot Charter Template: Plan a Controlled AI POC - Juan Carlo
  4. Andrew Ng: How to Choose Your First AI Project
  5. How to Define AI Pilot Success Criteria Before You Start
  6. Starting with Value Driven AI: How to Choose Your First AI Project
  7. AI Project Charter Template | Dan Cumberland Labs
About the author

About the author

Antonio Evans
Antonio Evans

Antonio Evans is the founder of Quanta Intelligence and a fractional CTO who builds HIPAA-ready AI systems for health and life-science companies. Before that he was technical co-founder of FriendsEAT for twenty years, CEO of Socialdraft, and a data engineer at IBM. Antonio lives with his dog Santino in Lisbon, Portugal.

All articles