Business

How to Write a Knowledge Base an AI Assistant Can Use

Antonio Evans7 min read

A person arranges books and recipe cards on clear shelves while a robot assistant pulls exactly the card it needs to answer a waiting customer.
Key points

Key points

  1. 1An AI assistant answers from short passages cut out of your articles, so every section has to make sense on its own, without the rest of the page.
  2. 2Coverage of the questions people actually ask matters more than the number of articles, and two conflicting answers are worse than a gap.
  3. 3Clear headings, plain lists, the customer's own words and text in place of screenshots make the right passage easier to find.
  4. 4A knowledge base that an AI reads is a production system: every article needs an owner, a review date and access rules.

How an AI assistant reads your knowledge base

Most AI assistants that answer from company documents do not read whole articles. They read pieces. Zendesk's documentation describes the process plainly: your content is ingested and split into chunks, each chunk is stored with a numerical vector that represents its meaning, the meaning of a user's message is compared with those vectors, and the AI writes a reply from the article title and the best-matching chunks (Zendesk help). This approach is called retrieval-augmented generation, usually shortened to RAG.

Two consequences follow. First, the assistant can only be as accurate as the passages it retrieves. HelpDocs puts it well: a grounded assistant answers from your published content and cites it, while an ungrounded one answers from whatever the model absorbed in training, which is where invented policies come from. The quality ceiling of a grounded assistant is set by your content, not by the model (HelpDocs).

Second, the unit that matters is the passage, not the article. A person can piece together an answer from three sections of a long page. An assistant that retrieves only one of those sections will answer from that one section. Chunking choices matter too. NVIDIA's tests across several document sets found that the best chunk size varied by content and question type, with short factual questions favoring smaller chunks and complex analytical questions favoring larger ones (NVIDIA). You may not control how your tool chunks text. You do control whether each piece makes sense when it is cut out.

Start from the questions people actually ask

The first job is coverage. HelpDocs identifies three causes behind almost every poor AI answer, none of them model problems: the answer is not written down, the answer is written down several times in different ways, or the answer exists but cannot be reached (HelpDocs). The first is the most common.

Build the list from evidence, not from what you think customers ask:

  • Searches on your help center that returned no results.
  • The most common reasons for support tickets, emails and calls.
  • Questions staff answer from memory because nothing is written down.
  • Messages from the assistant's own logs where it said it did not know.

HelpDocs recommends matching each of your top ticket drivers and no-result searches to an article, and treating anything without a match as a gap the AI cannot fill (HelpDocs). It also makes a useful point about scale: a hundred articles that answer your top hundred questions will outperform four hundred that miss them.

Leave out what the assistant does not need. A guide on building knowledge bases for AI models in Towards Data Science notes that a support chatbot may only need factual and tutorial content about company policies and procedures, and that limiting scope helps keep the model from inventing out-of-scope answers (Towards Data Science). Internal debates, old drafts and marketing copy do not belong in the set the assistant reads.

One question, one answer, one place

Duplicates do more damage than gaps. HelpDocs explains why: a gap produces "I don't know," while a contradiction produces a confident answer that may be the outdated one, because retrieval has no way to tell which version you meant to keep (HelpDocs). Zendesk's guidance says the same thing in its list of best practices: remove duplicate articles and conflicting information (Zendesk help).

A quick test: search for your five most important topics, such as refunds, cancellations, pricing, delivery times and opening hours, and count how many articles could plausibly answer each one. More than one means retrieval is making an editorial decision you did not make. Merge the articles, or retire the older one.

Keep each article focused, too. Zendesk recommends covering one topic completely and avoiding articles that mix several unrelated topics (Zendesk help). The cleaning step in the Towards Data Science guide follows the same logic: remove duplicate and outdated content, standardize terminology, and split material so each chunk holds one clear idea (Towards Data Science).

Write every section so it stands alone

Because the assistant reads passages, each section must carry its own context. Meilisearch's guide to chunking says chunks should be self-contained facts and should not be cut off in a way that changes the facts (Meilisearch). You get there through writing habits, not tooling.

Answer the title in the first paragraph. The opening passage is the one most likely to be retrieved. HelpDocs suggests reading only the first fifty words of ten articles and checking whether the title's question is answered (HelpDocs).

Repeat the noun instead of using a pronoun. Zendesk advises avoiding vague pronouns such as "it" or "they" and repeating the noun, because a chunk may lose the sentence that told the reader what "it" was (Zendesk help).

Repeat the topic in section text. Zendesk also recommends repeating the question or topic from the title so that context is not lost during chunking and questions are not separated from their answers.

Give complete answers. State the answer directly rather than implying it, include the conditions and exceptions, and avoid sending the reader elsewhere for the important part.

Here is the difference in practice:

Before:
  It can be changed in settings. They will need to confirm it first.

After:
  The delivery address on an order can be changed in Account settings
  until the order ships. The account owner must confirm the new
  delivery address from the link in the confirmation email.

The second version is longer and much more useful. Any passage cut from it still says what can be changed, where, until when, and by whom.

Structure and formatting that survive chunking

Structure helps the assistant find the right passage. Zendesk's formatting guidance for AI use is short and practical (Zendesk help):

  • Use clear headings and subheadings to break content into logical sections.
  • Use bullet points for facts and numbered lists for steps.
  • Present alternative solutions as separate instructions, not nested sub-steps.
  • Add written text for images, videos and diagrams, because the AI reads only text.
  • Keep tables simple, since information in tables is harder for a language model to interpret than sentences.

Headings carry a lot of weight. HelpDocs warns that headings such as "Overview" or "More information" tell a retrieval system nothing; if you cannot tell what a section covers from its heading alone, neither can the assistant (HelpDocs). Write headings that name the task or question: "Reschedule an appointment by phone" rather than "Phone".

Use the customer's words. If your team says "deprovision a seat" and customers ask how to "remove someone", the article should contain both phrasings. HelpDocs suggests taking the top search queries and checking whether each exact phrase appears anywhere in your content (HelpDocs). Zendesk adds that terms should be defined in full and acronyms spelled out on first use (Zendesk help).

Nothing important should live only in a picture. A price in a screenshot, a step shown only in a video, or a policy inside an attached file may be invisible to the assistant. HelpDocs suggests a direct test: ask the assistant about three facts that appear only in visuals, and add text for any it cannot answer (HelpDocs).

A simple article template that follows these rules:

# How do I reschedule an appointment?

You can reschedule an appointment online or by phone. [State the
rule, the deadline and any fee in this first paragraph.]

## Reschedule an appointment online
1. Open the booking confirmation email and select "Manage booking".
2. Choose a new date and time.
3. Select "Confirm". A confirmation email for the new time follows.

## Reschedule an appointment by phone
Call the front desk during opening hours and give the name on the booking.

## Rescheduling an appointment at short notice
[State the short-notice rule and who can make exceptions.]

Write procedures as steps an assistant can follow

Some assistants do more than answer questions. They take actions: look up an order, book a slot, start a return. For those, the knowledge base doubles as the assistant's instructions. OpenAI's guide to building agents recommends turning existing operating procedures, support scripts and policy documents into routines for the agent, and notes that in customer service these routines can roughly map to individual articles in a knowledge base (OpenAI).

The same guide gives three rules that apply to any procedure article:

  1. Break tasks into small, clear steps. Dense paragraphs leave room for misreading.
  2. Make every step a specific action or output. "Ask for the order number" or "check the delivery date" is better than "verify the details".
  3. Capture the edge cases. Say what to do when information is missing, when the customer asks something unexpected, or when the normal path does not apply.

Policies deserve the same treatment. A refund policy written as a paragraph of legal prose is hard for an assistant to apply correctly. Rewrite it as the conditions that decide the outcome: who qualifies, within what period, for which products, with what proof, and what happens in each case. Keep the original legal wording in a separate article if you need it, and make sure the two never disagree.

Write the escalation rule into the procedure itself. If refunds above a certain value need a manager, the refund article should say so in plain words, so the assistant hands the case to a person instead of approving it.

Keep it current and keep it fenced

A knowledge base that an AI reads is a production system. HelpDocs recommends treating it like one, with known owners, review cycles, access rules and a way to tell when it is wrong (HelpDocs). Stale content is the most common cause of an answer that is wrong on today's facts, because nothing announces that an article has aged.

Three habits keep it healthy:

  • Owner and review date on every article. Tie reviews to changes in the business: a price change, new hours or a revised policy should trigger an update the same day.
  • A gap review every week or two. Read the questions the assistant could not answer and the conversations staff had to correct. Zendesk notes that AI tools can help here by analyzing solved tickets to surface gaps and outdated articles (Zendesk).
  • Access rules where the content lives. An assistant will surface anything it can read. HelpDocs advises testing by asking a customer-facing assistant something only staff should know, and fixing any leak with permissions rather than by asking the AI to keep a secret (HelpDocs).

Finally, check the citations, not just the answers. Connect the assistant, ask five real questions, and look at which article each answer came from. A right answer drawn from the wrong source is a problem you want to find before your customers do.

FAQ

FAQ

How many articles do I need before launching an AI assistant?

Coverage matters more than count. Make sure your most common questions, drawn from tickets, calls and failed searches, each have one clear and current article. When the top twenty questions are covered well, an assistant can be useful; below that, its most common answer will be a hedge.

Can I just upload our existing documents as they are?

You can, but expect weaker answers. Long documents that bury answers deep in the text, duplicate versions of the same policy, and facts locked in images all reduce accuracy. A short cleanup pass that removes duplicates, adds descriptive headings and moves key facts into the first paragraph usually pays off quickly.

Should I write differently for the AI than for human readers?

Mostly no. The practices that help an AI, such as focused articles, direct answers, clear headings and plain language, also help people. The main differences are repeating nouns instead of using pronouns and repeating the topic in each section, which can feel slightly redundant to a human reader but makes each passage stand alone.

Can AI write the knowledge base for me?

AI can draft articles, rewrite sections and suggest headings, which saves a lot of time. It cannot know your business's facts, prices or policies, so a person who knows the business must check every draft. Treat AI as a fast first-draft writer and editor, not the author of record.

How do I know which articles are causing wrong answers?

Ask the assistant real questions and read the source it cites for each answer. Review the conversations where staff had to step in or correct the assistant, and trace each back to the article it used. The fix is usually a missing fact, an outdated article or a duplicate that contradicts the current one.

Sources

Sources

  1. https://support.zendesk.com/hc/en-us/articles/4408845739162-Optimizing-your-knowledge-content-for-generative-AI
  2. https://www.helpdocs.io/ai-knowledge-base/
  3. https://developer.nvidia.com/blog/finding-the-best-chunking-strategy-for-accurate-ai-responses/
  4. https://towardsdatascience.com/how-to-build-an-efficient-knowledge-base-for-ai-models/
  5. https://www.meilisearch.com/blog/rag-chunking-strategies
  6. https://openai.com/business/guides-and-resources/a-practical-guide-to-building-ai-agents/
  7. https://www.zendesk.com/service/help-center/ai-knowledge-base/
About the author

About the author

Antonio Evans
Antonio Evans

Antonio Evans is the founder of Quanta Intelligence and a fractional CTO who builds HIPAA-ready AI systems for health and life-science companies. Before that he was technical co-founder of FriendsEAT for twenty years, CEO of Socialdraft, and a data engineer at IBM. Antonio lives with his dog Santino in Lisbon, Portugal.

All articles