A system prompt is a single string that carries role, tone, tool guidance and every business rule you have ever written. The Tetrate guide on system prompts describes them as persistent context that defines role, behavior and boundaries, the layer that keeps responses consistent across a whole session the system prompts guide. That is exactly the wrong container for rules that change per customer, per region or per quarter.
Two failure modes show up quickly. First, edits become surgical in the worst way: to change one threshold you re-flow paragraphs, and a reviewer cannot tell whether you altered behavior or just wording. Second, long prompts lose their own instructions. Practitioners report that models "forget" format and constraint instructions placed thousands of tokens earlier, which is why one write-up recommends restating critical requirements immediately before generation the study on stable output format in long contexts. A rule buried on line 40 of a system prompt competes with everything after it.
There is also a governance argument. Thoughtworks' write-up on Structured Prompt-Driven Development treats prompts as first-class artifacts kept with the code in version control so changes stay reviewable and reusable the SPDD article on martinfowler.com. A rules table is that idea applied at field level: the artifact you review is structured, small and diffable.
Decision rule: if a rule names a field, compares a value, or selects an action, it belongs in the table. If it describes persona, tone or output schema, it belongs in the system prompt. If it does both, split it.



