AI agents

Structuring prompts for cache and token budgets

• Designing Prompts for Cacheability: A Practical Guide
• Splitting a Prompt Into a Cacheable Prefix and a Volatile Tail
• Trimming a Prefix Without Busting the Cache
• A Lint Rule for Prompt Edits That Change Token Count
• A Retrieval Pipeline That Emits a Stable Prefix
• A Token Budget per Prompt Region
• Ordering Context for Cache Hits
• Ordering Retrieved Chunks for a Stable Prefix
• Prefix Caching and Rerankers: The Ordering Conflict
• Prompt Compression Techniques for Long Contexts
• Splitting a Prompt Into Cacheable and Length-Sensitive Parts
• System Prompts for Multi-Turn Agents and Cache
• Testing That a Prompt Edit Preserved the Cache Boundary
• Two Clocks, One Prompt: Reconciling Local and Provider Cache TTLs
• Versioning a Stable Prompt Prefix Without Breaking Cache
• Where to Split the Cacheable Prefix When Tools Change