Testing and verification for AI coding agents
Acceptance checks
Acceptance checks for AI agent tasks
- A Test List That Survives an Agent's Own Edits
- How to Write Acceptance Checks an Agent Can Run Itself
- Turning a Manual QA Checklist into Agent-Runnable Checks
- What an Acceptance Check Costs in Command Time and Tokens
- Writing Acceptance Checks an Agent Can Run Itself
- A Characterization Run in CI: Cost, Time and What to Cache
- A Lint Rule as a Test for Agent Output
- A Test Coverage Budget for Agent Work: When to Stop Adding Tests
- All of Acceptance checks
Mutation testing
Mutation testing and test strength
- Assertions That Resist Weakening: A Pattern Library
- How to Spot a Test That Passes for the Wrong Reason
- Mutation Testing on a Budget: Picking the Lines to Kill
- Trimming Mutation Scope: Files, Operators and Lines
- When an Agent Writes the Mutant: Prompt and Sandbox
- A Mutation Score That Won't Mislead: Choosing the Denominator
- Assertion Density per Changed Line: Setting a Floor and Measuring
- Assertions That Survive a Mutant: A Pattern Library
- All of Mutation testing
Test fixtures
Fixtures and seed data for agent tests
- A Fixture Manifest an Agent Cannot Rewrite: Paths and Hashes
- Costing a Contract Test Suite: Stubs Versus Live Runs
- Indexing for a Retrieval Eval: What to Store So Reruns Are Cheap
- One Agent, One Database: Fixtures and Seed Data for Parallel Work
- A Manifest for Fixtures and Seed Data an Agent Cannot Rewrite
- A Separate Schema per Agent: Connection Strings and Teardown
- Fixtures or Factories: Which Survives a Parallel Agent Suite
- Parallel Migrations Without Lock Contention
- All of Test fixtures
Flaky tests
Taming flaky and unreliable agent tests
Codebase analysis
Static analysis and codebase mapping
- Using AI Coding Agents on a Legacy Codebase
- A Call Graph Diff an Agent Runs Before It Edits
- A Guard Test That Fails When a Refactor Adds an Indirect Caller
- Finding Callers a Static Graph Misses: Dispatch and Reflection
- How to Map a Codebase Before an Agent Touches It
- Mapping Call Sites Before an Agent Edits a Shared Function
- A Pre-Edit Checklist for Any Function with More Than Five Callers
- Auditing an Agent-Built Map: Finding Stale and Missing Edges
- All of Codebase analysis