AI agents

Routing LLM tasks between models and code

• Classifying Requests Before They Reach the Router
• Routing Logic for LLM Tasks: Rules, Thresholds and Fallbacks
• Signals a Router Can Read Before Any Model Call
• When to Let the Model Choose the Tool vs. When to Route in Code
• Config Format for Routing Rules: Fields, Defaults, Validation
• Logging the Cap Decision per Call
• Placing the Router: Gateway, Service or Prompt
• Routing by Data Sensitivity: Where a Prompt May Go
• Routing Work Between a Model and a Person: Thresholds and Queues