- Early routers were stateless, simply scoring the prompt and choosing an LLM
- For agentic workflows, can make better decisions with more context of the larger problem, not just the current prompt
- Using an expensive LLM as a planner and a cheaper LLM for individual tasks is a simple, hard-coded form of adding context to routing decisions
- Optionally, Prompt A and its response may modify the context for subsequent prompts