☰
←
Previous
8 / 21
Next
→
⛶
All Slides
✕
1.
LLM Routing
2.
Introduction
3.
A Brief History
4.
Goal
5.
Metrics
6.
Workflow Options
7.
Statefulness
8.
Learning
9.
Retraining
10.
Decision Algorithms
11.
Benchmarks
12.
Oracle Performance
13.
Failure Modes
14.
FrugalGPT
15.
RouteLLM
16.
LLMRouter
17.
vLLM Semantic Router
18.
Where This Leaves Us
19.
Reading List — Early / Foundational
20.
Reading List — More Recent
21.
References
Router taxonomy
Learning
Simpler is to pre-train a router and use frozen model (offline learning)
Training data
Router (training)
Prompt
Frozen router
Decision
copy (freeze)
(unchanged after copying)
Some papers examine algorithms that learn as you use models and provide preference data (online learning)
Prompt
Router
LLM
Answer + feedback
update router