LLM Routing

Bandit-Based, Budget-Aware LLM Routing with Preference-Informed LinUCB (PILOT)

Sep 1, 2025206

Treat LLM routing as a contextual bandit and use a preference-informed LinUCB plus a knapsack budget policy to adaptively, cost-effectively pick the right model per query.

LLM Routing Reinforcement Learning AI Infrastructure Algorithms & Optimization

Reading List

Bandit-Based, Budget-Aware LLM Routing with Preference-Informed LinUCB (PILOT)