LLMOps
LiteLLM 1.98 RC Adds Shadow Evaluation for Auto Router and Fixes System Prompt Cost Misclassification
The new release can copy a small sample of real requests to a candidate router, then use a blinded judge to compare responses without affecting production results. Complexity classification also no longer treats a fixed agent system prompt as a signal of each request’s technical difficulty.