lm-sys/RouteLLM: A framework for serving and evaluating LLM routers - save LLM costs without compromising quality

github.com

saved by: 0 people
related read on: magnitudedev/magnitude: Open source inference engine for ... from the discussion