Why it matters
Different workloads can have different cost, quality, and policy needs. Routing can help teams match a request to an approved model path.
How it works
A route profile can specify model choices and fallback paths. Its behavior depends on configured rules, provider access, and the workload requirements.
How Halo approaches it
Halo supports configurable route profiles, model catalogs with pricing, and fallback paths in the model gateway. Cost-aware routing offers savings potential without a guaranteed percentage.