Demo Org
Insights
AI
Analyze
Overview
Cohorts
Reports
Experiment
Success metrics
Testing
Benchmark
Routing
Compare
Operate
Requests
Alerts
1
Caching
Settings
Install
API Keys
Team
Routing
Traffic split
Results in Compare
Smart routing
optimize for
Lowest cost
Fastest
Lowest error rate
every
h, ±
pp / step
Auto OFF
Select variant…
%
Select variant…
%
New variant
New pipeline
Save
On error
— what happens the moment a routed variant fails a request
Return the error
Fail fast and surface the provider error to the caller. Nothing is silently re-routed, so each variant's success/error stats stay exact.
Preserves experiment integrity
Cascade to a fallback
Retry the request on another routed variant until one responds, so the user always gets an answer.
Prioritizes availability
Cohort overrides
local
Add cohort override
No cohort overrides yet — the default split above applies to everyone.