Total users
124
across 3 cohorts
Avg success rate
16.7%
weighted to your success metric
Best cohort
Free
19.8% success rate
Routing opportunity
Free
+6.2pp with 빠른 상담
| Cohort | 쇼핑 상담claude-sonnet-4-6 current default | 빠른 상담claude-haiku-4-5 | Route to |
|---|---|---|---|
Enterprise 19 users | 0.0% | 12.8% | 빠른 상담 |
Free users convert +6.2pp higher on Engagement with the 빠른 상담 variant than with the current default (쇼핑 상담). Route this cohort separately to capture the lift.
| Cohort | Users | Success rate | Avg calls / user | Cost / user | Cost / outcome | Best variant |
|---|---|---|---|---|---|---|
Enterprise | 19 | 6.1% | 2.5 | $0.004 | $0.027 |
Pro 23 users | 0.0% | 22.1% | 빠른 상담anthropic:claude-haiku-4-5 +22.1pp vs default |
Free 82 users | 16.7% | 22.9% | 빠른 상담anthropic:claude-haiku-4-5 +6.2pp vs default |
Pro | 23 | 14.5% | 2.7 | $0.003 | $0.008 | 빠른 상담anthropic:claude-haiku-4-5 |
Free | 82 | 19.8% | 2.5 | $0.005 | $0.009 | 빠른 상담anthropic:claude-haiku-4-5 |