Total users
124
across 3 cohorts
Avg success rate
14.3%
weighted to your success metric
Best cohort
Free
17.4% success rate
Routing opportunity
Free
+9.5pp with 빠른 상담
| Cohort | 쇼핑 상담claude-sonnet-4-6 current default | 빠른 상담claude-haiku-4-5 | Route to |
|---|---|---|---|
Enterprise 19 users | 0.0% | 10.3% | 빠른 상담 |
Free users convert +9.5pp higher on Engagement with the 빠른 상담 variant than with the current default (쇼핑 상담). Route this cohort separately to capture the lift.
| Cohort | Users | Success rate | Avg calls / user | Cost / user | Cost / outcome | Best variant |
|---|---|---|---|---|---|---|
Enterprise | 19 | 4.7% | 2.6 | $0.005 | $0.036 |
Pro 23 users | 0.0% | 17.3% | 빠른 상담anthropic:claude-haiku-4-5 +17.3pp vs default |
Free 82 users | 12.8% | 22.3% | 빠른 상담anthropic:claude-haiku-4-5 +9.5pp vs default |
Pro | 23 | 11.2% | 2.7 | $0.003 | $0.011 | 빠른 상담anthropic:claude-haiku-4-5 |
Free | 82 | 17.4% | 2.6 | $0.005 | $0.011 | 빠른 상담anthropic:claude-haiku-4-5 |