The fastest way to improve an AI calling campaign is to test one line at a time. Make two versions of your agent that differ in exactly one thing (usually the opening line), split the list randomly, run both at the same times, and compare the outcome rate on answered calls. Roll out the winner, then test the next line. Teams that do this steadily beat teams that rewrite the whole script every week.
Set up two script versions: Try Edesy free — Rs 50 free credit, no demo needed.
The method
- Pick one outcome (payment promised, booked, completed, qualified).
- Change one thing between version A and B.
- Split the list randomly into two equal halves.
- Run both at the same times, same calling window, same retries.
- Compare on answered calls, with a few hundred answered calls per version as a minimum.
- Roll out the winner; test the next line.
What to test, in order
| Test | Example |
|---|---|
| Opening line | "EMI reminder" first vs name + company first |
| The ask | "Will you pay by Friday?" vs "When can you pay?" |
| Offer wording | "Free specimen book" vs "book nominated by your students" |
| Language mode | Hinglish vs Hindi (comparison) |
| Call length | 3 questions vs 1 question + WhatsApp (30-second calls) |
| Calling time | Morning vs evening |
A worked example
A reminder campaign tests two openings on 2,000 contacts (1,000 each):
- A: "Namaste, main XYZ Finance ki taraf se bol rahi hoon. Aapki EMI ke baare mein..."
- B: "Namaste {{name}} ji, aapki {{amount}} rupaye ki EMI {{due_date}} ko due hai..."
Compare payment promised ÷ answered calls for each. If B is clearly higher across enough answered calls, B becomes the default and the next test changes the ask.
Read the failures too
Beyond the headline outcome, compare drop reasons and where calls ended for each version. See why AI calls fail: drop reasons by script stage. A version that wins on outcomes but gets more complaints isn't a winner.
Common mistakes
- Changing several lines at once.
- Running A in the morning and B in the evening.
- Declaring a winner after 50 calls.
- Comparing on dialled calls instead of answered calls.
Cost
A/B tests cost nothing extra: the same calls you'd make anyway, at Rs 4-6 per started minute on Edesy depending on your prepaid top-up, with unanswered calls free.
Try it
Create a free account, duplicate your agent, change the opening line, and split your next list in two.