Testing and Evals

Know How the Agent Behaves Before a Customer Calls

A prompt change that fixes one conversation can quietly break three others. Edesy gives you a Test Center to talk to the agent yourself, eval suites that replay scripted conversations and score them, and prompt versions and config snapshots so you can see what changed and roll back.

How testing and evals work on Edesy

Edesy lets you test a voice agent before it takes real calls. The Test Center runs a browser voice call, a text chat or a test call to your phone, with a variable tester and saved scenarios. Evals run suites of scripted conversations in text mode and score each one with assertions and an LLM judge.

Testing and evals facts

What ships on the Edesy voice agent platform today

ItemDetails
Test CenterBrowser voice call, text chat, or a test call to your phone
Variable testerFill the agent's {{variables}}, such as a name or order ID, before each test
ScenariosRun the agent through common caller situations again after each change
Eval suitesGroups of cases, each with draft, active or archived status
Eval casesScripted caller turns, optional mocked tool results, a severity from low to critical, and tags
AssertionsReply contains or does not contain, tool called or not called, tool argument equals, minimum turns, maximum latency, LLM rubric
LLM judgeScores rubric assertions such as "the agent confirmed the date before booking"
ModeSimulated conversations in text mode; voice quality is tested in the Test Center
ResultsPass rate, per-check evidence, transcript and tool trace for every case
VersionsPrompt version history with diff and rollback; config snapshots you can restore

A Safe Way to Change an Agent

Test, score, compare, then ship

  1. Step 1 of 5: 1. Talk to the agent in the Test Center

    Start a browser call or a text chat, fill test values in the variable tester, and listen for problems a transcript would not show.

  2. Step 2 of 5: 2. Write eval cases for the calls that matter

    Script the caller turns for each case, mock tool results if needed, and add checks: the reply must mention the refund window, the booking tool must be called, and so on.

  3. Step 3 of 5: 3. Run the suite

    Each case runs as a simulated text conversation. Deterministic checks pass or fail, and the LLM judge scores rubric checks.

  4. Step 4 of 5: 4. Read the evidence

    Every result shows the transcript, the tool trace and the evidence for each check, so a failure points to the turn that caused it.

  5. Step 5 of 5: 5. Compare versions and roll back if needed

    Prompt version history shows a diff of what changed. Restore an earlier version or a config snapshot if the new one is worse.

Tools for Testing an Agent

From a quick listen to a repeatable suite

Browser Voice Call

Talk to the agent from your browser with the real voice, model and tools, without using a phone number.

Text Chat

Chat with the agent in text to check logic and wording quickly, without audio.

Variable Tester

Fill {{variables}} such as customer name, amount due or order ID, so you test the agent the way a campaign will call it.

Eval Suites and Cases

Group cases into suites, mark severity, and keep a regression set you can run after every change.

Assertions and LLM Judge

Mix exact checks (contains, tool called, tool argument) with rubric checks scored by an LLM judge.

Prompt Versions and Snapshots

See a diff between prompt versions, roll back, or restore a saved config snapshot.

Testing and Evals FAQ

How to check an agent before launch

Simple, Transparent Pricing

From ₹4/min on plans and credit packs, ₹6/min pay as you go. Bring your own AI keys for a platform fee from ₹1/min. New accounts get ₹50 free credit. Prices exclude 18% GST.

Pay As You Go
₹6/ minute + telephony
Start immediately, pay per minute
  • No monthly commitment
  • Standard AI providers included
  • Twilio, Exotel, Plivo, Vobiz or SIP trunk
  • Call analytics dashboard
  • 75+ languages, 14 Indian
  • ₹50 free credit on sign-up
Get Started
Most Popular
Pro
₹1,499/ month
For growing businesses
  • ₹5/min platform rate
  • 300 minutes included
  • Unlimited agents
  • API access
  • Webhook integrations
  • Up to 5 phone numbers
Get Started
Max
₹4,999/ month
For high-volume operations
  • ₹4.50/min platform rate
  • 1,100 minutes included
  • Everything in Pro
  • 20% off premium add-ons
  • Up to 15 phone numbers
Ultra
₹14,999/ month
Maximum value for enterprises
  • ₹4/min platform rate, the lowest
  • 3,500 minutes included
  • Everything in Max
  • 30% off premium add-ons
  • Up to 50 phone numbers
  • SLA available
Bring Your Own Keys
₹1/ minute + your AI & telephonyplatform fee, all your own keys
Use your own STT, LLM & TTS keys
  • ₹1/min with all your own keys, ₹1.20 with some
  • Bring your own OpenAI, Gemini, Deepgram, ElevenLabs, Sarvam or Cartesia keys
  • Pay AI providers directly at your own rates
  • Up to 10 Google AI Studio keys in a pool
  • Best for high volume
See BYOK Pricing

Planning a launch?

Tell us about the calls your agent will handle. We reply within one working day with a test plan and setup advice.

Test Your Agent Before It Goes Live

Build an agent, talk to it in the Test Center and set up your first eval suite. New accounts get ₹50 free credit on sign-up, no card needed.

Hear AI Voice Assistant in Action

Real demo calls showcasing low latency and natural conversations in multiple Indian languages

Hindi + English
Lead Qualification

B2B Lead Qualification - Flipkart Gift

AI voice agent qualifying B2B leads for corporate gifting. Ultra-low latency with 1-2 second response time. Bilingual conversation in Hindi and English.

1-2 second response latencyBilingual Hindi + English

Audio player powered by Google Drive

Open in Drive
Malayalam
Education

Institute Admission - Malayalam

AI voice agent handling admission inquiries and appointment booking for educational institutes in Malayalam language.

Malayalam language supportEducation sector use case

Audio player powered by Google Drive

Open in Drive
Tamil
Education

Institute Admission - Tamil

AI voice agent handling admission inquiries and appointment booking for educational institutes in Tamil language.

Tamil language supportEducation sector use case

Audio player powered by Google Drive

Open in Drive
Assamese
Lead Qualification

Solar Company Lead Qualification - Assamese

AI voice agent qualifying leads for solar installation company in Assamese language. Natural conversation flow with product inquiry handling.

Assamese language supportSolar/renewable energy sector

Audio player powered by Google Drive

Open in Drive
Bengali
Appointment Booking

Hospital Appointment Booking - Bengali

AI voice bot helping patients book hospital appointments in Bengali. Natural conversation with availability checking and confirmation.

Bengali language supportHospital appointment booking

Audio player powered by Google Drive

Open in Drive
Hindi
Appointment Booking

Hospital Appointment Booking - Hindi

AI voice bot helping patients book hospital appointments in Hindi. Handles doctor selection, time slot booking, and confirmation.

Hindi language supportHospital appointment booking

Audio player powered by Google Drive

Open in Drive
Telugu
Appointment Booking

Hospital Appointment Booking - Telugu

AI voice bot helping patients book hospital appointments in Telugu. Natural conversation flow for healthcare scheduling.

Telugu language supportHospital appointment booking

Audio player powered by Google Drive

Open in Drive

Simple, Transparent Pricing

From ₹4/min on plans and credit packs, ₹6/min pay as you go. ₹50 free credit on sign-up.

Pay As You Go
₹6/ minute + telephony
Start immediately, pay per minute
  • No monthly commitment
  • Standard AI providers included
  • Twilio, Exotel, Plivo, Vobiz or SIP trunk
  • Call analytics dashboard
  • 75+ languages, 14 Indian
  • ₹50 free credit on sign-up
Get Started
Most Popular
Pro
₹1,499/ month
For growing businesses
  • ₹5/min platform rate
  • 300 minutes included
  • Unlimited agents
  • API access
  • Webhook integrations
  • Up to 5 phone numbers
Get Started
Max
₹4,999/ month
For high-volume operations
  • ₹4.50/min platform rate
  • 1,100 minutes included
  • Everything in Pro
  • 20% off premium add-ons
  • Up to 15 phone numbers
Ultra
₹14,999/ month
Maximum value for enterprises
  • ₹4/min platform rate, the lowest
  • 3,500 minutes included
  • Everything in Max
  • 30% off premium add-ons
  • Up to 50 phone numbers
  • SLA available