VAPI•6mo ago

success evaluation false after 3 minute convo

call id: 9777ab09-113c-4b24-8af0-3d1981bfbf1b
Jul 10, 2025, 10:31
Outbound

my prompt specifies any call that is answered by a real person a pass (true)
This call was a fail (false), it may be a timeout issue, but I can not see the reason in the logs.

I just need to understand the reason for the result.

VapiAPP•7/12/25, 8:30 AM

Hey Ham,

Thank you for reaching out. Please note that our team does not operate over the weekend. We’ll be back in the office on Monday and will dive straight into your issue then to determine the best way forward.

Regards,

Shubham Bajaj

Solutions Engineer

worthy-azureOP•7/14/25, 4:29 PM

here is another call Id that happened today, I increased the timeout to 30 seconds so I do not think it timed out.

Maybe I am going about this the wrong way, I simply need a true false if the contact picked up and talked to the Agent

e3083097-814e-4968-afcc-6dac3e178fbb

worthy-azureOP•7/14/25, 4:29 PM

Success evaluation prompt:

You are an expert call evaluator. you will be given a transcript of the call and the system prompt of the ai participant.
The objective is to have a meeting the contact booked, the results of the meeting are not important.
the objective is a pass if the contact attended the meeting.
no connection , no answer, voicemail are all fails.

worthy-azureOP•7/14/25, 4:30 PM

Success Evaluation Rubric

PassFail
A simple 'true' if call passed, 'false' if not.

Success evaluation request timeout in seconds.
30

Ccomprehensive-tomato Hey Ham, Thank you for reaching out. Please note that our team does not operate...

worthy-azureOP•7/14/25, 8:57 PM

thanks for the reply, my OP was on Thursday hopefully someone can help this week

VapiAPP•7/15/25, 10:46 PM

Hey Ham,

Thanks for reaching out! We're currently swamped with a bunch of tickets and it's taking us longer than usual to get back to everyone. I know waiting isn't fun, but we want to make sure we give your issue the attention it deserves rather than rushing through it.

We'll circle back with you soon to get this sorted out.

worthy-azureOP•7/17/25, 2:30 PM

updated the prompt

You are an expert call evaluator. you will be given a transcript of the call and the system prompt of the ai participant.
The objective is to have a conversation with the contact.
What is said in the conversation is not relevant.
Did the AI agent talk to someone on the call? yes = true, no = false

VapiAPP•7/19/25, 6:03 PM

Hey Ham,

I sincerely apologize for the delay in our responses this week. We experimented with some process adjustments that didn’t work as intended, and unfortunately, this caused some disruptions. That’s entirely my responsibility.

Just a quick note—our team is unavailable on weekends. However, if something urgent or critical comes up, feel free to reach out to me directly, and I’ll assist you.

The support issues will be resolved in the coming weeks, and starting Monday, you can expect more consistent and improved support. Thank you so much for your patience and for continuing to stick with us!

success evaluation false after 3 minute convo

Similar Threads

Similar Threads

Similar Threads