VAPI•10mo ago

Voice cut off due to async tool call response

I have an async tool call navigateToUrl('url') which I use to redirect the user to a specific website when he's interested in a particular product. There he can find more information about the product or order it.
The tool call gets triggered correctly but the voice get's cut off when the tool call returns a success response after which the sentence sort of restarts.

Call Id: 604e7ddd-8cdc-4950-9879-47515319c7e8

FFloris I have an async tool call navigateToUrl('url') which I use to redirect the user ...

Duckie•3/4/25, 3:35 PM

It sounds like you're experiencing a frustrating issue with the voice getting cut off after the async tool call navigateToUrl('url')navigateToUrl('url') returns a success response. This is a common problem in voice AI applications, especially with async tool calls. Here are some steps you can take to troubleshoot and potentially resolve this issue:

Review Recent Changes: Check if there have been any recent changes to the configuration or logic that might affect how the assistant responds after the tool call. Ensure that the logic for providing feedback after tool calls is still intact.
Inspect Network and Environment: Make sure your network connection is stable and test the system in a different environment to rule out any device-specific issues.
Utilize Logs: Look at the logs for both VAPI and any other relevant services to see if there are error messages or warnings that could provide insight into the cut-off issue.
Suppress Tool Call Announcements: Consider adjusting backend settings to suppress the automatic success messages that might be interrupting the flow. This can help maintain a smoother conversation without unnecessary interruptions.
Assume Success in Conversation Flow: Design your conversation flow to assume success after the tool call, allowing the dialogue to continue without waiting for user confirmation.
Check Voicemail Detection Settings: If applicable, adjust parameters like machineDetectionSilenceTimeoutmachineDetectionSilenceTimeout to prevent premature cut-offs.

If these steps don't resolve the issue, it may be worth reaching out for further support or checking for any known bugs in the VAPI service that could be affecting your tool calls.

Let me know if you need more help with this!

Sources:

Troubleshooting Voice Cut-Off Issues in Async Tool Calls with VAPI

FFloris I have an async tool call navigateToUrl('url') which I use to redirect the user ...

Duckie•3/4/25, 3:35 PM

⤵️ Mention @Duckie for follow-ups 🐥

forward-apricotOP•3/4/25, 3:38 PM

This doesn't solve the issue

forward-apricotOP•3/5/25, 7:51 AM

@Shubham Bajaj Could you please look into this as the outcome of this will determine if we go with Vapi for our company or not

dangerous-fuchsia•3/6/25, 1:50 AM

@Floris looking into this.

dangerous-fuchsia•3/6/25, 2:09 AM

expectedexpected
The Aromatherapy Massage combines a relaxing massage with the therapeutic benefits of essential oils. It begins with a consultation to select oils that match your mood or health goals, such as lavender for relaxation or eucalyptus for respiratory support. ...more

actual

actual

with the therapeutic benefits of essential oils. It begins with a consultation to select oils that match your mood or health goals,

logs

logs

15:31:22:089 ElevenLabs (WebSocket #2) Received Non Audio Message. Message: {
"audio": null,
"isFinal": true,
"normalizedAlignment": null,
"alignment": null
}

15:31:17:550 ElevenLabs (Websocket #2) Pushing 101... "The Aromatherapy Massage combines a relaxing massage with the therapeutic benefits of essential oils."

There was an cutt off from 11labs side for The Aromatherapy Massage combines a relaxing massageThe Aromatherapy Massage combines a relaxing massage so I suggest

@Floris Give me some time to check 11labs team if its on their side. Let me know your thoughts on this.

forward-apricotOP•3/6/25, 7:26 AM

Thanks for looking into this @Shubham Bajaj I thought it was due to the async function call returning success and that's being fed into the llm or into 11labs which cuts off the sentence it's saying at that moment.

forward-apricotOP•3/6/25, 7:27 AM

It's not a one off, I can reproduce it each and every time the async function call is executed and a result is returned while the voice is talking

forward-apricotOP•3/6/25, 7:27 AM

I don't think the async function call result should stop the llm or voice from what it's doing

forward-apricotOP•3/6/25, 7:30 AM

An option to ignore tool call results, or to not feed it back into the llm/voice would work for me as a fix I guess

forward-apricotOP•3/10/25, 7:35 AM

Any news on this @Shubham Bajaj ?

Fforward-apricot An option to ignore tool call results, or to not feed it back into the llm/voice...

dangerous-fuchsia•3/11/25, 2:20 AM

Yeah set the tool to asyncasync.

dangerous-fuchsia•3/11/25, 2:21 AM

@Floris Apology for the delay in response. You can try now on your end it will work.

dangerous-fuchsia•3/11/25, 2:21 AM

Let me know how it goes.

forward-apricotOP•3/11/25, 9:11 AM

I'll test it today

forward-apricotOP•3/11/25, 2:48 PM

It's not fixed @Shubham Bajaj call id: a90e9a69-15b6-45e5-9700-ac1b5164a71c
The voice got cut off again when the second tool call responded while the voice was talking

forward-apricotOP•3/12/25, 8:49 AM

Could you look into this when you have a sec @Shubham Bajaj ?

forward-apricotOP•3/13/25, 9:53 AM

Any update on this, @Shubham Bajaj ? ^

dangerous-fuchsia•3/13/25, 9:01 PM

@Floris looking into it.

dangerous-fuchsia•3/13/25, 10:21 PM

@FlorisI re-examined it and realized I misunderstood it last time. After reviewing the call logs again, I couldn't reach the conclusion. I'll find its RCA, and get back to you works?

forward-apricotOP•3/14/25, 6:19 AM

Sure, I can also demo it real life or record a video if that helps?

VapiAPP•3/17/25, 9:58 AM

Floris, would it be possible to provide one more latest call_id that I can take a look into??

forward-apricotOP•3/18/25, 7:51 AM

Hi @Sahil, I got another one: 17574f7f-200a-4c3e-ad2b-ffc681dbecb0

The voice get's cut of when the async function call is triggered. It get's cut of at the "The sweet" part. I'm using the web integration to test and printed the transcripts:

VapiAPP•3/19/25, 12:28 AM

Hello Floris,

I believe you're using vapi.send to trigger a function when the user makes a selection correct?

If that's the case you'll need to add triggerResponseEnabled: false to the vapi.send message so that it doesn't interrupt the assistant.

vapi.send({ type: 'add-message', message: { role: 'system', // or 'user' depending on context content: 'Important context the assistant should know about but not respond to immediately' }, triggerResponseEnabled: false // This is the key parameter });

Could you test this and let me know if it resolves the behavior?

forward-apricotOP•3/19/25, 3:00 PM

Hi Mason,

No, I let the assistant trigger an async tool function when a guest request information about a specific product.
An url is passed as a parameter to that function which I use client side to navigate the guest to that url in an iframe.
I don't have the ability to use that triggerResponsseEnabled boolean I think.

forward-apricotOP•3/21/25, 8:56 AM

@Shubham Bajaj Any progress on this? Been going on quite some time now

VapiAPP•3/22/25, 2:02 AM

@Floris The issue lies in how the tool call responses are processed and fed back into the conversation flow, affecting the TTS (text-to-speech) stream.

The onToolCalls method is triggered when the LLM generates a tool call. For async tools, even though they're marked as async in the configuration (tool.async = true), the system is still capturing the response. This function feeds the tool call results back into the conversation buffer, which triggers a new LLM response.

Let me check with team regarding this, and ThankYou for bringing this to attention.

forward-apricotOP•3/24/25, 7:44 AM

No worries @Shubham Bajaj, any idea when this will be fixed?

VapiAPP•3/25/25, 2:22 AM

Your issue has been acknowledged, and it will be fixed by the end of this week.

forward-apricotOP•3/25/25, 7:29 AM

Nice, thank you @Shubham Bajaj please keep me posted

forward-apricotOP•5/12/25, 10:35 AM

Hi @Shubham Bajaj, I'm still experiencing this issue. Can it been resolved already? It been a month and a half ago since we last discussed

VapiAPP•5/15/25, 2:26 AM

Hey,

Could you please schedule a brief call at your convenience so we can discuss this matter in detail?

Kindly use the following link to book a suitable time: https://calendly.com/shubham-vapi/chat-30m.

Voice cut off due to async tool call response

Similar Threads

Similar Threads

Similar Threads