VAPI•2y ago

Lag in outbound call in bot response

When using outbound communication with GPT-3 and GPT-4, there's a delay of around 4 seconds or more before the bot responds to the user's initial "hello." why ?

and but with inbound no such type of delay i am facing

call_id: c3a289f2-8c7a-4b79-987a-3b551c296a52

Ask Inkeep•5/8/24, 6:51 AM

Hi @Tech@, I'm an AI assistant for Vapi. I'll analyze available sources and get back to you shortly.

Ask Inkeep•5/8/24, 6:51 AM

-----------------------------
While I generate an answer, here are some sources that might be helpful:

Outbound Calling
Inbound Calling
Outbound Sales Example
Web Calling
-----------------------------

Ask Inkeep•5/8/24, 6:51 AM

Answer

The delay you're experiencing in outbound communication using GPT-3 and GPT-4 models before the bot responds to the initial "hello" might be related to several factors, including the initial processing time required for speech recognition (transcription), language model inference, and generating the response through text-to-speech (TTS). Outbound calls, depending on the setup, may also introduce slight delays as the system prepares and processes the call initiation and assistant activation.

For inbound calls, the system might be more optimized or in a ready state to process incoming audio signals immediately, which could explain why you're not facing the same delay. Additionally, different configurations or optimizations specific to inbound versus outbound scenarios within the Vapi platform could also contribute to this difference in response times.

It's also worth noting that discussions on the Vapi Discord forum have highlighted cases where response delays were observed, suggesting that fine-tuning the prompt or exploring different configurations might help mitigate this issue. However, specific details or solutions to eliminate the delay completely were not provided in the available information sources supportAI hallucinates and triggers the function 9/10 times RIGHT AFTER the first message for no reason supportDelay in response after answering the call. .

Given these insights, it's recommended to review the assistant's configuration and explore ways to optimize the prompt or other settings to reduce latency. If the issue persists, it may be beneficial to consider consulting the Vapi documentation or reaching out to the Vapi community for more targeted advice on minimizing delays in outbound communication scenarios.

Sources
[1] AI hallucinates and triggers the function 9/10 times RIGHT AFTER the first message for no reason
[2] Delay in response after answering the call.

living-lavender•5/8/24, 7:32 AM

Vapi Office Hour is live. You can ask this question over there @Tech@

scattered-tealOP•5/8/24, 8:09 AM

@Sahil Hi, why this is happening with outbound call , after user say "hello" bot take 4 to 5 sec to response

living-lavender•5/8/24, 8:10 AM

Please join our Discord channel at https://discord.gg/Ebm6YrQb?event=1236504144794222612 and ask your question there. Sagar is an expert in addressing queries about latency and related topics. @Tech@

scattered-tealOP•5/8/24, 8:11 AM

sure, thank you

Sscattered-teal @Sahil Hi, why this is happening with outbound call , after user say "hello" bot...

wet-aqua•5/9/24, 8:43 AM

is there a solution for that - have the same issue

worthy-azure•7/18/24, 10:11 AM

Yea got a similar issue. It's almost like it's warming up. Once it gets going it's fine but the first 10 sec there's massive lag.

Wworthy-azure Yea got a similar issue. It's almost like it's warming up. Once it gets going it...

dangerous-fuchsia•7/18/24, 9:59 PM

@Darnasis can you please create a issue and share call id.

skinny-azure•6/12/25, 9:59 PM

was there a resolution to this? i have this issue too.

KyleAPP•6/13/25, 2:36 AM

This ticket has been marked as solved, and as a result, you will no longer receive any further responses. Kindly create a new support ticket to escalate your inquiry. 

Lag in outbound call in bot response

Answer

Similar Threads

Similar Threads

Answer

Similar Threads