other-emerald•3w ago
VAPI delays between user speech stopped and Model request.
There are VAPI delays between user speech stopped and Model request. Below are logs from a recent call
08:50:23:170
(+01:12:176)
[CHECKPOINT]
User speech stopped
08:50:24:152
(+01:13:158)
[CHECKPOINT]
Model request started
The one second gap between speech stopped and model request makes the overall gap to be over 2 seconds which makes the whole experience unnatural.
This happens multiple times in a single call.
Is there something that can be done to improve this experience?
Example Call ID 0d960b14-aa3d-428f-b02c-bb554c390de9
4 Replies
Sorry for the delays as we are currently experiencing an extremely high volume of support requests. The team will get back to you.
other-emeraldOP•7d ago
Hi, could you please let me know how long would it take to get to this.
Hey! I checked the logs for your call. The short delay you noticed between finishing your speech and the assistant’s response is due to endpointing latency. This is an intentional pause to make sure you’ve finished your turn before the model request is sent.
- For longer utterances, the timeout can be ~1.5s.
- For shorter ones, it’s usually just a few hundred ms.
This behavior is expected and depends on the configured endpointing timeout.
other-emeraldOP•5d ago
Thanks Aditya. Isn't [CHECKPOINT] User speech stopped indicative of the endpoint detection. This is the timestamp when configured endpointing detected user speech as already stopped.
The gap between endpoint checkpoint and model call should be 50-100ms as it is in most cases. It is occasionally during the same call that agent takes long pauses - that too at end of sentence endpoints. Issue is 100% reproducible in every call - happens at least 2-3 times