harsh-harlequin•16mo ago
Reduce the latency of 11labs
Hi,
My Agent is speaking french, is it possible to reduce the latency of 1200ms via eleven labs ?
I'm using the "TTS: 11labs Multilingual V2" otherwise, the agent will speak in english / german or something else
The current latency is really long during the call, often around 2000ms for 1650ms estimated
Is there a way ?
Matthieu
7 Replies
Hi @Matthieu GARCIA, I'm an AI assistant for Vapi. I'll analyze available sources and get back to you shortly.
-----------------------------
While I generate an answer, here are some sources that might be helpful:
* Web Calling
* Inbound Calling
* Dashboard
* Outbound Calling
-----------------------------
Answer
Hi Matthieu,
Reducing latency with Eleven Labs, especially for multilingual TTS, can be challenging due to the inherent complexities of handling multiple languages and the quality of the text-to-speech synthesis. While Vapi typically offers optimizations to reduce latency, specific adjustments with Eleven Labs or other TTS providers might not be directly controllable through Vapi's standard settings (1) .
Here are a few general tips that might help reduce latency:
1. Optimize Network Conditions: Ensure that your network connection is stable and fast. Network issues can significantly impact latency.
2. Server Proximity: Using servers geographically closer to your user base can reduce latency. Vapi uses colocated servers to shave off milliseconds of latency.
3. Simplify TTS Demands: Sometimes, reducing the complexity of the text being converted can help. Simplifying sentences or using less complex language structures might slightly reduce processing time.
For the specific issue with Eleven Labs, you might want to check their documentation or support for any settings or recommendations specific to reducing latency in multilingual setups.
If these tips don't help, consider reaching out directly to Eleven Labs for more detailed assistance on their multilingual TTS configurations.
xenial-black•16mo ago
Use Azure.
harsh-harlequinOP•16mo ago
Yep. But the French voices are very bad. The best way is to create one, but it’s very complex. Do you know a DIY video or article to explain how to create it on Microsoft azure ?
xenial-black•16mo ago
Unfortunately, no you need to search on google for it.
harsh-harlequinOP•16mo ago
i did, i will stay with openai voices
like-gold•16mo ago
No really good choice for the moment @Matthieu GARCIA