mute-gold•4mo ago

Switching languages on the run

Im wondering if any of you guys worked on a "multilingual" agent, basically if the customer speaks in english, it answers in english if the customer speaks in german, it answers in german any way of doing this ?

9 Replies

Vapi Support Bot•4mo ago

Yes, you can build a multilingual agent in Vapi!
Set your assistant's transcriber to a provider like Google or Deepgram that supports multilingual transcription. Vapi will detect the spoken language and, if you use the contents property for messages, will automatically translate responses to match the user's language.
Example configuration for a multilingual transcriber:

"transcriber": {
  "provider": "google",
  "model": "default",
  "language": "multilingual"
}

"transcriber": {
  "provider": "google",
  "model": "default",
  "language": "multilingual"
}

See the multilingual support docs for more details. Sources: - Multilingual Support Documentation - Changelog October 25, 2024 - Google Transcriber Setup

⤵️ Mention @Vapi Support Bot for follow-ups 🐥

rival-black•4mo ago

By detecting the user’s language, dynamically adjusting prompts, and using multilingual transcription and voice synthesis services, you can build a Vapi assistant that responds in the user’s language.

Vapi Support Bot•4mo ago

Absolutely, you can build a multilingual agent in Vapi! By configuring your assistant to use a transcriber provider like Google or Deepgram that supports multilingual transcription, Vapi can detect the language your customer is speaking. If you use the contents property for messages, the assistant will automatically translate its responses to match the user's language. This means your agent can seamlessly switch between languages like English and German during a conversation, responding in whichever language the customer uses. Absolutely, you can build a multilingual agent in Vapi! By configuring your assistant to use a transcriber provider like Google or Deepgram that supports multilingual transcription, Vapi can detect the language your customer is speaking. If you use the contents property for messages, the assistant will automatically translate its responses to match the user's language. This means your agent can seamlessly switch between languages like English and German during a conversation, responding in whichever language the customer uses. Absolutely, you can build a multilingual agent in Vapi! By configuring your assistant to use a transcriber provider like Google or Deepgram that supports multilingual transcription, Vapi can detect the language your customer is speaking. If you use the contents property for messages, the assistant will automatically translate its responses to match the user's language. This means your agent can seamlessly switch between languages like English and German during a conversation, responding in whichever language the customer uses.

mute-goldOP•4mo ago

@Kings_big💫 uhm can you elaborate please?

rival-black•4mo ago

I meant you can make a multilingual Vapi assistant by enabling auto language detection in the transcriber, dynamically adjusting prompts based on the detected language, and selecting matching voice synthesis for natural responses. https://docs.vapi.ai/customization/multilingual

Multilingual | Vapi

Set up multilingual support for your assistant

mute-goldOP•4mo ago

i see that link updates stuff before startging the call { "voice": { "provider": "azure", "voiceId": "es-ES-ElviraNeural" } } my idea is to switch the language once the call has already started, sorry for the insitence but i do not yet understand how to do so ! thank you so much for your time and help with multilingual i mean dynamic language switching during calls

Sahil•4mo ago

Use these settings for multilingual assistant:

Model: Any
Transcriber: Deepgram - Multi
Voice: 11labs - eleven_turbo_v2_5

Model: Any
Transcriber: Deepgram - Multi
Voice: 11labs - eleven_turbo_v2_5

mute-goldOP•4mo ago

thank. you kyle !

unwilling-turquoise•3mo ago

yes only the workflow use of google is not posible because it is done for the last 6 days...

Switching languages on the run

Did you find this page helpful?