VAPI•2y ago

Azure voice switching to english while enumerating ID

Hi, i'm using fr-FR-RemyMultilingualNeural voice from azure. I need the agent to enumerate some strings that are customers ID's like AB123. My problem is the voice is switching to english while enumerating this, any way i can fix it ?

Vapi•8/1/24, 1:44 PM

@hugopdvn
Hello! It sounds like you're encountering a language switching issue with the Azure voice model when it comes to enumerating customer IDs. To maintain the French pronunciation for alphanumeric strings like "AB123," you can try using the Speech Synthesis Markup Language (SSML) to specify the language context for those strings. Here's an example of how you might format your SSML:

<speak version="1.0" xmlns="http://www.w3.org/2001/10/synthesis" xml:lang="fr-FR">
    <voice name="fr-FR-RemyNeural">
        Voici l'ID du client: 
        <say-as interpret-as="characters">AB123</say-as>
    </voice>
</speak>

<speak version="1.0" xmlns="http://www.w3.org/2001/10/synthesis" xml:lang="fr-FR">
    <voice name="fr-FR-RemyNeural">
        Voici l'ID du client: 
        <say-as interpret-as="characters">AB123</say-as>
    </voice>
</speak>

By using the <say-as><say-as> tag with the interpret-as="characters"interpret-as="characters" attribute, you can instruct the voice model to spell out the ID character by character, which can help maintain the correct language pronunciation.

If you're still experiencing issues, you might want to check the documentation for the specific voice model you're using or reach out to Azure support for more detailed guidance on handling multilingual content.

Vapi•8/1/24, 1:44 PM

You can continue this conversation by mentioning me in the message.

military-pinkOP•8/1/24, 1:46 PM

@Vapi Should I use this syntax into my script ?

Vapi•8/1/24, 1:46 PM

@hugopdvn
Yes, incorporating the SSML syntax into your script can help control the pronunciation and language behavior of the text-to-speech engine. By using SSML tags, you can specify that certain parts of your script should be read in French, even if they contain alphanumeric strings like customer IDs.

Here's a quick guide on how to use the SSML syntax in your script:

Wrap your entire speech output in <speak><speak> tags.
Specify the language and voice using the <voice><voice> tag and the xml:langxml:lang attribute.
Use the <say-as><say-as> tag with the interpret-as="characters"interpret-as="characters" attribute for alphanumeric strings to spell them out.

Make sure to replace "AB123" with the actual customer ID you want to enumerate. If you have multiple IDs, you can repeat the <say-as><say-as> tag for each one.

If you're not sure how to integrate SSML with your specific setup or if you need further assistance, please let me know, and I'll be happy to help!

military-pinkOP•8/1/24, 1:50 PM

that doesnt work

Mmilitary-pink Hi, i'm using fr-FR-RemyMultilingualNeural voice from azure. I need the agent to...

dangerous-fuchsia•8/1/24, 9:19 PM

can you please share the call id along with actual vs expected response.

Ddangerous-fuchsia can you please share the call id along with actual vs expected response.

military-pinkOP•8/2/24, 7:27 AM

yes, for example here : bdb55646-c604-4384-ae16-74728166ef55
The bot starts to give me the ID in english

military-pinkOP•8/2/24, 7:30 AM

same here : abd8ea94-8fef-4d15-a53f-f0a8f9da5126
at the end the bot gives me the ID in something that looks like german, instead of giving it to me in french

Mmilitary-pink yes, for example here : bdb55646-c604-4384-ae16-74728166ef55 The bot starts to g...

dangerous-fuchsia•8/2/24, 8:13 PM

there is no english trasncription for this call id.

{
"role": "bot",
"time": 1722519640868,
"source": "",
"endTime": 1722519644728,
"message": "Bonjour, Audi By my car Lyon Nord à votre service,",
"secondsFromStart": 1.04
},
{
"role": "user",
"time": 1722519651608,
"endTime": 1722519652288,
"message": "Oui alors",
"duration": 1.1599998,
"secondsFromStart": 11.78
},
{
"role": "bot",
"time": 1722519652948.001,
"source": "",
"endTime": 1722519665798,
"message": "Je suppose donc que vous appelez pour connaître le statut de votre véhicule. Merci de votre appel. Votre demande concerne t l votre véhicule Peugeot quatre cent 6 avec la plaque d'immatriculation. Eux,",
"secondsFromStart": 13.120001
}

Mmilitary-pink same here : abd8ea94-8fef-4d15-a53f-f0a8f9da5126 at the end the bot gives me the...

dangerous-fuchsia•8/2/24, 8:15 PM

same with this call id no transcrription in english.

dangerous-fuchsia•8/2/24, 8:15 PM

please check the call ids.

military-pinkOP•8/5/24, 7:39 AM

@Shubham Bajaj the problem is the ID that looks like 'AD132FB' (2 letters followed by 3 digits, and then 2 letters again) is being prononced as an english (or german or whatever, it depends) word

Mmilitary-pink @Shubham Bajaj the problem is the ID that looks like 'AD132FB' (2 letters follow...

dangerous-fuchsia•8/5/24, 2:31 PM

i couldn't any word similar to this in transcription instead you can ask LLM to give numbers output in language you require.

dangerous-fuchsia•8/5/24, 2:31 PM

let me know if it works.

Ddangerous-fuchsia i couldn't any word similar to this in transcription instead you can ask LLM to ...

military-pinkOP•8/6/24, 7:57 AM

allready done but that does not work